Sep 19 04:11:47.670708 ip-10-0-130-52 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 19 04:11:47.670723 ip-10-0-130-52 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 19 04:11:47.670734 ip-10-0-130-52 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 19 04:11:47.671075 ip-10-0-130-52 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 19 04:11:57.919665 ip-10-0-130-52 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 19 04:11:57.919682 ip-10-0-130-52 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4299aa8498f74f31aef994c5b7fd8549 --
Sep 19 04:13:39.901067 ip-10-0-130-52 systemd[1]: Starting Kubernetes Kubelet...
Sep 19 04:13:40.307210 ip-10-0-130-52 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 04:13:40.307210 ip-10-0-130-52 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 19 04:13:40.307210 ip-10-0-130-52 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 04:13:40.307210 ip-10-0-130-52 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 19 04:13:40.307210 ip-10-0-130-52 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 04:13:40.308447 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.308355    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 19 04:13:40.312486 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312468    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 04:13:40.312486 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312486    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312490    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312495    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312498    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312501    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312504    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312507    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312516    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312519    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312522    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312525    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312527    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312530    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312533    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312535    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312538    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312541    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312544    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312546    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312549    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 04:13:40.312557 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312552    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312554    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312558    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312561    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312563    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312566    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312569    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312572    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312574    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312578    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312580    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312582    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312585    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312587    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312590    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312592    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312596    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312600    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312603    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312607    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 04:13:40.313139 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312609    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312612    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312615    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312617    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312619    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312622    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312625    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312627    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312630    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312632    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312643    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312646    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312648    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312654    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312658    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312662    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312665    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312668    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312670    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 04:13:40.313857 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312673    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312675    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312678    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312681    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312683    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312686    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312688    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312691    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312693    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312696    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312698    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312700    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312703    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312706    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312709    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312712    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312714    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312717    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312719    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 04:13:40.314434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312722    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312724    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312727    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312729    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312732    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312734    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312738    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312741    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312760    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312764    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312767    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312769    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312772    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312775    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312778    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312781    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312784    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312787    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312789    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 04:13:40.315025 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.312792    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315149    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315162    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315165    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315169    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315172    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315175    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315178    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315182    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315184    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315187    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315190    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315192    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315195    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315197    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315200    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315202    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315205    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315208    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315211    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 04:13:40.315485 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315214    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315217    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315219    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315222    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315225    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315227    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315231    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315236    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315239    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315242    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315246    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315248    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315251    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315253    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315257    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315260    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315263    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315266    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315269    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315271    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 04:13:40.316097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315274    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315277    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315279    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315282    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315285    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315287    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315289    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315292    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315295    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315297    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315299    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315302    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315304    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315307    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315309    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315313    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315318    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315320    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315323    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 04:13:40.316622 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315326    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315329    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315332    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315335    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315338    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315340    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315343    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315347    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315351    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315355    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315358    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315361    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315364    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315367    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315370    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315372    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315375    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315377    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315380    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 04:13:40.317112 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315383    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315385    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315388    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315390    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315392    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315395    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315399    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315402    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315404    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315407    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315410    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315412    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315415    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315417    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315419    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315422    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315425    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315428    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315430    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315433    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 04:13:40.317599 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315436    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315439    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315840    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315845    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315849    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315852    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315855    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315857    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315861    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315865    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315868    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315872    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315876    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315879    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315881    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315885    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315888    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315890    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 04:13:40.318097 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315893    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315896    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315899    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315903    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315906    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315909    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315913    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315915    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315918    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315920    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315927    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315930    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315932    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315935    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315938    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315940    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315943    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315946    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315948    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315951    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 04:13:40.318566 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315953    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315956    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315959    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315961    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315964    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315967    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315969    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315972    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315975    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315977    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315980    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315982    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315985    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315988    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315990    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315993    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315995    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.315998    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316001    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316003    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 04:13:40.319069 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316006    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316008    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316012    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316015    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316017    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316020    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316022    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316025    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316027    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316030    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316032    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316035    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316037    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316040    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316043    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316045    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316048    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316051    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316053    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316056    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 04:13:40.319543 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316059    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316061    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316064    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316066    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316068    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316071    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316074    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316076    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316079    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316082    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316084    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316087    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316089    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316092    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316096    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316098    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316101    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316104    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316106    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316109    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 04:13:40.320071 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316111    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316114    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316116    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316192    2569 flags.go:64] FLAG: --address="0.0.0.0"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316231    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316238    2569 flags.go:64] FLAG: --anonymous-auth="true"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316243    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316247    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316251    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316255    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316260    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316263    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316266    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316269    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316273    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316276    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316279    2569 flags.go:64] FLAG: --cgroup-root=""
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316282    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316284    2569 flags.go:64] FLAG: --client-ca-file=""
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316288    2569 flags.go:64] FLAG: --cloud-provider="external"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316291    2569 flags.go:64] FLAG: --cluster-dns="[]"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316295    2569 flags.go:64] FLAG: --cluster-domain=""
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316298    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316301    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 19 04:13:40.320555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316304    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316307    2569 flags.go:64] FLAG: --container-log-max-files="5"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316317    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316320    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316322    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316325    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316329    2569 flags.go:64] FLAG: --contention-profiling="false"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316331    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316334    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316337    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316340    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316344    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316347    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316350    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316353    2569 flags.go:64] FLAG: --enable-load-reader="false"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316356    2569 flags.go:64] FLAG: --enable-server="true"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316359    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316364    2569 flags.go:64] FLAG: --event-burst="100"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316367    2569 flags.go:64] FLAG: --event-qps="50"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316370    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316373    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316375    2569 flags.go:64] FLAG: --eviction-hard=""
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316379    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316382    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316385    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 19 04:13:40.321154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316388    2569 flags.go:64] FLAG: --eviction-soft=""
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316391    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316393    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316396    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316399    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316402    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316405    2569 flags.go:64] FLAG: --fail-swap-on="true"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316408    2569 flags.go:64] FLAG: --feature-gates=""
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316411    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316416    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316419    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316422    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316425    2569 flags.go:64] FLAG: --healthz-port="10248"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316428    2569 flags.go:64] FLAG: --help="false"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316431    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316434    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316437    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316440    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316443    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316446    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316449    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316452    2569 flags.go:64] FLAG: --image-service-endpoint=""
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316455    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 19 04:13:40.321784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316458    2569 flags.go:64] FLAG: --kube-api-burst="100"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316460    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316464    2569 flags.go:64] FLAG: --kube-api-qps="50"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316466    2569 flags.go:64] FLAG: --kube-reserved=""
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316469    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316472    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316475    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316477    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316480    2569 flags.go:64] FLAG: --lock-file=""
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316483    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316486    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316489    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316494    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316497    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316500    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316503    2569 flags.go:64] FLAG: --logging-format="text"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316506    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316509    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316512    2569 flags.go:64] FLAG: --manifest-url=""
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316515    2569 flags.go:64] FLAG: --manifest-url-header=""
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316520    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316523    2569 flags.go:64] FLAG: --max-open-files="1000000"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316527    2569 flags.go:64] FLAG: --max-pods="110"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316530    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316533    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 19 04:13:40.322393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316536    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316539    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316542    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316544    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316547    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316555    2569 flags.go:64] FLAG: --node-status-max-images="50"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316558    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316561    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316564    2569 flags.go:64] FLAG: --pod-cidr=""
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316567    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316572    2569 flags.go:64] FLAG: --pod-manifest-path=""
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316575    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316578    2569 flags.go:64] FLAG: --pods-per-core="0"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316581    2569 flags.go:64] FLAG: --port="10250"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316584    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316587    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b187dcfac0a0028a"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316590    2569 flags.go:64] FLAG: --qos-reserved=""
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316593    2569 flags.go:64] FLAG: --read-only-port="10255"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316596    2569 flags.go:64] FLAG: --register-node="true"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316598    2569 flags.go:64] FLAG: --register-with-taints=""
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316601    2569 flags.go:64] FLAG: --registry-burst="10"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316605    2569 flags.go:64] FLAG: --registry-qps="5"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316608    2569 flags.go:64] FLAG: --reserved-cpus=""
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316610    2569 flags.go:64] FLAG: --reserved-memory=""
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316614    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 19 04:13:40.323042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316617    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316621    2569 flags.go:64] FLAG: --rotate-certificates="false"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316626    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316628    2569 flags.go:64] FLAG: --runonce="false"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316631    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316644    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316647    2569 flags.go:64] FLAG: --seccomp-default="false"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316650    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316653    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316656    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316659    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316662    2569 flags.go:64] FLAG: --storage-driver-password="root"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316665    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316668    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316671    2569 flags.go:64] FLAG: --storage-driver-user="root"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316674    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316677    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316679    2569 flags.go:64] FLAG: --system-cgroups=""
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316682    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316687    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316690    2569 flags.go:64] FLAG: --tls-cert-file=""
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316693    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316697    2569 flags.go:64] FLAG: --tls-min-version=""
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316699    2569 flags.go:64] FLAG: --tls-private-key-file=""
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316702    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 19 04:13:40.323674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316705    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316707    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316710    2569 flags.go:64] FLAG: --v="2"
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316714    2569 flags.go:64] FLAG: --version="false"
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316722    2569 flags.go:64] FLAG: --vmodule=""
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316725    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.316728    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316884    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316891    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316895    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316898    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316901    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316903    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316907    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316911    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316914    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316917    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316920    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316923    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316925    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316928    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 04:13:40.324308 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316931    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316933    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316936    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316938    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316941    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316944    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316946    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316949    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316952    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316954    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316957    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316960    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316962    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316965    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316967    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316970    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316977    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316980    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316982    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316986    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 04:13:40.324899 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316993    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316996    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.316999    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317002    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317004    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317007    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317010    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317013    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317016    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317018    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317021    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317023    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317025    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317028    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317031    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317033    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317036    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317038    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317041    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 04:13:40.325396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317043    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317047    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317051    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317053    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317056    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317059    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317061    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317063    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317066    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317068    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317072    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317074    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317078    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317082    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317084    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317087    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317089    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317092    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317094    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 04:13:40.325878 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317097    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317099    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317102    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317104    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317107    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317109    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317112    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317114    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317117    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317120    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317123    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317126    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317129    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317131    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317134    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317136    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317138    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317141    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317143    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317146    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 04:13:40.326343 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317148    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 04:13:40.326841 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317151    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 04:13:40.326841 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317153    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 04:13:40.326841 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317156    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 04:13:40.326841 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317161    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 04:13:40.326841 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317165    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 04:13:40.326841 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.317169    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 04:13:40.326841 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.317874    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 04:13:40.326841 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.325803    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 19 04:13:40.326841 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.325823    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 19 04:13:40.326841 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.325845    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 19 04:13:40.326841 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.325855    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 19 04:13:40.326841 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325913    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 04:13:40.326841 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325918    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 04:13:40.326841 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325921    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325924    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325928    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325931    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325933    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325936    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325939    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325942    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325944    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325949    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325953    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325956    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325959    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325962    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325965    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325968    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325971    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325973    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325976    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 04:13:40.327226 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325979    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325981    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325984    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325986    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325989    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325992    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325994    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.325997    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326001    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326005    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326008    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326010    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326013    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326016    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326018    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326021    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326024    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326026    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326029    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326031    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 04:13:40.327678 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326034    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326036    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326039    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326042    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326044    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326047    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326050    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326052    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326055    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326057    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326060    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326064    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326068    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326070    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326073    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326075    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326078    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326081    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326084    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326086    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 04:13:40.328176 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326090    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326095    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326099    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326102    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326105    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326107    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326111    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326114    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326117    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326120    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326122    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326125    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326128    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326130    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326133    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326136    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326139    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326141    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326144    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 04:13:40.328673 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326146    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326149    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326151    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326154    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326158    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326161    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326163    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326166    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326168    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326171    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326173    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326176    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326179    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326182    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326184    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326187    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326190    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326193    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 04:13:40.329266 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326195    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 04:13:40.329695 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.326201    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 04:13:40.329695 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326352    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 04:13:40.329695 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326358    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 04:13:40.329695 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326361    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 04:13:40.329695 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326364    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 04:13:40.329695 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326368    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 04:13:40.329695 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326371    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 04:13:40.329695 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326373    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 04:13:40.329695 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326376    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 04:13:40.329695 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326379    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 04:13:40.329695 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326382    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 04:13:40.329695 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326384    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 04:13:40.329695 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326387    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 04:13:40.329695 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326390    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326394    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326397    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326400    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326403    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326406    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326409    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326412    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326415    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326418    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326420    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326423    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326426    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326428    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326431    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326434    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326443    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326446    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326449    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326451    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 04:13:40.330047 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326454    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326456    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326459    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326461    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326464    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326466    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326469    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326471    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326474    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326476    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326478    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326482    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326486    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326488    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326491    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326494    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326497    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326500    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326503    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326506    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 04:13:40.330532 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326508    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326511    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326513    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326516    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326518    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326521    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326523    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326526    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326528    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326536    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326539    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326542    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326544    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326547    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326549    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326552    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326554    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326557    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326559    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326561    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 04:13:40.331026 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326564    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326567    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326569    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326572    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326574    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326577    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326579    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326581    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326585    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326587    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326590    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326592    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326595    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326597    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326600    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326602    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326605    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326607    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326610    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326612    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 04:13:40.331502 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326615    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 04:13:40.332002 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326617    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 04:13:40.332002 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326628    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 04:13:40.332002 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326632    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 04:13:40.332002 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326634    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 04:13:40.332002 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326637    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 04:13:40.332002 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:40.326639    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 04:13:40.332002 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.326644    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 04:13:40.332002 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.326812    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 19 04:13:40.332002 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.329406    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 19 04:13:40.332002 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.330524    2569 server.go:1019] "Starting client certificate rotation"
Sep 19 04:13:40.332002 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.330631    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 04:13:40.332002 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.330666    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 04:13:40.333624 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.333609    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 04:13:40.337421 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.337399    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 04:13:40.352670 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.352649    2569 log.go:25] "Validated CRI v1 runtime API"
Sep 19 04:13:40.354420 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.354400    2569 log.go:25] "Validated CRI v1 image API"
Sep 19 04:13:40.356017 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.356004    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 19 04:13:40.359235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.359215    2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a7766dd3-97e0-43f4-bb62-8635561c1580:/dev/nvme0n1p3 b48816dd-f99a-4fe6-907d-20cf94f16000:/dev/nvme0n1p4]
Sep 19 04:13:40.359280 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.359235    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 19 04:13:40.365094 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.365073    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 04:13:40.365470 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.365357    2569 manager.go:216] Machine: {Timestamp:2026-09-19 04:13:40.362898294 +0000 UTC m=+0.341094675 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3039034 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23472bfc155d31b85f629a299d19e9 SystemUUID:ec23472b-fc15-5d31-b85f-629a299d19e9 BootID:4299aa84-98f7-4f31-aef9-94c5b7fd8549 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ca:60:14:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ca:60:14:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:14:92:6f:05:bf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 19 04:13:40.365470 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.365464    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 19 04:13:40.365577 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.365550    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 19 04:13:40.369080 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.369054    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 19 04:13:40.369257 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.369082    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-52.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 19 04:13:40.369955 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.369943    2569 topology_manager.go:138] "Creating topology manager with none policy"
Sep 19 04:13:40.370020 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.369963    2569 container_manager_linux.go:309] "Creating device plugin manager"
Sep 19 04:13:40.370020 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.369974    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 04:13:40.370764 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.370734    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 04:13:40.370854 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.370843    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 19 04:13:40.375183 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.375170    2569 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 04:13:40.375315 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.375304    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 19 04:13:40.375370 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.375345    2569 kubelet.go:486] "Attempting to sync node with API server"
Sep 19 04:13:40.375370 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.375359    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 19 04:13:40.375469 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.375375    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 19 04:13:40.375469 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.375389    2569 kubelet.go:398] "Adding apiserver pod source"
Sep 19 04:13:40.375469 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.375401    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 19 04:13:40.375824 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.375810    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 04:13:40.375898 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.375833    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 04:13:40.378119 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.378104    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 19 04:13:40.380920 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.380906    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 19 04:13:40.380969 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.380937    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 19 04:13:40.382418 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.382404    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 19 04:13:40.382456 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.382435    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 19 04:13:40.382456 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.382445    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 19 04:13:40.382456 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.382454    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 19 04:13:40.382529 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.382466    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 19 04:13:40.382529 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.382472    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 19 04:13:40.382529 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.382491    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 19 04:13:40.382529 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.382496    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 19 04:13:40.382529 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.382504    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 19 04:13:40.382529 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.382510    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 19 04:13:40.382529 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.382518    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 19 04:13:40.382529 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.382525    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 19 04:13:40.383464 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.383451    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 19 04:13:40.383464 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.383465    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 19 04:13:40.384609 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.384584    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 19 04:13:40.385017 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.384986    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 19 04:13:40.386693 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.386675    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-52.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 19 04:13:40.387892 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.387878    2569 server.go:1268] "Started kubelet"
Sep 19 04:13:40.388013 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.387960    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 19 04:13:40.388070 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.388041    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 19 04:13:40.388192 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.388053    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 19 04:13:40.389144 ip-10-0-130-52 systemd[1]: Started Kubernetes Kubelet.
Sep 19 04:13:40.389520 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.389498    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 19 04:13:40.393160 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.393141    2569 server.go:310] "Adding debug handlers to kubelet server"
Sep 19 04:13:40.393642 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.393614    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 19 04:13:40.397833 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.396720    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-52.ec2.internal.18d69da1d954b00b  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-52.ec2.internal,UID:ip-10-0-130-52.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-52.ec2.internal,},FirstTimestamp:2026-09-19 04:13:40.387852299 +0000 UTC m=+0.366048679,LastTimestamp:2026-09-19 04:13:40.387852299 +0000 UTC m=+0.366048679,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-52.ec2.internal,}"
Sep 19 04:13:40.400668 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.400488    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 19 04:13:40.401158 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.401137    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 19 04:13:40.401808 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.401460    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-52.ec2.internal\" not found"
Sep 19 04:13:40.401971 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.401955    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 19 04:13:40.402037 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.401956    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 19 04:13:40.402037 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.402004    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 19 04:13:40.402127 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.402077    2569 reconstruct.go:97] "Volume reconstruction finished"
Sep 19 04:13:40.402127 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.402088    2569 reconciler.go:29] "Reconciler: start to sync state"
Sep 19 04:13:40.402214 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.402131    2569 factory.go:55] Registering systemd factory
Sep 19 04:13:40.402214 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.402157    2569 factory.go:223] Registration of the systemd container factory successfully
Sep 19 04:13:40.402414 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.402399    2569 factory.go:153] Registering CRI-O factory
Sep 19 04:13:40.402455 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.402418    2569 factory.go:223] Registration of the crio container factory successfully
Sep 19 04:13:40.402487 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.402477    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 19 04:13:40.402524 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.402500    2569 factory.go:103] Registering Raw factory
Sep 19 04:13:40.402524 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.402515    2569 manager.go:1196] Started watching for new ooms in manager
Sep 19 04:13:40.403030 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.403005    2569 manager.go:349] Starting recovery of all containers
Sep 19 04:13:40.403533 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.403506    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-52.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 19 04:13:40.403862 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.403844    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 19 04:13:40.409487 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.409463    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5f2n7"
Sep 19 04:13:40.413428 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.413414    2569 manager.go:354] Recovery completed
Sep 19 04:13:40.418922 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.418908    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:40.420585 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.420570    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5f2n7"
Sep 19 04:13:40.421478 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.421463    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:40.421539 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.421491    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:40.421539 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.421501    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:40.422249 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.422234    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 19 04:13:40.422339 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.422258    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:40.422339 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.422263    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 19 04:13:40.422422 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.422341    2569 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 04:13:40.423105 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.423086    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:40.423171 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.423121    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:40.423171 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.423136    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:40.424691 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.424679    2569 policy_none.go:49] "None policy: Start"
Sep 19 04:13:40.424691 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.424695    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 19 04:13:40.424811 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.424706    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 19 04:13:40.426712 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.426695    2569 policy_none.go:47] "Start"
Sep 19 04:13:40.459314 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.459298    2569 manager.go:337] "Starting Device Plugin manager"
Sep 19 04:13:40.482847 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.459336    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 19 04:13:40.482847 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.459349    2569 server.go:87] "Starting device plugin registration server"
Sep 19 04:13:40.482847 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.459761    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 19 04:13:40.482847 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.459778    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 19 04:13:40.482847 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.459961    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 19 04:13:40.482847 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.460037    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 19 04:13:40.482847 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.460045    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 19 04:13:40.482847 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.460493    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 19 04:13:40.482847 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.460548    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-52.ec2.internal\" not found"
Sep 19 04:13:40.530782 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.530728    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 19 04:13:40.532259 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.532239    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 19 04:13:40.532372 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.532298    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 19 04:13:40.532372 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.532335    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 19 04:13:40.532483 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.532372    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 19 04:13:40.535164 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.535149    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 04:13:40.560419 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.560328    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:40.561258 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.561243    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:40.561332 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.561272    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:40.561332 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.561283    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:40.561332 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.561307    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.571041 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.571025    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.571097 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.571049    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-52.ec2.internal\": node \"ip-10-0-130-52.ec2.internal\" not found"
Sep 19 04:13:40.591190 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.591156    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-52.ec2.internal\" not found"
Sep 19 04:13:40.633326 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.633287    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-52.ec2.internal"]
Sep 19 04:13:40.633481 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.633373    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:40.634371 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.634354    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:40.634474 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.634381    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:40.634474 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.634391    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:40.637321 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.637309    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:40.637477 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.637462    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.637515 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.637498    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:40.638162 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.638128    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:40.638162 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.638163    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:40.638306 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.638178    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:40.638306 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.638185    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:40.638306 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.638206    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:40.638306 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.638215    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:40.640248 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.640232    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.640344 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.640258    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:40.640981 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.640963    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:40.641077 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.640992    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:40.641077 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.641007    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:40.671480 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.671454    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-52.ec2.internal\" not found" node="ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.675993 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.675976    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-52.ec2.internal\" not found" node="ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.691666 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.691645    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-52.ec2.internal\" not found"
Sep 19 04:13:40.792417 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.792377    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-52.ec2.internal\" not found"
Sep 19 04:13:40.802613 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.802585    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62749e283bd453af448090af420e93bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal\" (UID: \"62749e283bd453af448090af420e93bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.802716 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.802622    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62749e283bd453af448090af420e93bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal\" (UID: \"62749e283bd453af448090af420e93bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.802716 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.802640    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/62ca4fb25798dbdda7b410bc15fd658c-config\") pod \"kube-apiserver-proxy-ip-10-0-130-52.ec2.internal\" (UID: \"62ca4fb25798dbdda7b410bc15fd658c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.893170 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.893138    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-52.ec2.internal\" not found"
Sep 19 04:13:40.903427 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.903403    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62749e283bd453af448090af420e93bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal\" (UID: \"62749e283bd453af448090af420e93bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.903549 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.903434    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62749e283bd453af448090af420e93bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal\" (UID: \"62749e283bd453af448090af420e93bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.903549 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.903449    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/62ca4fb25798dbdda7b410bc15fd658c-config\") pod \"kube-apiserver-proxy-ip-10-0-130-52.ec2.internal\" (UID: \"62ca4fb25798dbdda7b410bc15fd658c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.903549 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.903513    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/62ca4fb25798dbdda7b410bc15fd658c-config\") pod \"kube-apiserver-proxy-ip-10-0-130-52.ec2.internal\" (UID: \"62ca4fb25798dbdda7b410bc15fd658c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.903549 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.903517    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/62749e283bd453af448090af420e93bf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal\" (UID: \"62749e283bd453af448090af420e93bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.903549 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.903535    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/62749e283bd453af448090af420e93bf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal\" (UID: \"62749e283bd453af448090af420e93bf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.975617 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.975588    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.979213 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:40.979190    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:40.993440 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:40.993418    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-52.ec2.internal\" not found"
Sep 19 04:13:41.093951 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:41.093888    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-52.ec2.internal\" not found"
Sep 19 04:13:41.194418 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:41.194346    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-52.ec2.internal\" not found"
Sep 19 04:13:41.294917 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:41.294876    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-52.ec2.internal\" not found"
Sep 19 04:13:41.330361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:41.330340    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 19 04:13:41.330781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:41.330525    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 19 04:13:41.380115 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:41.380090    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 04:13:41.395824 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:41.395798    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-52.ec2.internal\" not found"
Sep 19 04:13:41.427609 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:41.427576    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 04:08:40 +0000 UTC" deadline="2028-03-21 19:06:12.448545522 +0000 UTC"
Sep 19 04:13:41.427609 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:41.427602    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13190h52m31.020946266s"
Sep 19 04:13:41.496288 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:41.496225    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-52.ec2.internal\" not found"
Sep 19 04:13:41.597035 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:41.597003    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-52.ec2.internal\" not found"
Sep 19 04:13:41.623542 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:41.623518    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 04:13:41.666548 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:41.666506    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62749e283bd453af448090af420e93bf.slice/crio-d63c166afb4d42a1bfc858b07e12a71e7543d0dba19ab06a99b0fe8b5b863a4c WatchSource:0}: Error finding container d63c166afb4d42a1bfc858b07e12a71e7543d0dba19ab06a99b0fe8b5b863a4c: Status 404 returned error can't find the container with id d63c166afb4d42a1bfc858b07e12a71e7543d0dba19ab06a99b0fe8b5b863a4c
Sep 19 04:13:41.666963 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:41.666942    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62ca4fb25798dbdda7b410bc15fd658c.slice/crio-a9e9c450e4eaee39e059414b4860b4959f8ae8cfd6f35c4dd58494d96eef7190 WatchSource:0}: Error finding container a9e9c450e4eaee39e059414b4860b4959f8ae8cfd6f35c4dd58494d96eef7190: Status 404 returned error can't find the container with id a9e9c450e4eaee39e059414b4860b4959f8ae8cfd6f35c4dd58494d96eef7190
Sep 19 04:13:41.672347 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:41.672329    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 04:13:41.701535 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:41.701514    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:41.709113 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:41.709095    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 04:13:41.721502 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:41.721484    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 04:13:41.722661 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:41.722649    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-52.ec2.internal"
Sep 19 04:13:41.752421 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:41.752357    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 04:13:42.376383 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.376347    2569 apiserver.go:52] "Watching apiserver"
Sep 19 04:13:42.385220 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.385187    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 19 04:13:42.385829 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.385795    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-krt5k","openshift-ovn-kubernetes/ovnkube-node-v94sd","kube-system/global-pull-secret-syncer-9msr4","kube-system/kube-apiserver-proxy-ip-10-0-130-52.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal","openshift-multus/multus-additional-cni-plugins-25d84","openshift-multus/network-metrics-daemon-twvwv","openshift-network-diagnostics/network-check-target-hzrtl","openshift-network-operator/iptables-alerter-psrqr","kube-system/konnectivity-agent-nlbdx","openshift-cluster-node-tuning-operator/tuned-ph2hm","openshift-dns/node-resolver-j7hp9","openshift-image-registry/node-ca-25lfw"]
Sep 19 04:13:42.389551 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.389527    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-psrqr"
Sep 19 04:13:42.394764 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.394737    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7hp9"
Sep 19 04:13:42.397149 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.397127    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:42.397288 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:42.397242    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:13:42.398865 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.398840    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rf9c9\""
Sep 19 04:13:42.398971 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.398916    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 19 04:13:42.399194 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.399176    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 19 04:13:42.399826 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.399515    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 19 04:13:42.399826 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.399660    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xh47w\""
Sep 19 04:13:42.399826 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.399690    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 19 04:13:42.400008 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.399923    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 19 04:13:42.401049 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.401021    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 19 04:13:42.401997 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.401703    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-25lfw"
Sep 19 04:13:42.403723 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.403701    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.405248 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.405223    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 19 04:13:42.406368 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.405993    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 19 04:13:42.406368 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.406084    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:42.406368 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:42.406144    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:13:42.406861 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.406837    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 19 04:13:42.407203 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.407181    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xhwtw\""
Sep 19 04:13:42.407375 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.407357    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 19 04:13:42.407523 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.407506    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 19 04:13:42.407848 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.407829    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 19 04:13:42.409429 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.409407    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:42.409530 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:42.409504    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:13:42.412252 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412226    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-sys-fs\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.412352 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412286    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhrbb\" (UniqueName: \"kubernetes.io/projected/29727eca-ca7c-4741-b3a9-829a920ba7ee-kube-api-access-hhrbb\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.412352 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412316    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0793a29-db71-4d86-af83-a59132434a7e-iptables-alerter-script\") pod \"iptables-alerter-psrqr\" (UID: \"f0793a29-db71-4d86-af83-a59132434a7e\") " pod="openshift-network-operator/iptables-alerter-psrqr"
Sep 19 04:13:42.412352 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412347    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80adac8f-4c32-43bf-8ecc-e127f28b7b7a-serviceca\") pod \"node-ca-25lfw\" (UID: \"80adac8f-4c32-43bf-8ecc-e127f28b7b7a\") " pod="openshift-image-registry/node-ca-25lfw"
Sep 19 04:13:42.412522 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412376    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.412522 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412403    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.412522 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412426    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80adac8f-4c32-43bf-8ecc-e127f28b7b7a-host\") pod \"node-ca-25lfw\" (UID: \"80adac8f-4c32-43bf-8ecc-e127f28b7b7a\") " pod="openshift-image-registry/node-ca-25lfw"
Sep 19 04:13:42.412522 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412451    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-registration-dir\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.412522 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412476    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70dadf06-e872-445e-9238-112acc1a782f-hosts-file\") pod \"node-resolver-j7hp9\" (UID: \"70dadf06-e872-445e-9238-112acc1a782f\") " pod="openshift-dns/node-resolver-j7hp9"
Sep 19 04:13:42.412522 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412502    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70dadf06-e872-445e-9238-112acc1a782f-tmp-dir\") pod \"node-resolver-j7hp9\" (UID: \"70dadf06-e872-445e-9238-112acc1a782f\") " pod="openshift-dns/node-resolver-j7hp9"
Sep 19 04:13:42.412844 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412553    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-dbus\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:42.412844 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412581    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjcf6\" (UniqueName: \"kubernetes.io/projected/80adac8f-4c32-43bf-8ecc-e127f28b7b7a-kube-api-access-rjcf6\") pod \"node-ca-25lfw\" (UID: \"80adac8f-4c32-43bf-8ecc-e127f28b7b7a\") " pod="openshift-image-registry/node-ca-25lfw"
Sep 19 04:13:42.412844 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412608    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-socket-dir\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.412844 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412633    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv55s\" (UniqueName: \"kubernetes.io/projected/f0793a29-db71-4d86-af83-a59132434a7e-kube-api-access-kv55s\") pod \"iptables-alerter-psrqr\" (UID: \"f0793a29-db71-4d86-af83-a59132434a7e\") " pod="openshift-network-operator/iptables-alerter-psrqr"
Sep 19 04:13:42.412844 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412666    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wrtc\" (UniqueName: \"kubernetes.io/projected/70dadf06-e872-445e-9238-112acc1a782f-kube-api-access-2wrtc\") pod \"node-resolver-j7hp9\" (UID: \"70dadf06-e872-445e-9238-112acc1a782f\") " pod="openshift-dns/node-resolver-j7hp9"
Sep 19 04:13:42.412844 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412709    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:42.412844 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412726    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.412844 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412734    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-device-dir\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.412844 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412765    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0793a29-db71-4d86-af83-a59132434a7e-host-slash\") pod \"iptables-alerter-psrqr\" (UID: \"f0793a29-db71-4d86-af83-a59132434a7e\") " pod="openshift-network-operator/iptables-alerter-psrqr"
Sep 19 04:13:42.413360 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.412861    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-kubelet-config\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:42.415323 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.415299    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.417142 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.417124    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9xfg7\""
Sep 19 04:13:42.417549 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.417513    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.417658 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.417637    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 19 04:13:42.420305 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.420285    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 19 04:13:42.420414 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.420332    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nlbdx"
Sep 19 04:13:42.421492 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.421471    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 19 04:13:42.421609 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.421593    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 19 04:13:42.421716 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.421696    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 19 04:13:42.421913 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.421893    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 19 04:13:42.421991 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.421947    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 19 04:13:42.422360 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.422342    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 19 04:13:42.422623 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.422607    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 19 04:13:42.422623 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.422618    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c5xfx\""
Sep 19 04:13:42.423051 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.423029    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.428754 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.428733    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7xx4p\""
Sep 19 04:13:42.428996 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.428969    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hsjsd\""
Sep 19 04:13:42.429092 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.429046    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 19 04:13:42.429319 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.429300    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 19 04:13:42.429848 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.429807    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 19 04:13:42.429984 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.429952    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5hxrf\""
Sep 19 04:13:42.430073 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.430053    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 19 04:13:42.430139 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.430130    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 19 04:13:42.430249 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.430233    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 04:13:42.430370 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.430354    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tvn8m\""
Sep 19 04:13:42.430633 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.430616    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 19 04:13:42.430940 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.430919    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 19 04:13:42.477375 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.474919    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wtzwd"
Sep 19 04:13:42.491489 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.491455    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wtzwd"
Sep 19 04:13:42.503244 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.503220    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 19 04:13:42.513920 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.513890    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-multus-socket-dir-parent\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.514051 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.513926    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx7gp\" (UniqueName: \"kubernetes.io/projected/8003fa5c-0817-4994-8405-7bc431ab1c36-kube-api-access-rx7gp\") pod \"network-metrics-daemon-twvwv\" (UID: \"8003fa5c-0817-4994-8405-7bc431ab1c36\") " pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:42.514051 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.513953    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-run-ovn\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.514051 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.513976    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee26e518-d640-482f-842a-b74e6afa7e3c-ovnkube-script-lib\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.514051 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-sys\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.514330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514080    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-host\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.514330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514119    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjcf6\" (UniqueName: \"kubernetes.io/projected/80adac8f-4c32-43bf-8ecc-e127f28b7b7a-kube-api-access-rjcf6\") pod \"node-ca-25lfw\" (UID: \"80adac8f-4c32-43bf-8ecc-e127f28b7b7a\") " pod="openshift-image-registry/node-ca-25lfw"
Sep 19 04:13:42.514330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514144    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv55s\" (UniqueName: \"kubernetes.io/projected/f0793a29-db71-4d86-af83-a59132434a7e-kube-api-access-kv55s\") pod \"iptables-alerter-psrqr\" (UID: \"f0793a29-db71-4d86-af83-a59132434a7e\") " pod="openshift-network-operator/iptables-alerter-psrqr"
Sep 19 04:13:42.514330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514169    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wrtc\" (UniqueName: \"kubernetes.io/projected/70dadf06-e872-445e-9238-112acc1a782f-kube-api-access-2wrtc\") pod \"node-resolver-j7hp9\" (UID: \"70dadf06-e872-445e-9238-112acc1a782f\") " pod="openshift-dns/node-resolver-j7hp9"
Sep 19 04:13:42.514330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514226    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/028ebdc9-75c6-46e1-9322-c25d3a774fb3-tmp\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.514330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514250    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0793a29-db71-4d86-af83-a59132434a7e-host-slash\") pod \"iptables-alerter-psrqr\" (UID: \"f0793a29-db71-4d86-af83-a59132434a7e\") " pod="openshift-network-operator/iptables-alerter-psrqr"
Sep 19 04:13:42.514330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514274    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e02cfaf0-083f-4fc0-b915-6d328825c71c-cnibin\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.514330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514299    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-system-cni-dir\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.514330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514324    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-modprobe-d\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514342    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70dadf06-e872-445e-9238-112acc1a782f-tmp-dir\") pod \"node-resolver-j7hp9\" (UID: \"70dadf06-e872-445e-9238-112acc1a782f\") " pod="openshift-dns/node-resolver-j7hp9"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514363    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhrbb\" (UniqueName: \"kubernetes.io/projected/29727eca-ca7c-4741-b3a9-829a920ba7ee-kube-api-access-hhrbb\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514384    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0793a29-db71-4d86-af83-a59132434a7e-iptables-alerter-script\") pod \"iptables-alerter-psrqr\" (UID: \"f0793a29-db71-4d86-af83-a59132434a7e\") " pod="openshift-network-operator/iptables-alerter-psrqr"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514392    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0793a29-db71-4d86-af83-a59132434a7e-host-slash\") pod \"iptables-alerter-psrqr\" (UID: \"f0793a29-db71-4d86-af83-a59132434a7e\") " pod="openshift-network-operator/iptables-alerter-psrqr"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514408    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-systemd-units\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514435    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-systemd\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514459    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-lib-modules\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514483    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-var-lib-kubelet\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514520    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-dbus\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514547    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-multus-cni-dir\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514571    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6aa05739-7ebf-490c-b4e5-1dafcca312f3-multus-daemon-config\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514595    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-etc-kubernetes\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514623    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee26e518-d640-482f-842a-b74e6afa7e3c-env-overrides\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514644    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-sysctl-d\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514690    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e02cfaf0-083f-4fc0-b915-6d328825c71c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514708    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-run-k8s-cni-cncf-io\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.514781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514724    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-var-lib-cni-bin\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514740    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xmvl\" (UniqueName: \"kubernetes.io/projected/6aa05739-7ebf-490c-b4e5-1dafcca312f3-kube-api-access-5xmvl\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514764    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a48add2c-d95d-4119-8461-b322d6e6b9ee-konnectivity-ca\") pod \"konnectivity-agent-nlbdx\" (UID: \"a48add2c-d95d-4119-8461-b322d6e6b9ee\") " pod="kube-system/konnectivity-agent-nlbdx"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514791    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-run-netns\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514838    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514870    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-device-dir\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514887    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-kubelet-config\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514905    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-run\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.514973    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70dadf06-e872-445e-9238-112acc1a782f-hosts-file\") pod \"node-resolver-j7hp9\" (UID: \"70dadf06-e872-445e-9238-112acc1a782f\") " pod="openshift-dns/node-resolver-j7hp9"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515006    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-sys-fs\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515032    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515061    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-run-netns\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515086    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-slash\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515110    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-node-log\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515131    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee26e518-d640-482f-842a-b74e6afa7e3c-ovn-node-metrics-cert\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515156    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80adac8f-4c32-43bf-8ecc-e127f28b7b7a-host\") pod \"node-ca-25lfw\" (UID: \"80adac8f-4c32-43bf-8ecc-e127f28b7b7a\") " pod="openshift-image-registry/node-ca-25lfw"
Sep 19 04:13:42.515640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515187    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e02cfaf0-083f-4fc0-b915-6d328825c71c-cni-binary-copy\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515208    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e02cfaf0-083f-4fc0-b915-6d328825c71c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515229    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a48add2c-d95d-4119-8461-b322d6e6b9ee-agent-certs\") pod \"konnectivity-agent-nlbdx\" (UID: \"a48add2c-d95d-4119-8461-b322d6e6b9ee\") " pod="kube-system/konnectivity-agent-nlbdx"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515248    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h67mx\" (UniqueName: \"kubernetes.io/projected/ee26e518-d640-482f-842a-b74e6afa7e3c-kube-api-access-h67mx\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515271    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515288    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdjth\" (UniqueName: \"kubernetes.io/projected/e02cfaf0-083f-4fc0-b915-6d328825c71c-kube-api-access-bdjth\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515294    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70dadf06-e872-445e-9238-112acc1a782f-tmp-dir\") pod \"node-resolver-j7hp9\" (UID: \"70dadf06-e872-445e-9238-112acc1a782f\") " pod="openshift-dns/node-resolver-j7hp9"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515338    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-cnibin\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515373    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-kubelet\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515391    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-device-dir\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515421    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-log-socket\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515443    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-kubelet-config\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515453    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee26e518-d640-482f-842a-b74e6afa7e3c-ovnkube-config\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515475    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/70dadf06-e872-445e-9238-112acc1a782f-hosts-file\") pod \"node-resolver-j7hp9\" (UID: \"70dadf06-e872-445e-9238-112acc1a782f\") " pod="openshift-dns/node-resolver-j7hp9"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515478    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-sysconfig\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515521    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-sys-fs\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515548    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-var-lib-kubelet\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.516490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515550    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f0793a29-db71-4d86-af83-a59132434a7e-iptables-alerter-script\") pod \"iptables-alerter-psrqr\" (UID: \"f0793a29-db71-4d86-af83-a59132434a7e\") " pod="openshift-network-operator/iptables-alerter-psrqr"
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515561    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-dbus\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515575    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs\") pod \"network-metrics-daemon-twvwv\" (UID: \"8003fa5c-0817-4994-8405-7bc431ab1c36\") " pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515614    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjv9g\" (UniqueName: \"kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g\") pod \"network-check-target-hzrtl\" (UID: \"0f0eb8fe-5607-4bef-bf73-985c92fa4c72\") " pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515673    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/80adac8f-4c32-43bf-8ecc-e127f28b7b7a-host\") pod \"node-ca-25lfw\" (UID: \"80adac8f-4c32-43bf-8ecc-e127f28b7b7a\") " pod="openshift-image-registry/node-ca-25lfw"
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515678    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515715    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e02cfaf0-083f-4fc0-b915-6d328825c71c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515740    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80adac8f-4c32-43bf-8ecc-e127f28b7b7a-serviceca\") pod \"node-ca-25lfw\" (UID: \"80adac8f-4c32-43bf-8ecc-e127f28b7b7a\") " pod="openshift-image-registry/node-ca-25lfw"
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:42.515770    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515773    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-var-lib-cni-multus\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515810    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-etc-openvswitch\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:42.515871    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret podName:9969efc8-3073-4e0d-a4ef-cd1c6bb87409 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:43.015818369 +0000 UTC m=+2.994014761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret") pod "global-pull-secret-syncer-9msr4" (UID: "9969efc8-3073-4e0d-a4ef-cd1c6bb87409") : object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515893    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-run-openvswitch\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515927    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-cni-bin\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.515954    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-sysctl-conf\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516063    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e02cfaf0-083f-4fc0-b915-6d328825c71c-system-cni-dir\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.517361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516094    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-multus-conf-dir\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516121    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-run-multus-certs\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516147    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516173    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-cni-netd\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516203    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-socket-dir\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516205    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/80adac8f-4c32-43bf-8ecc-e127f28b7b7a-serviceca\") pod \"node-ca-25lfw\" (UID: \"80adac8f-4c32-43bf-8ecc-e127f28b7b7a\") " pod="openshift-image-registry/node-ca-25lfw"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516238    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6aa05739-7ebf-490c-b4e5-1dafcca312f3-cni-binary-copy\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516267    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-var-lib-openvswitch\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516315    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-kubernetes\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516334    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-socket-dir\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516343    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtvdd\" (UniqueName: \"kubernetes.io/projected/028ebdc9-75c6-46e1-9322-c25d3a774fb3-kube-api-access-gtvdd\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516377    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-hostroot\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516431    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516462    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-run-systemd\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516512    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-tuned\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516567    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-etc-selinux\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516584    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-registration-dir\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.518236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.516662    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/29727eca-ca7c-4741-b3a9-829a920ba7ee-registration-dir\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.529602 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.529574    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 19 04:13:42.534772 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.534560    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjcf6\" (UniqueName: \"kubernetes.io/projected/80adac8f-4c32-43bf-8ecc-e127f28b7b7a-kube-api-access-rjcf6\") pod \"node-ca-25lfw\" (UID: \"80adac8f-4c32-43bf-8ecc-e127f28b7b7a\") " pod="openshift-image-registry/node-ca-25lfw"
Sep 19 04:13:42.536061 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.536032    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhrbb\" (UniqueName: \"kubernetes.io/projected/29727eca-ca7c-4741-b3a9-829a920ba7ee-kube-api-access-hhrbb\") pod \"aws-ebs-csi-driver-node-v2mcx\" (UID: \"29727eca-ca7c-4741-b3a9-829a920ba7ee\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.537451 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.537422    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wrtc\" (UniqueName: \"kubernetes.io/projected/70dadf06-e872-445e-9238-112acc1a782f-kube-api-access-2wrtc\") pod \"node-resolver-j7hp9\" (UID: \"70dadf06-e872-445e-9238-112acc1a782f\") " pod="openshift-dns/node-resolver-j7hp9"
Sep 19 04:13:42.538990 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.538934    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-52.ec2.internal" event={"ID":"62ca4fb25798dbdda7b410bc15fd658c","Type":"ContainerStarted","Data":"a9e9c450e4eaee39e059414b4860b4959f8ae8cfd6f35c4dd58494d96eef7190"}
Sep 19 04:13:42.539123 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.539091    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv55s\" (UniqueName: \"kubernetes.io/projected/f0793a29-db71-4d86-af83-a59132434a7e-kube-api-access-kv55s\") pod \"iptables-alerter-psrqr\" (UID: \"f0793a29-db71-4d86-af83-a59132434a7e\") " pod="openshift-network-operator/iptables-alerter-psrqr"
Sep 19 04:13:42.540226 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.540202    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal" event={"ID":"62749e283bd453af448090af420e93bf","Type":"ContainerStarted","Data":"d63c166afb4d42a1bfc858b07e12a71e7543d0dba19ab06a99b0fe8b5b863a4c"}
Sep 19 04:13:42.616938 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.616901    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 04:13:42.617150 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.616961    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e02cfaf0-083f-4fc0-b915-6d328825c71c-cnibin\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.617150 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.616995    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-system-cni-dir\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.617150 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617096    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e02cfaf0-083f-4fc0-b915-6d328825c71c-cnibin\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.617150 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617137    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-modprobe-d\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.617374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617160    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-system-cni-dir\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.617374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617183    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-systemd-units\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.617374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617206    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-systemd\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.617374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617257    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-systemd-units\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.617374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617265    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-systemd\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.617374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617297    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-lib-modules\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.617374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617336    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-var-lib-kubelet\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.617374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617365    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-multus-cni-dir\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617390    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6aa05739-7ebf-490c-b4e5-1dafcca312f3-multus-daemon-config\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617415    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-etc-kubernetes\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617442    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee26e518-d640-482f-842a-b74e6afa7e3c-env-overrides\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617467    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-sysctl-d\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617484    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-lib-modules\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e02cfaf0-083f-4fc0-b915-6d328825c71c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617536    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-run-k8s-cni-cncf-io\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617567    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-var-lib-cni-bin\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617594    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xmvl\" (UniqueName: \"kubernetes.io/projected/6aa05739-7ebf-490c-b4e5-1dafcca312f3-kube-api-access-5xmvl\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617610    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a48add2c-d95d-4119-8461-b322d6e6b9ee-konnectivity-ca\") pod \"konnectivity-agent-nlbdx\" (UID: \"a48add2c-d95d-4119-8461-b322d6e6b9ee\") " pod="kube-system/konnectivity-agent-nlbdx"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617626    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-run-netns\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-run\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617681    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e02cfaf0-083f-4fc0-b915-6d328825c71c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617694    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-run-netns\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.617706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617710    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-slash\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617726    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-node-log\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617733    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-var-lib-kubelet\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617744    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee26e518-d640-482f-842a-b74e6afa7e3c-ovn-node-metrics-cert\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617771    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e02cfaf0-083f-4fc0-b915-6d328825c71c-cni-binary-copy\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617821    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e02cfaf0-083f-4fc0-b915-6d328825c71c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617837    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617850    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a48add2c-d95d-4119-8461-b322d6e6b9ee-agent-certs\") pod \"konnectivity-agent-nlbdx\" (UID: \"a48add2c-d95d-4119-8461-b322d6e6b9ee\") " pod="kube-system/konnectivity-agent-nlbdx"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617869    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-etc-kubernetes\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617878    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h67mx\" (UniqueName: \"kubernetes.io/projected/ee26e518-d640-482f-842a-b74e6afa7e3c-kube-api-access-h67mx\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617884    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-multus-cni-dir\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617334    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-modprobe-d\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617959    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-var-lib-cni-bin\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617965    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-run\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617975    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-node-log\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617976    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-slash\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.617987    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-run-k8s-cni-cncf-io\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.618521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618009    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-run-netns\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618052    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdjth\" (UniqueName: \"kubernetes.io/projected/e02cfaf0-083f-4fc0-b915-6d328825c71c-kube-api-access-bdjth\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618071    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-cnibin\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618089    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-kubelet\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618115    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-log-socket\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618142    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee26e518-d640-482f-842a-b74e6afa7e3c-ovnkube-config\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618193    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-sysconfig\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618220    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-var-lib-kubelet\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618247    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs\") pod \"network-metrics-daemon-twvwv\" (UID: \"8003fa5c-0817-4994-8405-7bc431ab1c36\") " pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618272    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjv9g\" (UniqueName: \"kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g\") pod \"network-check-target-hzrtl\" (UID: \"0f0eb8fe-5607-4bef-bf73-985c92fa4c72\") " pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618305    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e02cfaf0-083f-4fc0-b915-6d328825c71c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618336    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-var-lib-cni-multus\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618361    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-etc-openvswitch\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618386    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-run-openvswitch\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618415    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-cni-bin\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618475    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-sysctl-conf\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e02cfaf0-083f-4fc0-b915-6d328825c71c-system-cni-dir\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.619433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618509    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-multus-conf-dir\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618524    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-run-multus-certs\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618545    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618571    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-cni-netd\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618609    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6aa05739-7ebf-490c-b4e5-1dafcca312f3-cni-binary-copy\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618612    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ee26e518-d640-482f-842a-b74e6afa7e3c-env-overrides\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618617    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6aa05739-7ebf-490c-b4e5-1dafcca312f3-multus-daemon-config\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618633    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-var-lib-openvswitch\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-kubernetes\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618683    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtvdd\" (UniqueName: \"kubernetes.io/projected/028ebdc9-75c6-46e1-9322-c25d3a774fb3-kube-api-access-gtvdd\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618706    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-hostroot\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618757    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-run-systemd\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618784    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-tuned\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.618576    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-sysctl-d\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619043    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a48add2c-d95d-4119-8461-b322d6e6b9ee-konnectivity-ca\") pod \"konnectivity-agent-nlbdx\" (UID: \"a48add2c-d95d-4119-8461-b322d6e6b9ee\") " pod="kube-system/konnectivity-agent-nlbdx"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619098    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-run-netns\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619118    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-run-systemd\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619157    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-multus-socket-dir-parent\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.620317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619187    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx7gp\" (UniqueName: \"kubernetes.io/projected/8003fa5c-0817-4994-8405-7bc431ab1c36-kube-api-access-rx7gp\") pod \"network-metrics-daemon-twvwv\" (UID: \"8003fa5c-0817-4994-8405-7bc431ab1c36\") " pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619199    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-var-lib-cni-multus\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619209    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-run-ovn\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619232    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee26e518-d640-482f-842a-b74e6afa7e3c-ovnkube-script-lib\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619258    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-sys\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619298    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-host\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619330    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/028ebdc9-75c6-46e1-9322-c25d3a774fb3-tmp\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619358    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-log-socket\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619534    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e02cfaf0-083f-4fc0-b915-6d328825c71c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619560    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-cni-bin\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619896    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-cnibin\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619919    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-sysconfig\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619965    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-kubelet\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.619967    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-var-lib-kubelet\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.620002    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e02cfaf0-083f-4fc0-b915-6d328825c71c-cni-binary-copy\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.620017    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-var-lib-openvswitch\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.620047    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-etc-openvswitch\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:42.620052    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:42.621235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.620101    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-run-openvswitch\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:42.620176    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs podName:8003fa5c-0817-4994-8405-7bc431ab1c36 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:43.120156486 +0000 UTC m=+3.098352874 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs") pod "network-metrics-daemon-twvwv" (UID: "8003fa5c-0817-4994-8405-7bc431ab1c36") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.620306    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-sysctl-conf\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.620372    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e02cfaf0-083f-4fc0-b915-6d328825c71c-system-cni-dir\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.620431    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-multus-conf-dir\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.620470    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-cni-netd\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.620475    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ee26e518-d640-482f-842a-b74e6afa7e3c-ovnkube-config\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.620502    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-host-run-ovn-kubernetes\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.620896    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-kubernetes\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.621080    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ee26e518-d640-482f-842a-b74e6afa7e3c-ovn-node-metrics-cert\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.621157    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-host\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.621185    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ee26e518-d640-482f-842a-b74e6afa7e3c-run-ovn\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.621194    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e02cfaf0-083f-4fc0-b915-6d328825c71c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.621212    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/028ebdc9-75c6-46e1-9322-c25d3a774fb3-sys\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.621203    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ee26e518-d640-482f-842a-b74e6afa7e3c-ovnkube-script-lib\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.621277    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-hostroot\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.621287    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-multus-socket-dir-parent\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.622046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.621331    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6aa05739-7ebf-490c-b4e5-1dafcca312f3-host-run-multus-certs\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.622740 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.621602    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6aa05739-7ebf-490c-b4e5-1dafcca312f3-cni-binary-copy\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.622740 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.621696    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a48add2c-d95d-4119-8461-b322d6e6b9ee-agent-certs\") pod \"konnectivity-agent-nlbdx\" (UID: \"a48add2c-d95d-4119-8461-b322d6e6b9ee\") " pod="kube-system/konnectivity-agent-nlbdx"
Sep 19 04:13:42.622740 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.622400    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/028ebdc9-75c6-46e1-9322-c25d3a774fb3-etc-tuned\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.623925 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.623902    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/028ebdc9-75c6-46e1-9322-c25d3a774fb3-tmp\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.636118 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.636093    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h67mx\" (UniqueName: \"kubernetes.io/projected/ee26e518-d640-482f-842a-b74e6afa7e3c-kube-api-access-h67mx\") pod \"ovnkube-node-v94sd\" (UID: \"ee26e518-d640-482f-842a-b74e6afa7e3c\") " pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.643383 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.643364    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xmvl\" (UniqueName: \"kubernetes.io/projected/6aa05739-7ebf-490c-b4e5-1dafcca312f3-kube-api-access-5xmvl\") pod \"multus-krt5k\" (UID: \"6aa05739-7ebf-490c-b4e5-1dafcca312f3\") " pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.646977 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:42.646934    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 04:13:42.646977 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:42.646959    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 04:13:42.646977 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:42.646973    2569 projected.go:196] Error preparing data for projected volume kube-api-access-kjv9g for pod openshift-network-diagnostics/network-check-target-hzrtl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:42.647188 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:42.647056    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g podName:0f0eb8fe-5607-4bef-bf73-985c92fa4c72 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:43.147035201 +0000 UTC m=+3.125231589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kjv9g" (UniqueName: "kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g") pod "network-check-target-hzrtl" (UID: "0f0eb8fe-5607-4bef-bf73-985c92fa4c72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:42.649426 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.649405    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx7gp\" (UniqueName: \"kubernetes.io/projected/8003fa5c-0817-4994-8405-7bc431ab1c36-kube-api-access-rx7gp\") pod \"network-metrics-daemon-twvwv\" (UID: \"8003fa5c-0817-4994-8405-7bc431ab1c36\") " pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:42.650502 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.650467    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdjth\" (UniqueName: \"kubernetes.io/projected/e02cfaf0-083f-4fc0-b915-6d328825c71c-kube-api-access-bdjth\") pod \"multus-additional-cni-plugins-25d84\" (UID: \"e02cfaf0-083f-4fc0-b915-6d328825c71c\") " pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.651552 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.651534    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtvdd\" (UniqueName: \"kubernetes.io/projected/028ebdc9-75c6-46e1-9322-c25d3a774fb3-kube-api-access-gtvdd\") pod \"tuned-ph2hm\" (UID: \"028ebdc9-75c6-46e1-9322-c25d3a774fb3\") " pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.705784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.705713    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-psrqr"
Sep 19 04:13:42.713934 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.713910    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7hp9"
Sep 19 04:13:42.723425 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.723407    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-25lfw"
Sep 19 04:13:42.733325 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.733287    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx"
Sep 19 04:13:42.741055 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.741036    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ph2hm"
Sep 19 04:13:42.748994 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.748974    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-25d84"
Sep 19 04:13:42.758924 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.758903    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:13:42.764887 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.764867    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-krt5k"
Sep 19 04:13:42.773366 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:42.773342    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nlbdx"
Sep 19 04:13:43.022461 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:43.022372    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:43.022629 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:43.022552    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:43.022689 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:43.022644    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret podName:9969efc8-3073-4e0d-a4ef-cd1c6bb87409 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:44.022622325 +0000 UTC m=+4.000818697 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret") pod "global-pull-secret-syncer-9msr4" (UID: "9969efc8-3073-4e0d-a4ef-cd1c6bb87409") : object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:43.123602 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:43.123563    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs\") pod \"network-metrics-daemon-twvwv\" (UID: \"8003fa5c-0817-4994-8405-7bc431ab1c36\") " pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:43.123792 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:43.123748    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:43.123868 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:43.123853    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs podName:8003fa5c-0817-4994-8405-7bc431ab1c36 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:44.123831001 +0000 UTC m=+4.102027372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs") pod "network-metrics-daemon-twvwv" (UID: "8003fa5c-0817-4994-8405-7bc431ab1c36") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:43.224934 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:43.224882    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjv9g\" (UniqueName: \"kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g\") pod \"network-check-target-hzrtl\" (UID: \"0f0eb8fe-5607-4bef-bf73-985c92fa4c72\") " pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:43.225139 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:43.225100    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 04:13:43.225139 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:43.225137    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 04:13:43.225267 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:43.225153    2569 projected.go:196] Error preparing data for projected volume kube-api-access-kjv9g for pod openshift-network-diagnostics/network-check-target-hzrtl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:43.225267 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:43.225222    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g podName:0f0eb8fe-5607-4bef-bf73-985c92fa4c72 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:44.22520463 +0000 UTC m=+4.203400999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjv9g" (UniqueName: "kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g") pod "network-check-target-hzrtl" (UID: "0f0eb8fe-5607-4bef-bf73-985c92fa4c72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:43.495846 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:43.495802    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 04:08:42 +0000 UTC" deadline="2028-04-21 03:15:54.566992767 +0000 UTC"
Sep 19 04:13:43.495846 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:43.495837    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13919h2m11.071159821s"
Sep 19 04:13:43.533310 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:43.533277    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:43.533500 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:43.533425    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:13:43.659890 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:43.659860    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29727eca_ca7c_4741_b3a9_829a920ba7ee.slice/crio-fc8f4a8f14b02eb13909200018f9a070c8dd373779a7282ab4aba62f9854c187 WatchSource:0}: Error finding container fc8f4a8f14b02eb13909200018f9a070c8dd373779a7282ab4aba62f9854c187: Status 404 returned error can't find the container with id fc8f4a8f14b02eb13909200018f9a070c8dd373779a7282ab4aba62f9854c187
Sep 19 04:13:43.662150 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:43.662073    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70dadf06_e872_445e_9238_112acc1a782f.slice/crio-3e53a7c59dc2be7c82196fe9bf3e6980d8fa8b206a839183c9caff5a09daa2b6 WatchSource:0}: Error finding container 3e53a7c59dc2be7c82196fe9bf3e6980d8fa8b206a839183c9caff5a09daa2b6: Status 404 returned error can't find the container with id 3e53a7c59dc2be7c82196fe9bf3e6980d8fa8b206a839183c9caff5a09daa2b6
Sep 19 04:13:43.666074 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:43.666048    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80adac8f_4c32_43bf_8ecc_e127f28b7b7a.slice/crio-c9cc6974e3a4c16cbad7061fa1b8185cb3b7ca48fa3d1fde1a395aa07fae1d0d WatchSource:0}: Error finding container c9cc6974e3a4c16cbad7061fa1b8185cb3b7ca48fa3d1fde1a395aa07fae1d0d: Status 404 returned error can't find the container with id c9cc6974e3a4c16cbad7061fa1b8185cb3b7ca48fa3d1fde1a395aa07fae1d0d
Sep 19 04:13:43.669909 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:13:43.669807    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod028ebdc9_75c6_46e1_9322_c25d3a774fb3.slice/crio-7a7c53534e833ca8c7157f463b43b1c0affa311f0fbde681d8ece48b3467fc45 WatchSource:0}: Error finding container 7a7c53534e833ca8c7157f463b43b1c0affa311f0fbde681d8ece48b3467fc45: Status 404 returned error can't find the container with id 7a7c53534e833ca8c7157f463b43b1c0affa311f0fbde681d8ece48b3467fc45
Sep 19 04:13:44.031696 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.031604    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:44.031887 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:44.031785    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:44.031887 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:44.031853    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret podName:9969efc8-3073-4e0d-a4ef-cd1c6bb87409 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:46.031834133 +0000 UTC m=+6.010030511 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret") pod "global-pull-secret-syncer-9msr4" (UID: "9969efc8-3073-4e0d-a4ef-cd1c6bb87409") : object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:44.133874 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.133832    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs\") pod \"network-metrics-daemon-twvwv\" (UID: \"8003fa5c-0817-4994-8405-7bc431ab1c36\") " pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:44.134064 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:44.134024    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:44.134192 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:44.134110    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs podName:8003fa5c-0817-4994-8405-7bc431ab1c36 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:46.134091973 +0000 UTC m=+6.112288349 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs") pod "network-metrics-daemon-twvwv" (UID: "8003fa5c-0817-4994-8405-7bc431ab1c36") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:44.234545 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.234461    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjv9g\" (UniqueName: \"kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g\") pod \"network-check-target-hzrtl\" (UID: \"0f0eb8fe-5607-4bef-bf73-985c92fa4c72\") " pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:44.234742 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:44.234647    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 04:13:44.234742 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:44.234667    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 04:13:44.234742 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:44.234679    2569 projected.go:196] Error preparing data for projected volume kube-api-access-kjv9g for pod openshift-network-diagnostics/network-check-target-hzrtl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:44.234742 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:44.234739    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g podName:0f0eb8fe-5607-4bef-bf73-985c92fa4c72 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:46.234720648 +0000 UTC m=+6.212917021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjv9g" (UniqueName: "kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g") pod "network-check-target-hzrtl" (UID: "0f0eb8fe-5607-4bef-bf73-985c92fa4c72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:44.496817 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.496732    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 04:08:42 +0000 UTC" deadline="2028-02-26 18:50:17.384053009 +0000 UTC"
Sep 19 04:13:44.496817 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.496786    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12614h36m32.887272046s"
Sep 19 04:13:44.535127 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.533346    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:44.535127 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:44.533475    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:13:44.535127 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.533974    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:44.535127 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:44.534078    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:13:44.558222 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.558141    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nlbdx" event={"ID":"a48add2c-d95d-4119-8461-b322d6e6b9ee","Type":"ContainerStarted","Data":"4a1c518876a90ec6896db8411fb574c1b83f0e3cddc8f46435856b02219259d2"}
Sep 19 04:13:44.567166 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.567129    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-krt5k" event={"ID":"6aa05739-7ebf-490c-b4e5-1dafcca312f3","Type":"ContainerStarted","Data":"9eccf625d08e133fc0a8798197cc8406ffeec824202efc30b5ae7f58ee7fa456"}
Sep 19 04:13:44.576191 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.576156    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-psrqr" event={"ID":"f0793a29-db71-4d86-af83-a59132434a7e","Type":"ContainerStarted","Data":"cbf0de1369394eaf824f23cdd284e8df78ed47b305b1f355aa4e161ea724d9e5"}
Sep 19 04:13:44.584286 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.584217    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25d84" event={"ID":"e02cfaf0-083f-4fc0-b915-6d328825c71c","Type":"ContainerStarted","Data":"9661bcbb7966e658ae9a9efe049b85088088046ea9417f062fd3db48191f6a89"}
Sep 19 04:13:44.588390 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.588355    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ph2hm" event={"ID":"028ebdc9-75c6-46e1-9322-c25d3a774fb3","Type":"ContainerStarted","Data":"7a7c53534e833ca8c7157f463b43b1c0affa311f0fbde681d8ece48b3467fc45"}
Sep 19 04:13:44.596791 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.596515    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-25lfw" event={"ID":"80adac8f-4c32-43bf-8ecc-e127f28b7b7a","Type":"ContainerStarted","Data":"c9cc6974e3a4c16cbad7061fa1b8185cb3b7ca48fa3d1fde1a395aa07fae1d0d"}
Sep 19 04:13:44.612816 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.612677    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd" event={"ID":"ee26e518-d640-482f-842a-b74e6afa7e3c","Type":"ContainerStarted","Data":"cc1c6e80def3d781333795a05e2a7735f9751c993d2b5262e6a6f61e536b3b86"}
Sep 19 04:13:44.623355 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.623293    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7hp9" event={"ID":"70dadf06-e872-445e-9238-112acc1a782f","Type":"ContainerStarted","Data":"3e53a7c59dc2be7c82196fe9bf3e6980d8fa8b206a839183c9caff5a09daa2b6"}
Sep 19 04:13:44.626538 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.626512    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx" event={"ID":"29727eca-ca7c-4741-b3a9-829a920ba7ee","Type":"ContainerStarted","Data":"fc8f4a8f14b02eb13909200018f9a070c8dd373779a7282ab4aba62f9854c187"}
Sep 19 04:13:44.631653 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.631624    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-52.ec2.internal" event={"ID":"62ca4fb25798dbdda7b410bc15fd658c","Type":"ContainerStarted","Data":"86016bc3d1fb4f5f1ed49508e6be41da7d6c1254958540bd2e7fcba31d424158"}
Sep 19 04:13:44.644327 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.644298    2569 generic.go:356] "Generic (PLEG): container finished" podID="62749e283bd453af448090af420e93bf" containerID="8a3ed1875cecc69bf4ccb45ff1697dd5e0cd9b9967956e43b3cc37eed8eda842" exitCode=0
Sep 19 04:13:44.644441 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.644339    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal" event={"ID":"62749e283bd453af448090af420e93bf","Type":"ContainerDied","Data":"8a3ed1875cecc69bf4ccb45ff1697dd5e0cd9b9967956e43b3cc37eed8eda842"}
Sep 19 04:13:44.707329 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:44.706953    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-52.ec2.internal" podStartSLOduration=3.7069285450000002 podStartE2EDuration="3.706928545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:13:44.680651749 +0000 UTC m=+4.658848140" watchObservedRunningTime="2026-09-19 04:13:44.706928545 +0000 UTC m=+4.685124936"
Sep 19 04:13:45.533137 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:45.532863    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:45.533611 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:45.533238    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:13:45.667420 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:45.667374    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal" event={"ID":"62749e283bd453af448090af420e93bf","Type":"ContainerStarted","Data":"f8c4a3c02a5d325f7a9ed77dd4d3c54e03d2dbce98c8aaf4a38b0c215d71deaa"}
Sep 19 04:13:46.052085 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:46.052045    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:46.052283 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:46.052237    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:46.052344 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:46.052300    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret podName:9969efc8-3073-4e0d-a4ef-cd1c6bb87409 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:50.052282436 +0000 UTC m=+10.030478807 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret") pod "global-pull-secret-syncer-9msr4" (UID: "9969efc8-3073-4e0d-a4ef-cd1c6bb87409") : object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:46.152789 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:46.152733    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs\") pod \"network-metrics-daemon-twvwv\" (UID: \"8003fa5c-0817-4994-8405-7bc431ab1c36\") " pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:46.153410 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:46.152973    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:46.153410 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:46.153054    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs podName:8003fa5c-0817-4994-8405-7bc431ab1c36 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:50.153035177 +0000 UTC m=+10.131231550 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs") pod "network-metrics-daemon-twvwv" (UID: "8003fa5c-0817-4994-8405-7bc431ab1c36") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:46.254440 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:46.253822    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjv9g\" (UniqueName: \"kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g\") pod \"network-check-target-hzrtl\" (UID: \"0f0eb8fe-5607-4bef-bf73-985c92fa4c72\") " pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:46.254440 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:46.253999    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 04:13:46.254440 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:46.254023    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 04:13:46.254440 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:46.254038    2569 projected.go:196] Error preparing data for projected volume kube-api-access-kjv9g for pod openshift-network-diagnostics/network-check-target-hzrtl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:46.254440 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:46.254098    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g podName:0f0eb8fe-5607-4bef-bf73-985c92fa4c72 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:50.254079536 +0000 UTC m=+10.232275910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjv9g" (UniqueName: "kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g") pod "network-check-target-hzrtl" (UID: "0f0eb8fe-5607-4bef-bf73-985c92fa4c72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:46.534351 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:46.532811    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:46.534351 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:46.532938    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:13:46.534351 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:46.533327    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:46.534351 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:46.533419    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:13:47.532767 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:47.532714    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:47.532954 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:47.532880    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:13:48.539390 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:48.539359    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:48.539894 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:48.539499    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:13:48.539894 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:48.539545    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:48.539894 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:48.539657    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:13:49.533449 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:49.533415    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:49.533616 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:49.533565    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:13:50.088194 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:50.088153    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:50.088579 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:50.088319    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:50.088579 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:50.088371    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret podName:9969efc8-3073-4e0d-a4ef-cd1c6bb87409 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:58.088358168 +0000 UTC m=+18.066554536 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret") pod "global-pull-secret-syncer-9msr4" (UID: "9969efc8-3073-4e0d-a4ef-cd1c6bb87409") : object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:50.189405 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:50.189371    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs\") pod \"network-metrics-daemon-twvwv\" (UID: \"8003fa5c-0817-4994-8405-7bc431ab1c36\") " pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:50.189586 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:50.189575    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:50.189641 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:50.189629    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs podName:8003fa5c-0817-4994-8405-7bc431ab1c36 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:58.189616471 +0000 UTC m=+18.167812839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs") pod "network-metrics-daemon-twvwv" (UID: "8003fa5c-0817-4994-8405-7bc431ab1c36") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:50.291042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:50.290451    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjv9g\" (UniqueName: \"kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g\") pod \"network-check-target-hzrtl\" (UID: \"0f0eb8fe-5607-4bef-bf73-985c92fa4c72\") " pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:50.291042 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:50.290614    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 04:13:50.291042 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:50.290629    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 04:13:50.291042 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:50.290638    2569 projected.go:196] Error preparing data for projected volume kube-api-access-kjv9g for pod openshift-network-diagnostics/network-check-target-hzrtl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:50.291042 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:50.290693    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g podName:0f0eb8fe-5607-4bef-bf73-985c92fa4c72 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:58.290680252 +0000 UTC m=+18.268876624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjv9g" (UniqueName: "kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g") pod "network-check-target-hzrtl" (UID: "0f0eb8fe-5607-4bef-bf73-985c92fa4c72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:50.533425 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:50.533388    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:50.533618 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:50.533519    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:13:50.533929 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:50.533911    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:50.534033 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:50.533998    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:13:51.533155 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:51.533125    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:51.533619 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:51.533259    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:13:52.533402 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:52.533366    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:52.533872 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:52.533367    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:52.533872 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:52.533524    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:13:52.533872 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:52.533601    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:13:53.533282 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:53.533246    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:53.533500 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:53.533380    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:13:54.533183 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:54.533147    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:54.533183 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:54.533182    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:54.533429 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:54.533288    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:13:54.533485 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:54.533434    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:13:55.532991 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:55.532948    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:55.533407 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:55.533103    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:13:56.532781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:56.532732    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:56.533023 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:56.532882    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:13:56.533023 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:56.532937    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:56.533403 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:56.533035    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:13:57.533381 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:57.533328    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:57.533865 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:57.533462    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:13:58.153785 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:58.153737    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:58.154027 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:58.153873    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:58.154027 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:58.153951    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret podName:9969efc8-3073-4e0d-a4ef-cd1c6bb87409 nodeName:}" failed. No retries permitted until 2026-09-19 04:14:14.153930936 +0000 UTC m=+34.132127308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret") pod "global-pull-secret-syncer-9msr4" (UID: "9969efc8-3073-4e0d-a4ef-cd1c6bb87409") : object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:58.254527 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:58.254493    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs\") pod \"network-metrics-daemon-twvwv\" (UID: \"8003fa5c-0817-4994-8405-7bc431ab1c36\") " pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:58.254727 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:58.254657    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:58.254819 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:58.254729    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs podName:8003fa5c-0817-4994-8405-7bc431ab1c36 nodeName:}" failed. No retries permitted until 2026-09-19 04:14:14.254707988 +0000 UTC m=+34.232904370 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs") pod "network-metrics-daemon-twvwv" (UID: "8003fa5c-0817-4994-8405-7bc431ab1c36") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:58.354957 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:58.354916    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjv9g\" (UniqueName: \"kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g\") pod \"network-check-target-hzrtl\" (UID: \"0f0eb8fe-5607-4bef-bf73-985c92fa4c72\") " pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:58.355140 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:58.355070    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 04:13:58.355140 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:58.355096    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 04:13:58.355140 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:58.355109    2569 projected.go:196] Error preparing data for projected volume kube-api-access-kjv9g for pod openshift-network-diagnostics/network-check-target-hzrtl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:58.355310 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:58.355170    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g podName:0f0eb8fe-5607-4bef-bf73-985c92fa4c72 nodeName:}" failed. No retries permitted until 2026-09-19 04:14:14.355149503 +0000 UTC m=+34.333345873 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjv9g" (UniqueName: "kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g") pod "network-check-target-hzrtl" (UID: "0f0eb8fe-5607-4bef-bf73-985c92fa4c72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:58.533954 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:58.533262    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:13:58.533954 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:58.533339    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:13:58.533954 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:58.533424    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:13:58.533954 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:58.533857    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:13:59.533472 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:13:59.533426    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:13:59.533666 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:13:59.533581    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:14:00.534090 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:00.534048    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:14:00.534557 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:00.534161    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:14:00.534557 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:00.534204    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:14:00.534557 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:00.534280    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:14:01.532655 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:01.532619    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:14:01.532831 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:01.532742    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:14:02.533415 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.533382    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:14:02.534086 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.533424    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:14:02.534086 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:02.533502    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:14:02.534086 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:02.533619    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:14:02.708858 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.708817    2569 generic.go:356] "Generic (PLEG): container finished" podID="e02cfaf0-083f-4fc0-b915-6d328825c71c" containerID="bba155608f5723f88e69cfa8fe4c45d2a046c6b9f20157b0311798aaeb70039d" exitCode=0
Sep 19 04:14:02.709040 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.708881    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25d84" event={"ID":"e02cfaf0-083f-4fc0-b915-6d328825c71c","Type":"ContainerDied","Data":"bba155608f5723f88e69cfa8fe4c45d2a046c6b9f20157b0311798aaeb70039d"}
Sep 19 04:14:02.710993 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.710874    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ph2hm" event={"ID":"028ebdc9-75c6-46e1-9322-c25d3a774fb3","Type":"ContainerStarted","Data":"f99e200de46753d68c2092801b1880102a4b1059c9475b19e719d6232fc9de3a"}
Sep 19 04:14:02.712941 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.712739    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-25lfw" event={"ID":"80adac8f-4c32-43bf-8ecc-e127f28b7b7a","Type":"ContainerStarted","Data":"08c251464030b1045b71bde7ed7e8268ecdc8d83e9f1480b482129e275f449c8"}
Sep 19 04:14:02.716589 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.716564    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd" event={"ID":"ee26e518-d640-482f-842a-b74e6afa7e3c","Type":"ContainerStarted","Data":"064572f1c6640908759943f770e38cdc9dc8f518535d3e366f4455a5445dcfec"}
Sep 19 04:14:02.716668 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.716640    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd" event={"ID":"ee26e518-d640-482f-842a-b74e6afa7e3c","Type":"ContainerStarted","Data":"48348eb41e05e9c4fc485f2167e1a11452078e81944de631f197c4a6c24d32cc"}
Sep 19 04:14:02.716713 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.716671    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd" event={"ID":"ee26e518-d640-482f-842a-b74e6afa7e3c","Type":"ContainerStarted","Data":"b9cc5872bba3c1b1358cafed03ff0daef237a1ffee05ce0fc5d41a255b09acdc"}
Sep 19 04:14:02.716713 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.716699    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd" event={"ID":"ee26e518-d640-482f-842a-b74e6afa7e3c","Type":"ContainerStarted","Data":"8f63d231ad5f3d649a19f72f010e3f67e695a89f99b7260e54349cf3f86c2f38"}
Sep 19 04:14:02.716810 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.716725    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd" event={"ID":"ee26e518-d640-482f-842a-b74e6afa7e3c","Type":"ContainerStarted","Data":"ce9bd7350d5792f705ea072f3e37b611b10bb8c41e90d12162e427981842a43f"}
Sep 19 04:14:02.716810 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.716768    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd" event={"ID":"ee26e518-d640-482f-842a-b74e6afa7e3c","Type":"ContainerStarted","Data":"5298d974bed2abdf666ead96e3f2c1960cfbacb9ad05b0da328360090a49bc1f"}
Sep 19 04:14:02.718533 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.718507    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7hp9" event={"ID":"70dadf06-e872-445e-9238-112acc1a782f","Type":"ContainerStarted","Data":"64fbfbbf695b6f102de0d5bfbaa33677d77c0676c17a57500a14fa96d6b7f112"}
Sep 19 04:14:02.720596 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.720522    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx" event={"ID":"29727eca-ca7c-4741-b3a9-829a920ba7ee","Type":"ContainerStarted","Data":"526a917b02d38604cbbe13b770453921f1c89f0a425facd14d13eb4e3e92a177"}
Sep 19 04:14:02.722287 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.722262    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nlbdx" event={"ID":"a48add2c-d95d-4119-8461-b322d6e6b9ee","Type":"ContainerStarted","Data":"2c78eea14ad7e16ecc521ddd198a2f4810eee80091149168d7bee357c4514da5"}
Sep 19 04:14:02.725060 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.725038    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-krt5k" event={"ID":"6aa05739-7ebf-490c-b4e5-1dafcca312f3","Type":"ContainerStarted","Data":"41941460e015db30219626de4e3949ba22547462d9039d9373cfb2976d019f30"}
Sep 19 04:14:02.769010 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.768964    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-52.ec2.internal" podStartSLOduration=21.768948232 podStartE2EDuration="21.768948232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:13:45.705203781 +0000 UTC m=+5.683400173" watchObservedRunningTime="2026-09-19 04:14:02.768948232 +0000 UTC m=+22.747144623"
Sep 19 04:14:02.844000 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.843946    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j7hp9" podStartSLOduration=4.585282138 podStartE2EDuration="22.843925345s" totalImagesPullingTime="18.258643207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:02.800631244 +0000 UTC m=+22.778827634" watchObservedRunningTime="2026-09-19 04:14:02.843925345 +0000 UTC m=+22.822121735"
Sep 19 04:14:02.906679 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.906630    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-25lfw" podStartSLOduration=4.6532003589999995 podStartE2EDuration="22.906612454s" totalImagesPullingTime="18.253412095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:02.848542325 +0000 UTC m=+22.826738715" watchObservedRunningTime="2026-09-19 04:14:02.906612454 +0000 UTC m=+22.884808844"
Sep 19 04:14:02.984850 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:02.984725    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-krt5k" podStartSLOduration=4.682314497 podStartE2EDuration="22.984707835s" totalImagesPullingTime="18.302393338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:02.906998319 +0000 UTC m=+22.885194708" watchObservedRunningTime="2026-09-19 04:14:02.984707835 +0000 UTC m=+22.962904221"
Sep 19 04:14:03.033740 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:03.033685    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nlbdx" podStartSLOduration=8.876192096 podStartE2EDuration="23.033667132s" totalImagesPullingTime="14.157475036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:02.98541125 +0000 UTC m=+22.963607640" watchObservedRunningTime="2026-09-19 04:14:03.033667132 +0000 UTC m=+23.011863521"
Sep 19 04:14:03.033955 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:03.033804    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ph2hm" podStartSLOduration=4.747224847 podStartE2EDuration="23.033794677s" totalImagesPullingTime="18.28656983s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:03.0335614 +0000 UTC m=+23.011757790" watchObservedRunningTime="2026-09-19 04:14:03.033794677 +0000 UTC m=+23.011991068"
Sep 19 04:14:03.533060 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:03.532851    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:14:03.533225 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:03.533193    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:14:03.557062 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:03.557032    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 19 04:14:03.729508 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:03.729467    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-psrqr" event={"ID":"f0793a29-db71-4d86-af83-a59132434a7e","Type":"ContainerStarted","Data":"5d7d4f1f1701b4b7921efc919f50a8239911ac2e72f8f58a8749db9b5925cac9"}
Sep 19 04:14:03.732599 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:03.732567    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx" event={"ID":"29727eca-ca7c-4741-b3a9-829a920ba7ee","Type":"ContainerStarted","Data":"8a55b08b224127fe2f099cbbd459cb745f8f2773334216a0aad981fee144b6d0"}
Sep 19 04:14:03.838933 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:03.838823    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-psrqr" podStartSLOduration=5.587883401 podStartE2EDuration="23.838805981s" totalImagesPullingTime="18.25092258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:03.831733636 +0000 UTC m=+23.809930027" watchObservedRunningTime="2026-09-19 04:14:03.838805981 +0000 UTC m=+23.817002371"
Sep 19 04:14:04.474501 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:04.474382    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T04:14:03.557056016Z","UUID":"68ca1045-d313-4c89-8030-b8da07cd329a","Handler":null,"Name":"","Endpoint":""}
Sep 19 04:14:04.475999 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:04.475976    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 19 04:14:04.476117 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:04.476010    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 19 04:14:04.532557 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:04.532526    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:14:04.532557 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:04.532565    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:14:04.532910 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:04.532649    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:14:04.532910 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:04.532771    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:14:04.739240 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:04.738863    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx" event={"ID":"29727eca-ca7c-4741-b3a9-829a920ba7ee","Type":"ContainerStarted","Data":"9672c3084b6b72c11d2e0830ed6356169d8dea87ef5b90e13c538bf6d470321b"}
Sep 19 04:14:05.532986 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:05.532954    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:14:05.533172 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:05.533072    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:14:05.745288 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:05.745252    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd" event={"ID":"ee26e518-d640-482f-842a-b74e6afa7e3c","Type":"ContainerStarted","Data":"8bb16e406003f2db498b613d65af0ce21475ffc3d75159f55f9316fd793e1bdd"}
Sep 19 04:14:05.938645 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:05.938610    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nlbdx"
Sep 19 04:14:05.939223 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:05.939198    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nlbdx"
Sep 19 04:14:05.987743 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:05.987583    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v2mcx" podStartSLOduration=5.396876633 podStartE2EDuration="25.987560106s" totalImagesPullingTime="20.590683473s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:04.810812669 +0000 UTC m=+24.789009059" watchObservedRunningTime="2026-09-19 04:14:05.987560106 +0000 UTC m=+25.965756497"
Sep 19 04:14:06.533025 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:06.532987    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:14:06.533218 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:06.532997    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:14:06.533218 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:06.533123    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:14:06.533218 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:06.533208    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:14:06.868517 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:06.868474    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:07.157359 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:07.157297    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:07.533303 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:07.533110    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:14:07.533495 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:07.533396    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:14:07.753799 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:07.753763    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd" event={"ID":"ee26e518-d640-482f-842a-b74e6afa7e3c","Type":"ContainerStarted","Data":"f8d555a9113fb8888e57b13dfc559212d01da50099b84a46e948c02df83a3b42"}
Sep 19 04:14:07.754290 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:07.754256    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:14:07.754409 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:07.754313    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:14:07.755479 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:07.755456    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:14:07.777904 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:07.777872    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:14:07.778086 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:07.778026    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:14:07.888593 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:07.888535    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd" podStartSLOduration=9.576502154 podStartE2EDuration="27.888516682s" totalImagesPullingTime="18.312014528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:07.79650877 +0000 UTC m=+27.774705159" watchObservedRunningTime="2026-09-19 04:14:07.888516682 +0000 UTC m=+27.866713071"
Sep 19 04:14:08.533006 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:08.532972    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:14:08.533195 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:08.533106    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:14:08.533195 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:08.533160    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:14:08.533274 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:08.533253    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:14:08.762330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:08.762287    2569 generic.go:356] "Generic (PLEG): container finished" podID="e02cfaf0-083f-4fc0-b915-6d328825c71c" containerID="86b34241fba5eb88b280eee092842aa5e5c52bb69f2512e9aed02d504420fc74" exitCode=0
Sep 19 04:14:08.763524 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:08.763432    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25d84" event={"ID":"e02cfaf0-083f-4fc0-b915-6d328825c71c","Type":"ContainerDied","Data":"86b34241fba5eb88b280eee092842aa5e5c52bb69f2512e9aed02d504420fc74"}
Sep 19 04:14:09.533519 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:09.533329    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:14:09.534019 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:09.533612    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:14:09.731143 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:09.731113    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-twvwv"]
Sep 19 04:14:09.740664 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:09.740632    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9msr4"]
Sep 19 04:14:09.740811 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:09.740791    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:14:09.740922 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:09.740902    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:14:09.747713 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:09.747685    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hzrtl"]
Sep 19 04:14:09.747861 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:09.747817    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:14:09.747945 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:09.747923    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:14:09.765133 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:09.765110    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:14:09.765315 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:09.765229    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:14:10.131915 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:10.131868    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nlbdx"
Sep 19 04:14:10.132109 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:10.132032    2569 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 19 04:14:10.132569 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:10.132539    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nlbdx"
Sep 19 04:14:10.327651 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:10.327563    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:10.769658 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:10.769623    2569 generic.go:356] "Generic (PLEG): container finished" podID="e02cfaf0-083f-4fc0-b915-6d328825c71c" containerID="c93f3001973720061f88f36b3f4c8bfc4ac5cbe57b28c019cb642f9cf52015c1" exitCode=0
Sep 19 04:14:10.770064 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:10.769722    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25d84" event={"ID":"e02cfaf0-083f-4fc0-b915-6d328825c71c","Type":"ContainerDied","Data":"c93f3001973720061f88f36b3f4c8bfc4ac5cbe57b28c019cb642f9cf52015c1"}
Sep 19 04:14:10.774514 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:10.774491    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:10.895097 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:10.895063    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:11.533373 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:11.533327    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:14:11.533547 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:11.533435    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:14:11.533547 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:11.533444    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:14:11.533547 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:11.533472    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:14:11.533710 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:11.533576    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:14:11.533710 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:11.533667    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:14:11.775203 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:11.775168    2569 generic.go:356] "Generic (PLEG): container finished" podID="e02cfaf0-083f-4fc0-b915-6d328825c71c" containerID="1e6e8a1f589a24a81134dfc483c4385d39a6f0213c90c7bda05aef05ce631e73" exitCode=0
Sep 19 04:14:11.775664 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:11.775235    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25d84" event={"ID":"e02cfaf0-083f-4fc0-b915-6d328825c71c","Type":"ContainerDied","Data":"1e6e8a1f589a24a81134dfc483c4385d39a6f0213c90c7bda05aef05ce631e73"}
Sep 19 04:14:11.905266 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:11.905235    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:12.011201 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:12.011167    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:13.533381 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:13.533345    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:14:13.533877 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:13.533383    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:14:13.533877 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:13.533466    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hzrtl" podUID="0f0eb8fe-5607-4bef-bf73-985c92fa4c72"
Sep 19 04:14:13.533877 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:13.533556    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9msr4" podUID="9969efc8-3073-4e0d-a4ef-cd1c6bb87409"
Sep 19 04:14:13.533877 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:13.533354    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:14:13.533877 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:13.533669    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twvwv" podUID="8003fa5c-0817-4994-8405-7bc431ab1c36"
Sep 19 04:14:14.175541 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.175502    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:14:14.175738 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:14.175683    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 04:14:14.175827 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:14.175783    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret podName:9969efc8-3073-4e0d-a4ef-cd1c6bb87409 nodeName:}" failed. No retries permitted until 2026-09-19 04:14:46.175763532 +0000 UTC m=+66.153959915 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret") pod "global-pull-secret-syncer-9msr4" (UID: "9969efc8-3073-4e0d-a4ef-cd1c6bb87409") : object "kube-system"/"original-pull-secret" not registered
Sep 19 04:14:14.276402 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.276363    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs\") pod \"network-metrics-daemon-twvwv\" (UID: \"8003fa5c-0817-4994-8405-7bc431ab1c36\") " pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:14:14.276679 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:14.276512    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:14:14.276679 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:14.276583    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs podName:8003fa5c-0817-4994-8405-7bc431ab1c36 nodeName:}" failed. No retries permitted until 2026-09-19 04:14:46.276567208 +0000 UTC m=+66.254763581 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs") pod "network-metrics-daemon-twvwv" (UID: "8003fa5c-0817-4994-8405-7bc431ab1c36") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:14:14.377054 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.377018    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjv9g\" (UniqueName: \"kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g\") pod \"network-check-target-hzrtl\" (UID: \"0f0eb8fe-5607-4bef-bf73-985c92fa4c72\") " pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:14:14.377219 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:14.377148    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 04:14:14.377219 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:14.377164    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 04:14:14.377219 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:14.377179    2569 projected.go:196] Error preparing data for projected volume kube-api-access-kjv9g for pod openshift-network-diagnostics/network-check-target-hzrtl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:14:14.377349 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:14.377237    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g podName:0f0eb8fe-5607-4bef-bf73-985c92fa4c72 nodeName:}" failed. No retries permitted until 2026-09-19 04:14:46.37722144 +0000 UTC m=+66.355417833 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kjv9g" (UniqueName: "kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g") pod "network-check-target-hzrtl" (UID: "0f0eb8fe-5607-4bef-bf73-985c92fa4c72") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:14:14.745009 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.744932    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-52.ec2.internal" event="NodeReady"
Sep 19 04:14:14.745441 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.745116    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 19 04:14:14.818554 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.818491    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5clmr"]
Sep 19 04:14:14.822652 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.822631    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kscs4"]
Sep 19 04:14:14.822813 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.822776    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5clmr"
Sep 19 04:14:14.825674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.825650    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:14.826672 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.826347    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q6xzq\""
Sep 19 04:14:14.826672 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.826502    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 19 04:14:14.826672 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.826628    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 19 04:14:14.826918 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.826903    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 19 04:14:14.828223 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.828201    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5s7cn\""
Sep 19 04:14:14.828223 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.828206    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 19 04:14:14.828371 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.828224    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 19 04:14:14.841722 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.841697    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kscs4"]
Sep 19 04:14:14.844086 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.844065    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5clmr"]
Sep 19 04:14:14.981087 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.980832    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whlmr\" (UniqueName: \"kubernetes.io/projected/d6e6655e-0f9b-4a74-8846-79c07b83f45a-kube-api-access-whlmr\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:14.981268 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.981112    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d160e30-9094-4610-bb26-38565d5a063c-cert\") pod \"ingress-canary-5clmr\" (UID: \"0d160e30-9094-4610-bb26-38565d5a063c\") " pod="openshift-ingress-canary/ingress-canary-5clmr"
Sep 19 04:14:14.981268 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.981141    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:14.981268 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.981168    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6e6655e-0f9b-4a74-8846-79c07b83f45a-tmp-dir\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:14.981435 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.981266    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gbcv\" (UniqueName: \"kubernetes.io/projected/0d160e30-9094-4610-bb26-38565d5a063c-kube-api-access-2gbcv\") pod \"ingress-canary-5clmr\" (UID: \"0d160e30-9094-4610-bb26-38565d5a063c\") " pod="openshift-ingress-canary/ingress-canary-5clmr"
Sep 19 04:14:14.981435 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:14.981375    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6e6655e-0f9b-4a74-8846-79c07b83f45a-config-volume\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:15.082151 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.082059    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whlmr\" (UniqueName: \"kubernetes.io/projected/d6e6655e-0f9b-4a74-8846-79c07b83f45a-kube-api-access-whlmr\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:15.082151 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.082104    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d160e30-9094-4610-bb26-38565d5a063c-cert\") pod \"ingress-canary-5clmr\" (UID: \"0d160e30-9094-4610-bb26-38565d5a063c\") " pod="openshift-ingress-canary/ingress-canary-5clmr"
Sep 19 04:14:15.082151 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.082144    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:15.082422 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.082165    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6e6655e-0f9b-4a74-8846-79c07b83f45a-tmp-dir\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:15.082422 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.082203    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gbcv\" (UniqueName: \"kubernetes.io/projected/0d160e30-9094-4610-bb26-38565d5a063c-kube-api-access-2gbcv\") pod \"ingress-canary-5clmr\" (UID: \"0d160e30-9094-4610-bb26-38565d5a063c\") " pod="openshift-ingress-canary/ingress-canary-5clmr"
Sep 19 04:14:15.082422 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.082275    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6e6655e-0f9b-4a74-8846-79c07b83f45a-config-volume\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:15.082422 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:15.082287    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 04:14:15.082422 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:15.082362    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls podName:d6e6655e-0f9b-4a74-8846-79c07b83f45a nodeName:}" failed. No retries permitted until 2026-09-19 04:14:15.582341946 +0000 UTC m=+35.560538325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls") pod "dns-default-kscs4" (UID: "d6e6655e-0f9b-4a74-8846-79c07b83f45a") : secret "dns-default-metrics-tls" not found
Sep 19 04:14:15.082737 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.082606    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d6e6655e-0f9b-4a74-8846-79c07b83f45a-tmp-dir\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:15.082903 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.082885    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d6e6655e-0f9b-4a74-8846-79c07b83f45a-config-volume\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:15.087120 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.087099    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d160e30-9094-4610-bb26-38565d5a063c-cert\") pod \"ingress-canary-5clmr\" (UID: \"0d160e30-9094-4610-bb26-38565d5a063c\") " pod="openshift-ingress-canary/ingress-canary-5clmr"
Sep 19 04:14:15.105321 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.105294    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gbcv\" (UniqueName: \"kubernetes.io/projected/0d160e30-9094-4610-bb26-38565d5a063c-kube-api-access-2gbcv\") pod \"ingress-canary-5clmr\" (UID: \"0d160e30-9094-4610-bb26-38565d5a063c\") " pod="openshift-ingress-canary/ingress-canary-5clmr"
Sep 19 04:14:15.109034 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.109006    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whlmr\" (UniqueName: \"kubernetes.io/projected/d6e6655e-0f9b-4a74-8846-79c07b83f45a-kube-api-access-whlmr\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:15.134894 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.134856    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5clmr"
Sep 19 04:14:15.533051 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.533014    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:14:15.533227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.533067    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:14:15.533227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.533014    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:14:15.541063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.540662    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 04:14:15.541063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.541062    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zg2ns\""
Sep 19 04:14:15.541629 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.541617    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 04:14:15.542098 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.542075    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 04:14:15.542098 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.542095    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 04:14:15.542251 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.542117    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rwkvg\""
Sep 19 04:14:15.586052 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.586016    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:15.586230 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:15.586155    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 04:14:15.586230 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:15.586214    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls podName:d6e6655e-0f9b-4a74-8846-79c07b83f45a nodeName:}" failed. No retries permitted until 2026-09-19 04:14:16.586196224 +0000 UTC m=+36.564392607 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls") pod "dns-default-kscs4" (UID: "d6e6655e-0f9b-4a74-8846-79c07b83f45a") : secret "dns-default-metrics-tls" not found
Sep 19 04:14:15.994329 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:15.994297    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5clmr"]
Sep 19 04:14:16.029126 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:14:16.029090    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d160e30_9094_4610_bb26_38565d5a063c.slice/crio-1d1fe87cf3b2f7d4decc7e1803cf8c5ef0d943041676d3d34b895f4a66bc4ee2 WatchSource:0}: Error finding container 1d1fe87cf3b2f7d4decc7e1803cf8c5ef0d943041676d3d34b895f4a66bc4ee2: Status 404 returned error can't find the container with id 1d1fe87cf3b2f7d4decc7e1803cf8c5ef0d943041676d3d34b895f4a66bc4ee2
Sep 19 04:14:16.595215 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:16.595181    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:16.595403 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:16.595309    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 04:14:16.595403 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:16.595366    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls podName:d6e6655e-0f9b-4a74-8846-79c07b83f45a nodeName:}" failed. No retries permitted until 2026-09-19 04:14:18.595350822 +0000 UTC m=+38.573547195 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls") pod "dns-default-kscs4" (UID: "d6e6655e-0f9b-4a74-8846-79c07b83f45a") : secret "dns-default-metrics-tls" not found
Sep 19 04:14:16.788884 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:16.788840    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5clmr" event={"ID":"0d160e30-9094-4610-bb26-38565d5a063c","Type":"ContainerStarted","Data":"1d1fe87cf3b2f7d4decc7e1803cf8c5ef0d943041676d3d34b895f4a66bc4ee2"}
Sep 19 04:14:16.793140 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:16.793033    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25d84" event={"ID":"e02cfaf0-083f-4fc0-b915-6d328825c71c","Type":"ContainerDied","Data":"54f9be0830c654061c188f4214d741722bf8291d3665a8668e164f306e278a51"}
Sep 19 04:14:16.793893 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:16.792992    2569 generic.go:356] "Generic (PLEG): container finished" podID="e02cfaf0-083f-4fc0-b915-6d328825c71c" containerID="54f9be0830c654061c188f4214d741722bf8291d3665a8668e164f306e278a51" exitCode=0
Sep 19 04:14:17.801710 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:17.801381    2569 generic.go:356] "Generic (PLEG): container finished" podID="e02cfaf0-083f-4fc0-b915-6d328825c71c" containerID="c1514cc5e63b8b2ecd2097f27fa4a88d37bea67a8e76a1bbc2ac47b95d015f76" exitCode=0
Sep 19 04:14:17.801710 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:17.801462    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25d84" event={"ID":"e02cfaf0-083f-4fc0-b915-6d328825c71c","Type":"ContainerDied","Data":"c1514cc5e63b8b2ecd2097f27fa4a88d37bea67a8e76a1bbc2ac47b95d015f76"}
Sep 19 04:14:18.609504 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:18.609468    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:18.609654 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:18.609619    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 04:14:18.609694 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:18.609688    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls podName:d6e6655e-0f9b-4a74-8846-79c07b83f45a nodeName:}" failed. No retries permitted until 2026-09-19 04:14:22.609670893 +0000 UTC m=+42.587867261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls") pod "dns-default-kscs4" (UID: "d6e6655e-0f9b-4a74-8846-79c07b83f45a") : secret "dns-default-metrics-tls" not found
Sep 19 04:14:18.807546 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:18.807511    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-25d84" event={"ID":"e02cfaf0-083f-4fc0-b915-6d328825c71c","Type":"ContainerStarted","Data":"3bc86040faabf01940f7715be32a8b9ff474e2b3c59b9044b5a1cd9cc3b5fc79"}
Sep 19 04:14:18.995064 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:18.994981    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:19.148241 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:19.148211    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:19.772482 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:19.772453    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:19.811970 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:19.811937    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5clmr" event={"ID":"0d160e30-9094-4610-bb26-38565d5a063c","Type":"ContainerStarted","Data":"38dafc816cf4dc69955619aaf97ba3068d2f37a2c52c5e87e1fcf2a234adf7cb"}
Sep 19 04:14:19.840764 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:19.840701    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5clmr" podStartSLOduration=3.150614405 podStartE2EDuration="5.840685303s" totalImagesPullingTime="2.690070898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:19.840163633 +0000 UTC m=+39.818360024" watchObservedRunningTime="2026-09-19 04:14:19.840685303 +0000 UTC m=+39.818881687"
Sep 19 04:14:19.841048 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:19.841025    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-25d84" podStartSLOduration=10.973565791 podStartE2EDuration="39.841016447s" totalImagesPullingTime="28.867450656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:18.838826672 +0000 UTC m=+38.817023061" watchObservedRunningTime="2026-09-19 04:14:19.841016447 +0000 UTC m=+39.819212836"
Sep 19 04:14:19.880718 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:19.880682    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:20.363221 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:20.363186    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:20.479414 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:20.479383    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:20.985956 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:20.985918    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:21.105464 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:21.105433    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:21.964374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:21.964342    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:22.166880 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:22.166844    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:22.641544 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:22.641499    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:22.641704 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:22.641657    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 04:14:22.641740 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:22.641723    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls podName:d6e6655e-0f9b-4a74-8846-79c07b83f45a nodeName:}" failed. No retries permitted until 2026-09-19 04:14:30.641707777 +0000 UTC m=+50.619904145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls") pod "dns-default-kscs4" (UID: "d6e6655e-0f9b-4a74-8846-79c07b83f45a") : secret "dns-default-metrics-tls" not found
Sep 19 04:14:25.569918 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.569887    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"]
Sep 19 04:14:25.599920 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.599890    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"]
Sep 19 04:14:25.600073 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.599990    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:25.611001 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.610976    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 19 04:14:25.611127 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.610978    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ld5vv\""
Sep 19 04:14:25.612116 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.612097    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 19 04:14:25.618297 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.618280    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 19 04:14:25.626795 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.626775    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 19 04:14:25.761824 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.761788    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86zb8\" (UniqueName: \"kubernetes.io/projected/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-kube-api-access-86zb8\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:25.761824 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.761830    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:25.762050 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.761851    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:25.862534 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.862444    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86zb8\" (UniqueName: \"kubernetes.io/projected/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-kube-api-access-86zb8\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:25.862534 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.862495    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:25.862534 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.862514    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:25.862788 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:25.862616    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 19 04:14:25.862788 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:25.862686    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls podName:56c0a386-20f4-4ad1-8b1e-9040d461cf1f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:26.362666828 +0000 UTC m=+46.340863200 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-nz85f" (UID: "56c0a386-20f4-4ad1-8b1e-9040d461cf1f") : secret "cluster-monitoring-operator-tls" not found
Sep 19 04:14:25.863292 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.863274    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:25.880700 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:25.880668    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86zb8\" (UniqueName: \"kubernetes.io/projected/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-kube-api-access-86zb8\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:26.038311 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:26.038275    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:26.143501 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:26.143478    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:26.366146 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:26.366105    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:26.366319 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:26.366262    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 19 04:14:26.366355 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:26.366343    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls podName:56c0a386-20f4-4ad1-8b1e-9040d461cf1f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:27.366327118 +0000 UTC m=+47.344523486 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-nz85f" (UID: "56c0a386-20f4-4ad1-8b1e-9040d461cf1f") : secret "cluster-monitoring-operator-tls" not found
Sep 19 04:14:27.373304 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:27.373202    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:27.373789 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:27.373350    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 19 04:14:27.373789 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:27.373442    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls podName:56c0a386-20f4-4ad1-8b1e-9040d461cf1f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:29.37341907 +0000 UTC m=+49.351615454 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-nz85f" (UID: "56c0a386-20f4-4ad1-8b1e-9040d461cf1f") : secret "cluster-monitoring-operator-tls" not found
Sep 19 04:14:29.387784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.387722    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:29.388180 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:29.387915    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 19 04:14:29.388180 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:29.388025    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls podName:56c0a386-20f4-4ad1-8b1e-9040d461cf1f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:33.387985977 +0000 UTC m=+53.366182345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-nz85f" (UID: "56c0a386-20f4-4ad1-8b1e-9040d461cf1f") : secret "cluster-monitoring-operator-tls" not found
Sep 19 04:14:29.630579 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.630539    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pll6q"]
Sep 19 04:14:29.642512 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.642432    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:29.649844 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.649823    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 19 04:14:29.649977 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.649913    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 19 04:14:29.650048 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.649976    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 19 04:14:29.650275 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.650260    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 19 04:14:29.650275 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.650271    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mt2jg\""
Sep 19 04:14:29.650764 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.650726    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:29.659243 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.659212    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pll6q"]
Sep 19 04:14:29.734130 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.734096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:29.791249 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.791217    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-crio-socket\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:29.791425 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.791254    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-data-volume\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:29.791425 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.791305    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:29.791425 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.791412    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:29.791556 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.791445    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwt95\" (UniqueName: \"kubernetes.io/projected/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-api-access-xwt95\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:29.892631 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.892540    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:29.892631 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.892603    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:29.892631 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.892622    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwt95\" (UniqueName: \"kubernetes.io/projected/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-api-access-xwt95\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:29.892947 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.892652    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-crio-socket\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:29.892947 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.892669    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-data-volume\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:29.892947 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:29.892694    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:29.892947 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:29.892789    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 04:14:29.892947 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:29.892807    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls podName:a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:30.39278666 +0000 UTC m=+50.370983028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pll6q" (UID: "a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f") : secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:29.892947 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:29.892865    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm podName:a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:30.392846413 +0000 UTC m=+50.371042781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pll6q" (UID: "a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f") : configmap "kube-rbac-proxy" not found
Sep 19 04:14:29.892947 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.892895    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-crio-socket\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:29.893243 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.893032    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-data-volume\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:29.902644 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:29.902624    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwt95\" (UniqueName: \"kubernetes.io/projected/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-api-access-xwt95\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:30.395959 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:30.395929    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:30.396403 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:30.395998    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:30.396403 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:30.396085    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 04:14:30.396403 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:30.396109    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:30.396403 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:30.396153    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm podName:a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:31.396137938 +0000 UTC m=+51.374334313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pll6q" (UID: "a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f") : configmap "kube-rbac-proxy" not found
Sep 19 04:14:30.396403 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:30.396184    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls podName:a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:31.396164275 +0000 UTC m=+51.374360660 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pll6q" (UID: "a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f") : secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:30.698405 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:30.698312    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:30.698664 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:30.698449    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 04:14:30.698664 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:30.698526    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls podName:d6e6655e-0f9b-4a74-8846-79c07b83f45a nodeName:}" failed. No retries permitted until 2026-09-19 04:14:46.698505923 +0000 UTC m=+66.676702294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls") pod "dns-default-kscs4" (UID: "d6e6655e-0f9b-4a74-8846-79c07b83f45a") : secret "dns-default-metrics-tls" not found
Sep 19 04:14:31.404157 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:31.404121    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:31.404535 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:31.404193    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:31.404535 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:31.404270    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 04:14:31.404535 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:31.404308    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:31.404535 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:31.404342    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm podName:a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:33.404326219 +0000 UTC m=+53.382522586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pll6q" (UID: "a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f") : configmap "kube-rbac-proxy" not found
Sep 19 04:14:31.404535 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:31.404361    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls podName:a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:33.404350015 +0000 UTC m=+53.382546383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pll6q" (UID: "a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f") : secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:31.463871 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:31.463845    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7hp9_70dadf06-e872-445e-9238-112acc1a782f/dns-node-resolver/0.log"
Sep 19 04:14:32.084913 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:32.084887    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-25lfw_80adac8f-4c32-43bf-8ecc-e127f28b7b7a/node-ca/0.log"
Sep 19 04:14:32.466353 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:32.466319    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:32.548118 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:32.548078    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:32.867259 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:32.867182    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5clmr_0d160e30-9094-4610-bb26-38565d5a063c/serve-healthcheck-canary/0.log"
Sep 19 04:14:33.419453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:33.419416    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:33.419650 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:33.419483    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:33.419650 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:33.419521    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:33.419650 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:33.419590    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:33.419650 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:33.419608    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 04:14:33.419650 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:33.419625    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 19 04:14:33.419863 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:33.419672    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls podName:a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:37.419651521 +0000 UTC m=+57.397847892 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pll6q" (UID: "a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f") : secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:33.419863 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:33.419691    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm podName:a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:37.419681905 +0000 UTC m=+57.397878276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pll6q" (UID: "a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f") : configmap "kube-rbac-proxy" not found
Sep 19 04:14:33.419863 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:33.419707    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls podName:56c0a386-20f4-4ad1-8b1e-9040d461cf1f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:41.419699122 +0000 UTC m=+61.397895490 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-nz85f" (UID: "56c0a386-20f4-4ad1-8b1e-9040d461cf1f") : secret "cluster-monitoring-operator-tls" not found
Sep 19 04:14:34.435346 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.435302    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-ztdhc"]
Sep 19 04:14:34.437216 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.437193    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-ztdhc"
Sep 19 04:14:34.440969 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.440947    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-n4lx7\""
Sep 19 04:14:34.441795 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.441775    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 19 04:14:34.441795 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.441791    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 19 04:14:34.466958 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.466934    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-ztdhc"]
Sep 19 04:14:34.503376 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.503343    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"]
Sep 19 04:14:34.505268 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.505254    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"
Sep 19 04:14:34.512870 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.512841    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 19 04:14:34.513000 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.512986    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 19 04:14:34.513127 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.513112    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 19 04:14:34.513297 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.513285    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ztblt\""
Sep 19 04:14:34.539195 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.539165    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"]
Sep 19 04:14:34.628807 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.628765    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-fdg7q\" (UID: \"8b5d97e4-0c3a-4b35-ab5c-0270fda2473a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"
Sep 19 04:14:34.628987 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.628854    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbfgs\" (UniqueName: \"kubernetes.io/projected/86afa60b-1dab-4b7a-9874-778f4b2aefcb-kube-api-access-pbfgs\") pod \"volume-data-source-validator-5c4db8bdf9-ztdhc\" (UID: \"86afa60b-1dab-4b7a-9874-778f4b2aefcb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-ztdhc"
Sep 19 04:14:34.628987 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.628895    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx8k4\" (UniqueName: \"kubernetes.io/projected/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-kube-api-access-nx8k4\") pod \"cluster-samples-operator-685d7d68b5-fdg7q\" (UID: \"8b5d97e4-0c3a-4b35-ab5c-0270fda2473a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"
Sep 19 04:14:34.730260 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.730165    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-fdg7q\" (UID: \"8b5d97e4-0c3a-4b35-ab5c-0270fda2473a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"
Sep 19 04:14:34.730423 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.730271    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbfgs\" (UniqueName: \"kubernetes.io/projected/86afa60b-1dab-4b7a-9874-778f4b2aefcb-kube-api-access-pbfgs\") pod \"volume-data-source-validator-5c4db8bdf9-ztdhc\" (UID: \"86afa60b-1dab-4b7a-9874-778f4b2aefcb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-ztdhc"
Sep 19 04:14:34.730423 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:34.730316    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 19 04:14:34.730423 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:34.730385    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls podName:8b5d97e4-0c3a-4b35-ab5c-0270fda2473a nodeName:}" failed. No retries permitted until 2026-09-19 04:14:35.230370826 +0000 UTC m=+55.208567193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-fdg7q" (UID: "8b5d97e4-0c3a-4b35-ab5c-0270fda2473a") : secret "samples-operator-tls" not found
Sep 19 04:14:34.730423 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.730328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx8k4\" (UniqueName: \"kubernetes.io/projected/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-kube-api-access-nx8k4\") pod \"cluster-samples-operator-685d7d68b5-fdg7q\" (UID: \"8b5d97e4-0c3a-4b35-ab5c-0270fda2473a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"
Sep 19 04:14:34.740203 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.740175    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx8k4\" (UniqueName: \"kubernetes.io/projected/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-kube-api-access-nx8k4\") pod \"cluster-samples-operator-685d7d68b5-fdg7q\" (UID: \"8b5d97e4-0c3a-4b35-ab5c-0270fda2473a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"
Sep 19 04:14:34.740387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.740367    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbfgs\" (UniqueName: \"kubernetes.io/projected/86afa60b-1dab-4b7a-9874-778f4b2aefcb-kube-api-access-pbfgs\") pod \"volume-data-source-validator-5c4db8bdf9-ztdhc\" (UID: \"86afa60b-1dab-4b7a-9874-778f4b2aefcb\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-ztdhc"
Sep 19 04:14:34.745192 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:34.745172    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-ztdhc"
Sep 19 04:14:35.013603 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.013523    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-ztdhc"]
Sep 19 04:14:35.016495 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:14:35.016467    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86afa60b_1dab_4b7a_9874_778f4b2aefcb.slice/crio-ae25f6ef385fd3331614a1ed7ff55d8f63dbf338f033eec13b585fe47046ff41 WatchSource:0}: Error finding container ae25f6ef385fd3331614a1ed7ff55d8f63dbf338f033eec13b585fe47046ff41: Status 404 returned error can't find the container with id ae25f6ef385fd3331614a1ed7ff55d8f63dbf338f033eec13b585fe47046ff41
Sep 19 04:14:35.235767 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.235720    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-fdg7q\" (UID: \"8b5d97e4-0c3a-4b35-ab5c-0270fda2473a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"
Sep 19 04:14:35.235966 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:35.235891    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 19 04:14:35.236031 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:35.235972    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls podName:8b5d97e4-0c3a-4b35-ab5c-0270fda2473a nodeName:}" failed. No retries permitted until 2026-09-19 04:14:36.235951252 +0000 UTC m=+56.214147634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-fdg7q" (UID: "8b5d97e4-0c3a-4b35-ab5c-0270fda2473a") : secret "samples-operator-tls" not found
Sep 19 04:14:35.462082 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.462047    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn"]
Sep 19 04:14:35.464374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.464359    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn"
Sep 19 04:14:35.467401 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.467381    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 19 04:14:35.468021 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.468005    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 19 04:14:35.468354 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.468340    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 19 04:14:35.468416 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.468367    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vksl5\""
Sep 19 04:14:35.468473 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.468367    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 19 04:14:35.478734 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.478712    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn"]
Sep 19 04:14:35.537685 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.537652    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a634168-a302-4db0-9e10-0afd4756c0b0-config\") pod \"service-ca-operator-57cdc4b768-hzwkn\" (UID: \"1a634168-a302-4db0-9e10-0afd4756c0b0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn"
Sep 19 04:14:35.537878 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.537720    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hxqs\" (UniqueName: \"kubernetes.io/projected/1a634168-a302-4db0-9e10-0afd4756c0b0-kube-api-access-9hxqs\") pod \"service-ca-operator-57cdc4b768-hzwkn\" (UID: \"1a634168-a302-4db0-9e10-0afd4756c0b0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn"
Sep 19 04:14:35.537931 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.537891    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a634168-a302-4db0-9e10-0afd4756c0b0-serving-cert\") pod \"service-ca-operator-57cdc4b768-hzwkn\" (UID: \"1a634168-a302-4db0-9e10-0afd4756c0b0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn"
Sep 19 04:14:35.562267 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.562237    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf"]
Sep 19 04:14:35.564206 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.564186    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf"
Sep 19 04:14:35.567262 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.567239    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 19 04:14:35.567500 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.567476    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 19 04:14:35.567609 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.567513    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 19 04:14:35.567609 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.567513    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 19 04:14:35.567609 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.567553    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wd5hl\""
Sep 19 04:14:35.586397 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.586366    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf"]
Sep 19 04:14:35.638615 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.638576    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a634168-a302-4db0-9e10-0afd4756c0b0-serving-cert\") pod \"service-ca-operator-57cdc4b768-hzwkn\" (UID: \"1a634168-a302-4db0-9e10-0afd4756c0b0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn"
Sep 19 04:14:35.638825 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.638648    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a634168-a302-4db0-9e10-0afd4756c0b0-config\") pod \"service-ca-operator-57cdc4b768-hzwkn\" (UID: \"1a634168-a302-4db0-9e10-0afd4756c0b0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn"
Sep 19 04:14:35.638825 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.638680    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e30d573-f91e-4e5e-89ac-0314996c20a7-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-flldf\" (UID: \"4e30d573-f91e-4e5e-89ac-0314996c20a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf"
Sep 19 04:14:35.638825 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.638715    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e30d573-f91e-4e5e-89ac-0314996c20a7-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-flldf\" (UID: \"4e30d573-f91e-4e5e-89ac-0314996c20a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf"
Sep 19 04:14:35.638825 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.638767    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hxqs\" (UniqueName: \"kubernetes.io/projected/1a634168-a302-4db0-9e10-0afd4756c0b0-kube-api-access-9hxqs\") pod \"service-ca-operator-57cdc4b768-hzwkn\" (UID: \"1a634168-a302-4db0-9e10-0afd4756c0b0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn"
Sep 19 04:14:35.639049 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.638915    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm9jd\" (UniqueName: \"kubernetes.io/projected/4e30d573-f91e-4e5e-89ac-0314996c20a7-kube-api-access-gm9jd\") pod \"kube-storage-version-migrator-operator-55889f7b47-flldf\" (UID: \"4e30d573-f91e-4e5e-89ac-0314996c20a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf"
Sep 19 04:14:35.639361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.639339    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a634168-a302-4db0-9e10-0afd4756c0b0-config\") pod \"service-ca-operator-57cdc4b768-hzwkn\" (UID: \"1a634168-a302-4db0-9e10-0afd4756c0b0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn"
Sep 19 04:14:35.641108 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.641081    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a634168-a302-4db0-9e10-0afd4756c0b0-serving-cert\") pod \"service-ca-operator-57cdc4b768-hzwkn\" (UID: \"1a634168-a302-4db0-9e10-0afd4756c0b0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn"
Sep 19 04:14:35.649483 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.649459    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hxqs\" (UniqueName: \"kubernetes.io/projected/1a634168-a302-4db0-9e10-0afd4756c0b0-kube-api-access-9hxqs\") pod \"service-ca-operator-57cdc4b768-hzwkn\" (UID: \"1a634168-a302-4db0-9e10-0afd4756c0b0\") " pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn"
Sep 19 04:14:35.739683 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.739594    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e30d573-f91e-4e5e-89ac-0314996c20a7-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-flldf\" (UID: \"4e30d573-f91e-4e5e-89ac-0314996c20a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf"
Sep 19 04:14:35.739683 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.739637    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e30d573-f91e-4e5e-89ac-0314996c20a7-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-flldf\" (UID: \"4e30d573-f91e-4e5e-89ac-0314996c20a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf"
Sep 19 04:14:35.739939 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.739697    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm9jd\" (UniqueName: \"kubernetes.io/projected/4e30d573-f91e-4e5e-89ac-0314996c20a7-kube-api-access-gm9jd\") pod \"kube-storage-version-migrator-operator-55889f7b47-flldf\" (UID: \"4e30d573-f91e-4e5e-89ac-0314996c20a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf"
Sep 19 04:14:35.740261 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.740240    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4e30d573-f91e-4e5e-89ac-0314996c20a7-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-flldf\" (UID: \"4e30d573-f91e-4e5e-89ac-0314996c20a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf"
Sep 19 04:14:35.742046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.742023    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e30d573-f91e-4e5e-89ac-0314996c20a7-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-flldf\" (UID: \"4e30d573-f91e-4e5e-89ac-0314996c20a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf"
Sep 19 04:14:35.750181 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.750155    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm9jd\" (UniqueName: \"kubernetes.io/projected/4e30d573-f91e-4e5e-89ac-0314996c20a7-kube-api-access-gm9jd\") pod \"kube-storage-version-migrator-operator-55889f7b47-flldf\" (UID: \"4e30d573-f91e-4e5e-89ac-0314996c20a7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf"
Sep 19 04:14:35.773122 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.773083    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn"
Sep 19 04:14:35.852252 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.852214    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-ztdhc" event={"ID":"86afa60b-1dab-4b7a-9874-778f4b2aefcb","Type":"ContainerStarted","Data":"ae25f6ef385fd3331614a1ed7ff55d8f63dbf338f033eec13b585fe47046ff41"}
Sep 19 04:14:35.875427 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:35.875397    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf"
Sep 19 04:14:36.243578 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:36.243546    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-fdg7q\" (UID: \"8b5d97e4-0c3a-4b35-ab5c-0270fda2473a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"
Sep 19 04:14:36.243736 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:36.243689    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 19 04:14:36.243804 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:36.243770    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls podName:8b5d97e4-0c3a-4b35-ab5c-0270fda2473a nodeName:}" failed. No retries permitted until 2026-09-19 04:14:38.243736256 +0000 UTC m=+58.221932628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-fdg7q" (UID: "8b5d97e4-0c3a-4b35-ab5c-0270fda2473a") : secret "samples-operator-tls" not found
Sep 19 04:14:36.267127 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:36.267100    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn"]
Sep 19 04:14:36.269683 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:14:36.269625    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a634168_a302_4db0_9e10_0afd4756c0b0.slice/crio-4091fe396cc300a5f6e1927384b25cd97b8a14846987f5e2a0e28cc66a014e23 WatchSource:0}: Error finding container 4091fe396cc300a5f6e1927384b25cd97b8a14846987f5e2a0e28cc66a014e23: Status 404 returned error can't find the container with id 4091fe396cc300a5f6e1927384b25cd97b8a14846987f5e2a0e28cc66a014e23
Sep 19 04:14:36.270503 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:36.270473    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf"]
Sep 19 04:14:36.273407 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:14:36.273382    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e30d573_f91e_4e5e_89ac_0314996c20a7.slice/crio-f18c8e5e115f12c4cf8ae793cdec6ab4878b208fd4892cf7dc6dcfba73a2b08a WatchSource:0}: Error finding container f18c8e5e115f12c4cf8ae793cdec6ab4878b208fd4892cf7dc6dcfba73a2b08a: Status 404 returned error can't find the container with id f18c8e5e115f12c4cf8ae793cdec6ab4878b208fd4892cf7dc6dcfba73a2b08a
Sep 19 04:14:36.856524 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:36.856486    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf" event={"ID":"4e30d573-f91e-4e5e-89ac-0314996c20a7","Type":"ContainerStarted","Data":"f18c8e5e115f12c4cf8ae793cdec6ab4878b208fd4892cf7dc6dcfba73a2b08a"}
Sep 19 04:14:36.858558 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:36.858529    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-ztdhc" event={"ID":"86afa60b-1dab-4b7a-9874-778f4b2aefcb","Type":"ContainerStarted","Data":"c671876a771ab4ffa97b700589cf6aa31eb273d5abd72d0552a9e8ed9c5f277b"}
Sep 19 04:14:36.859834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:36.859800    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn" event={"ID":"1a634168-a302-4db0-9e10-0afd4756c0b0","Type":"ContainerStarted","Data":"4091fe396cc300a5f6e1927384b25cd97b8a14846987f5e2a0e28cc66a014e23"}
Sep 19 04:14:36.888369 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:36.888315    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5c4db8bdf9-ztdhc" podStartSLOduration=1.897702062 podStartE2EDuration="2.888299764s" totalImagesPullingTime="990.597702ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:36.888143082 +0000 UTC m=+56.866339473" watchObservedRunningTime="2026-09-19 04:14:36.888299764 +0000 UTC m=+56.866496151"
Sep 19 04:14:37.067554 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:37.067520    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:37.168274 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:37.168242    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:37.451392 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:37.451307    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:37.451578 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:37.451391    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:37.451578 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:37.451501    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 04:14:37.451578 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:37.451562    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm podName:a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:45.451545966 +0000 UTC m=+65.429742342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pll6q" (UID: "a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f") : configmap "kube-rbac-proxy" not found
Sep 19 04:14:37.451930 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:37.451911    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:37.452048 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:37.451952    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls podName:a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:45.451941111 +0000 UTC m=+65.430137484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pll6q" (UID: "a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f") : secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:38.259108 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:38.259065    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-fdg7q\" (UID: \"8b5d97e4-0c3a-4b35-ab5c-0270fda2473a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"
Sep 19 04:14:38.259484 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:38.259230    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 19 04:14:38.259484 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:38.259298    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls podName:8b5d97e4-0c3a-4b35-ab5c-0270fda2473a nodeName:}" failed. No retries permitted until 2026-09-19 04:14:42.259282852 +0000 UTC m=+62.237479220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-fdg7q" (UID: "8b5d97e4-0c3a-4b35-ab5c-0270fda2473a") : secret "samples-operator-tls" not found
Sep 19 04:14:39.777056 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:39.777001    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v94sd"
Sep 19 04:14:39.868837 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:39.868791    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn" event={"ID":"1a634168-a302-4db0-9e10-0afd4756c0b0","Type":"ContainerStarted","Data":"294af0f6e26e0677c6f756c51a4ba93aa340983893020cd22e1891c12b7d6962"}
Sep 19 04:14:39.870505 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:39.870478    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf" event={"ID":"4e30d573-f91e-4e5e-89ac-0314996c20a7","Type":"ContainerStarted","Data":"532594a2868405e1560ac0a18927c57e057165fc125cc07badbf35cbbf4fb4a8"}
Sep 19 04:14:39.887214 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:39.887158    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn" podStartSLOduration=2.065801411 podStartE2EDuration="4.887139677s" totalImagesPullingTime="2.821338266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:14:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:39.886043577 +0000 UTC m=+59.864239966" watchObservedRunningTime="2026-09-19 04:14:39.887139677 +0000 UTC m=+59.865336069"
Sep 19 04:14:39.911218 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:39.911155    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf" podStartSLOduration=2.086603191 podStartE2EDuration="4.911135513s" totalImagesPullingTime="2.824532322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:14:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:39.909928474 +0000 UTC m=+59.888124865" watchObservedRunningTime="2026-09-19 04:14:39.911135513 +0000 UTC m=+59.889331907"
Sep 19 04:14:40.047408 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:40.047318    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:40.258087 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:40.258049    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:40.545984 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:40.545954    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-b8cv4"]
Sep 19 04:14:40.548493 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:40.548473    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8cv4"
Sep 19 04:14:40.556115 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:40.556097    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wrtkl\""
Sep 19 04:14:40.556518 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:40.556497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:40.569014 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:40.568983    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-b8cv4"]
Sep 19 04:14:40.578006 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:40.577977    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzw2f\" (UniqueName: \"kubernetes.io/projected/17b23ba7-ee11-4c23-9b66-cc15a4e4f886-kube-api-access-xzw2f\") pod \"network-check-source-7cbc45fddc-b8cv4\" (UID: \"17b23ba7-ee11-4c23-9b66-cc15a4e4f886\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8cv4"
Sep 19 04:14:40.678813 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:40.678771    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzw2f\" (UniqueName: \"kubernetes.io/projected/17b23ba7-ee11-4c23-9b66-cc15a4e4f886-kube-api-access-xzw2f\") pod \"network-check-source-7cbc45fddc-b8cv4\" (UID: \"17b23ba7-ee11-4c23-9b66-cc15a4e4f886\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8cv4"
Sep 19 04:14:40.693935 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:40.693906    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 04:14:40.704093 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:40.704069    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 04:14:40.714198 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:40.714176    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzw2f\" (UniqueName: \"kubernetes.io/projected/17b23ba7-ee11-4c23-9b66-cc15a4e4f886-kube-api-access-xzw2f\") pod \"network-check-source-7cbc45fddc-b8cv4\" (UID: \"17b23ba7-ee11-4c23-9b66-cc15a4e4f886\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8cv4"
Sep 19 04:14:40.716525 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:40.716504    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:40.857293 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:40.857208    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8cv4"
Sep 19 04:14:41.104674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:41.104639    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:41.132009 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:41.131975    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-b8cv4"]
Sep 19 04:14:41.135767 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:14:41.135725    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b23ba7_ee11_4c23_9b66_cc15a4e4f886.slice/crio-83eaf44461a0e26cb8c7d1cc9c029dd59c788da960b9991fba075af265d9477e WatchSource:0}: Error finding container 83eaf44461a0e26cb8c7d1cc9c029dd59c788da960b9991fba075af265d9477e: Status 404 returned error can't find the container with id 83eaf44461a0e26cb8c7d1cc9c029dd59c788da960b9991fba075af265d9477e
Sep 19 04:14:41.219468 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:41.219432    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:41.485183 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:41.485104    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:41.485361 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:41.485215    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 19 04:14:41.485361 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:41.485270    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls podName:56c0a386-20f4-4ad1-8b1e-9040d461cf1f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:57.48525617 +0000 UTC m=+77.463452542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-nz85f" (UID: "56c0a386-20f4-4ad1-8b1e-9040d461cf1f") : secret "cluster-monitoring-operator-tls" not found
Sep 19 04:14:41.534042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:41.534004    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:41.688686 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:41.688654    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:41.829273 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:41.829160    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:41.878267 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:41.878225    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8cv4" event={"ID":"17b23ba7-ee11-4c23-9b66-cc15a4e4f886","Type":"ContainerStarted","Data":"83eaf44461a0e26cb8c7d1cc9c029dd59c788da960b9991fba075af265d9477e"}
Sep 19 04:14:41.936967 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:41.936917    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:42.291584 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:42.291550    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-fdg7q\" (UID: \"8b5d97e4-0c3a-4b35-ab5c-0270fda2473a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"
Sep 19 04:14:42.291777 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:42.291714    2569 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 19 04:14:42.291831 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:42.291798    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls podName:8b5d97e4-0c3a-4b35-ab5c-0270fda2473a nodeName:}" failed. No retries permitted until 2026-09-19 04:14:50.291778814 +0000 UTC m=+70.269975184 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-fdg7q" (UID: "8b5d97e4-0c3a-4b35-ab5c-0270fda2473a") : secret "samples-operator-tls" not found
Sep 19 04:14:42.904502 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:42.904467    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:43.001997 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.001961    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-ljwgv"]
Sep 19 04:14:43.005045 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.005015    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-ljwgv"
Sep 19 04:14:43.009311 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.009285    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 19 04:14:43.009459 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.009374    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-g6lp9\""
Sep 19 04:14:43.009673 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.009656    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 19 04:14:43.009772 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.009657    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 19 04:14:43.009977 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.009955    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 19 04:14:43.018104 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.018079    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-ljwgv"]
Sep 19 04:14:43.038251 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.038222    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:43.098714 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.098674    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e35bd755-e6f4-4a2b-9aaf-8849d65da9c2-signing-cabundle\") pod \"service-ca-55f6fc7b86-ljwgv\" (UID: \"e35bd755-e6f4-4a2b-9aaf-8849d65da9c2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ljwgv"
Sep 19 04:14:43.098920 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.098774    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e35bd755-e6f4-4a2b-9aaf-8849d65da9c2-signing-key\") pod \"service-ca-55f6fc7b86-ljwgv\" (UID: \"e35bd755-e6f4-4a2b-9aaf-8849d65da9c2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ljwgv"
Sep 19 04:14:43.098920 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.098818    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plswm\" (UniqueName: \"kubernetes.io/projected/e35bd755-e6f4-4a2b-9aaf-8849d65da9c2-kube-api-access-plswm\") pod \"service-ca-55f6fc7b86-ljwgv\" (UID: \"e35bd755-e6f4-4a2b-9aaf-8849d65da9c2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ljwgv"
Sep 19 04:14:43.146690 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.146654    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:43.199387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.199301    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e35bd755-e6f4-4a2b-9aaf-8849d65da9c2-signing-key\") pod \"service-ca-55f6fc7b86-ljwgv\" (UID: \"e35bd755-e6f4-4a2b-9aaf-8849d65da9c2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ljwgv"
Sep 19 04:14:43.199387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.199350    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plswm\" (UniqueName: \"kubernetes.io/projected/e35bd755-e6f4-4a2b-9aaf-8849d65da9c2-kube-api-access-plswm\") pod \"service-ca-55f6fc7b86-ljwgv\" (UID: \"e35bd755-e6f4-4a2b-9aaf-8849d65da9c2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ljwgv"
Sep 19 04:14:43.199611 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.199463    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e35bd755-e6f4-4a2b-9aaf-8849d65da9c2-signing-cabundle\") pod \"service-ca-55f6fc7b86-ljwgv\" (UID: \"e35bd755-e6f4-4a2b-9aaf-8849d65da9c2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ljwgv"
Sep 19 04:14:43.200212 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.200184    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/e35bd755-e6f4-4a2b-9aaf-8849d65da9c2-signing-cabundle\") pod \"service-ca-55f6fc7b86-ljwgv\" (UID: \"e35bd755-e6f4-4a2b-9aaf-8849d65da9c2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ljwgv"
Sep 19 04:14:43.202104 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.202084    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/e35bd755-e6f4-4a2b-9aaf-8849d65da9c2-signing-key\") pod \"service-ca-55f6fc7b86-ljwgv\" (UID: \"e35bd755-e6f4-4a2b-9aaf-8849d65da9c2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ljwgv"
Sep 19 04:14:43.219981 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.219956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plswm\" (UniqueName: \"kubernetes.io/projected/e35bd755-e6f4-4a2b-9aaf-8849d65da9c2-kube-api-access-plswm\") pod \"service-ca-55f6fc7b86-ljwgv\" (UID: \"e35bd755-e6f4-4a2b-9aaf-8849d65da9c2\") " pod="openshift-service-ca/service-ca-55f6fc7b86-ljwgv"
Sep 19 04:14:43.317618 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.317575    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-55f6fc7b86-ljwgv"
Sep 19 04:14:43.884691 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.884660    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8cv4" event={"ID":"17b23ba7-ee11-4c23-9b66-cc15a4e4f886","Type":"ContainerStarted","Data":"163f577b8d089e40b1ec5cbf5bc2a61ad83c84074790d45b8185c16922e30b26"}
Sep 19 04:14:43.909507 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.909449    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-b8cv4" podStartSLOduration=1.31998844 podStartE2EDuration="3.909433183s" totalImagesPullingTime="2.589444743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:14:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:43.908492803 +0000 UTC m=+63.886689192" watchObservedRunningTime="2026-09-19 04:14:43.909433183 +0000 UTC m=+63.887629572"
Sep 19 04:14:43.971145 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:43.971057    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-55f6fc7b86-ljwgv"]
Sep 19 04:14:43.974582 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:14:43.974560    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35bd755_e6f4_4a2b_9aaf_8849d65da9c2.slice/crio-436d693d0d0a52bd5f9250df09cf07134b5f95d4033d5723880efd812fa66b5d WatchSource:0}: Error finding container 436d693d0d0a52bd5f9250df09cf07134b5f95d4033d5723880efd812fa66b5d: Status 404 returned error can't find the container with id 436d693d0d0a52bd5f9250df09cf07134b5f95d4033d5723880efd812fa66b5d
Sep 19 04:14:44.485418 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:44.485381    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:44.891016 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:44.890967    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-ljwgv" event={"ID":"e35bd755-e6f4-4a2b-9aaf-8849d65da9c2","Type":"ContainerStarted","Data":"b9f3d1ca7de7db4c4b8a92c5d5a2fa643a5d9d8de53a1bcf88494830e78da03e"}
Sep 19 04:14:44.891212 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:44.891040    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-55f6fc7b86-ljwgv" event={"ID":"e35bd755-e6f4-4a2b-9aaf-8849d65da9c2","Type":"ContainerStarted","Data":"436d693d0d0a52bd5f9250df09cf07134b5f95d4033d5723880efd812fa66b5d"}
Sep 19 04:14:44.915866 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:44.915822    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-55f6fc7b86-ljwgv" podStartSLOduration=2.915805428 podStartE2EDuration="2.915805428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:14:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:44.915642353 +0000 UTC m=+64.893838742" watchObservedRunningTime="2026-09-19 04:14:44.915805428 +0000 UTC m=+64.894001818"
Sep 19 04:14:45.520302 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:45.520248    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:45.520482 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:45.520393    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:45.520520 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:45.520511    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:45.520584 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:45.520574    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls podName:a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f nodeName:}" failed. No retries permitted until 2026-09-19 04:15:01.520556573 +0000 UTC m=+81.498752948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pll6q" (UID: "a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f") : secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:45.520812 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:45.520792    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:14:46.151102 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.151066    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:46.226958 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.226920    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:14:46.230197 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.230173    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 04:14:46.239943 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.239906    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9969efc8-3073-4e0d-a4ef-cd1c6bb87409-original-pull-secret\") pod \"global-pull-secret-syncer-9msr4\" (UID: \"9969efc8-3073-4e0d-a4ef-cd1c6bb87409\") " pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:14:46.316561 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.316522    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:46.327669 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.327642    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs\") pod \"network-metrics-daemon-twvwv\" (UID: \"8003fa5c-0817-4994-8405-7bc431ab1c36\") " pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:14:46.331510 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.331487    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 04:14:46.338442 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:46.338419    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 19 04:14:46.338572 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:46.338516    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs podName:8003fa5c-0817-4994-8405-7bc431ab1c36 nodeName:}" failed. No retries permitted until 2026-09-19 04:15:50.338495094 +0000 UTC m=+130.316691466 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs") pod "network-metrics-daemon-twvwv" (UID: "8003fa5c-0817-4994-8405-7bc431ab1c36") : secret "metrics-daemon-secret" not found
Sep 19 04:14:46.415690 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.415601    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:46.428729 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.428696    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjv9g\" (UniqueName: \"kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g\") pod \"network-check-target-hzrtl\" (UID: \"0f0eb8fe-5607-4bef-bf73-985c92fa4c72\") " pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:14:46.438713 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.438683    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjv9g\" (UniqueName: \"kubernetes.io/projected/0f0eb8fe-5607-4bef-bf73-985c92fa4c72-kube-api-access-kjv9g\") pod \"network-check-target-hzrtl\" (UID: \"0f0eb8fe-5607-4bef-bf73-985c92fa4c72\") " pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:14:46.443619 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.443599    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9msr4"
Sep 19 04:14:46.453689 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.453637    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rwkvg\""
Sep 19 04:14:46.461124 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.461104    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:14:46.519467 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.519272    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:46.616241 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.616171    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:46.732116 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.732027    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:14:46.732343 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:46.732207    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 04:14:46.732343 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:14:46.732270    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls podName:d6e6655e-0f9b-4a74-8846-79c07b83f45a nodeName:}" failed. No retries permitted until 2026-09-19 04:15:18.732253916 +0000 UTC m=+98.710450290 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls") pod "dns-default-kscs4" (UID: "d6e6655e-0f9b-4a74-8846-79c07b83f45a") : secret "dns-default-metrics-tls" not found
Sep 19 04:14:46.789292 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.789250    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9msr4"]
Sep 19 04:14:46.793413 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:14:46.793388    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9969efc8_3073_4e0d_a4ef_cd1c6bb87409.slice/crio-c06f7e74bf4369a10339280f2edfc4f52d232b8b8aa400a876b8226f7e113856 WatchSource:0}: Error finding container c06f7e74bf4369a10339280f2edfc4f52d232b8b8aa400a876b8226f7e113856: Status 404 returned error can't find the container with id c06f7e74bf4369a10339280f2edfc4f52d232b8b8aa400a876b8226f7e113856
Sep 19 04:14:46.810847 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.810817    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hzrtl"]
Sep 19 04:14:46.813666 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:14:46.813638    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f0eb8fe_5607_4bef_bf73_985c92fa4c72.slice/crio-1e556de0c04cf11eb8548494ba3adbb2417beb912fbf11fe3b17cf8c3638be11 WatchSource:0}: Error finding container 1e556de0c04cf11eb8548494ba3adbb2417beb912fbf11fe3b17cf8c3638be11: Status 404 returned error can't find the container with id 1e556de0c04cf11eb8548494ba3adbb2417beb912fbf11fe3b17cf8c3638be11
Sep 19 04:14:46.873743 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.873715    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:46.898892 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.898855    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9msr4" event={"ID":"9969efc8-3073-4e0d-a4ef-cd1c6bb87409","Type":"ContainerStarted","Data":"c06f7e74bf4369a10339280f2edfc4f52d232b8b8aa400a876b8226f7e113856"}
Sep 19 04:14:46.900382 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.900365    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hzrtl" event={"ID":"0f0eb8fe-5607-4bef-bf73-985c92fa4c72","Type":"ContainerStarted","Data":"79cc43f1f999cdcf6d85f3657863f841222d7b7938e1394252c290ce1b875b63"}
Sep 19 04:14:46.900492 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.900396    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hzrtl" event={"ID":"0f0eb8fe-5607-4bef-bf73-985c92fa4c72","Type":"ContainerStarted","Data":"1e556de0c04cf11eb8548494ba3adbb2417beb912fbf11fe3b17cf8c3638be11"}
Sep 19 04:14:46.900543 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.900483    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:14:46.928207 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.928152    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hzrtl" podStartSLOduration=66.928133595 podStartE2EDuration="1m6.928133595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:13:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:46.926573836 +0000 UTC m=+66.904770226" watchObservedRunningTime="2026-09-19 04:14:46.928133595 +0000 UTC m=+66.906329986"
Sep 19 04:14:46.979113 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:46.979081    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:47.871231 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:47.871194    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:48.062299 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:48.062265    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:48.517140 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:48.517108    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:48.718591 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:48.718536    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:49.174784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:49.174732    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:49.282293 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:49.282261    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:49.669881 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:49.669849    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:49.868417 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:49.868377    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:49.971808 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:49.971717    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:50.364911 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:50.364834    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-fdg7q\" (UID: \"8b5d97e4-0c3a-4b35-ab5c-0270fda2473a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"
Sep 19 04:14:50.367601 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:50.367573    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b5d97e4-0c3a-4b35-ab5c-0270fda2473a-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-fdg7q\" (UID: \"8b5d97e4-0c3a-4b35-ab5c-0270fda2473a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"
Sep 19 04:14:50.413175 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:50.413133    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:50.417288 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:50.417264    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ztblt\""
Sep 19 04:14:50.423686 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:50.423656    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"
Sep 19 04:14:50.539358 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:50.539316    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:50.877989 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:50.877907    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:50.979406 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:50.979365    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:51.096709 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:51.096632    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q"]
Sep 19 04:14:51.266301 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:51.266272    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:51.675664 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:51.675629    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:51.867599 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:51.867563    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:51.923069 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:51.923029    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9msr4" event={"ID":"9969efc8-3073-4e0d-a4ef-cd1c6bb87409","Type":"ContainerStarted","Data":"0ed8d2367a246dafdeb6826680957d2ac150912cc44915ed04bbe7251c16f54d"}
Sep 19 04:14:51.924335 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:51.924307    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q" event={"ID":"8b5d97e4-0c3a-4b35-ab5c-0270fda2473a","Type":"ContainerStarted","Data":"dbfebfb4bb443523a636fa060d92494a9af996eb3629150b626a5eec6a30ec0d"}
Sep 19 04:14:52.021207 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:52.021108    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:52.305079 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:52.304989    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:52.480188 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:52.480157    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:52.868646 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:52.868610    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:53.245788 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:53.245731    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:53.447402 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:53.447358    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:53.860342 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:53.860255    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:53.936992 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:53.936951    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q" event={"ID":"8b5d97e4-0c3a-4b35-ab5c-0270fda2473a","Type":"ContainerStarted","Data":"2c144f8f2e1ef127bcb85ed364bcbef65af0d19d4e8faa26f5dd24bea3f499ca"}
Sep 19 04:14:53.937401 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:53.937042    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q" event={"ID":"8b5d97e4-0c3a-4b35-ab5c-0270fda2473a","Type":"ContainerStarted","Data":"30fbda65ac34a7b9c2a4a7cf6e19d4eb52f8b64bad378a42a30e99c7707f2416"}
Sep 19 04:14:53.958109 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:53.958054    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-fdg7q" podStartSLOduration=17.99023038 podStartE2EDuration="19.958039893s" totalImagesPullingTime="1.967809513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:53.957527491 +0000 UTC m=+73.935723881" watchObservedRunningTime="2026-09-19 04:14:53.958039893 +0000 UTC m=+73.936236295"
Sep 19 04:14:53.958439 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:53.958408    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9msr4" podStartSLOduration=69.872379026 podStartE2EDuration="1m13.958398631s" totalImagesPullingTime="4.086019605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:51.950033782 +0000 UTC m=+71.928230177" watchObservedRunningTime="2026-09-19 04:14:53.958398631 +0000 UTC m=+73.936595020"
Sep 19 04:14:54.650636 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:54.650604    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:55.089327 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:55.089209    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:55.245227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:55.245193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:55.448224 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:55.448192    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:55.858900 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:55.858812    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:56.465129 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:56.465094    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:56.657856 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:56.657824    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:56.892537 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:56.892507    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:14:57.528714 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:57.528659    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:57.531439 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:57.531414    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/56c0a386-20f4-4ad1-8b1e-9040d461cf1f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-nz85f\" (UID: \"56c0a386-20f4-4ad1-8b1e-9040d461cf1f\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:57.711045 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:57.711014    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-ld5vv\""
Sep 19 04:14:57.719193 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:57.719164    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"
Sep 19 04:14:57.993437 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:57.993374    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f"]
Sep 19 04:14:57.996222 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:14:57.996181    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56c0a386_20f4_4ad1_8b1e_9040d461cf1f.slice/crio-93c20cdf2566880b62c94b14ada1e64c6a2ba01b02c4c4c96402a4c9d2d6e77c WatchSource:0}: Error finding container 93c20cdf2566880b62c94b14ada1e64c6a2ba01b02c4c4c96402a4c9d2d6e77c: Status 404 returned error can't find the container with id 93c20cdf2566880b62c94b14ada1e64c6a2ba01b02c4c4c96402a4c9d2d6e77c
Sep 19 04:14:58.954717 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:58.954675    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f" event={"ID":"56c0a386-20f4-4ad1-8b1e-9040d461cf1f","Type":"ContainerStarted","Data":"93c20cdf2566880b62c94b14ada1e64c6a2ba01b02c4c4c96402a4c9d2d6e77c"}
Sep 19 04:14:59.959561 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:59.959527    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f" event={"ID":"56c0a386-20f4-4ad1-8b1e-9040d461cf1f","Type":"ContainerStarted","Data":"c4c033dbd9c35aecddad3b02aa52453514ed9d8f9aeb33246561d368d88995fc"}
Sep 19 04:14:59.988100 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:14:59.988038    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-nz85f" podStartSLOduration=33.139218815 podStartE2EDuration="34.988015548s" totalImagesPullingTime="1.848796733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:59.987957877 +0000 UTC m=+79.966154268" watchObservedRunningTime="2026-09-19 04:14:59.988015548 +0000 UTC m=+79.966211939"
Sep 19 04:15:00.217044 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:00.217004    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:00.319280 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:00.319240    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:00.420620 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:00.420586    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:00.825897 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:00.825863    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:01.560411 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:01.560353    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:15:01.562846 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:01.562826    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pll6q\" (UID: \"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f\") " pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:15:01.756896 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:01.756785    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mt2jg\""
Sep 19 04:15:01.761655 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:01.761639    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pll6q"
Sep 19 04:15:02.058156 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:02.058126    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pll6q"]
Sep 19 04:15:02.061647 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:15:02.061618    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e2b98a_c67f_4b9e_9b3c_8a434de3be0f.slice/crio-bad836d1c3752e08937d6a8732d1369c16ce249c8619e2e5a7abcfedd8ce87bb WatchSource:0}: Error finding container bad836d1c3752e08937d6a8732d1369c16ce249c8619e2e5a7abcfedd8ce87bb: Status 404 returned error can't find the container with id bad836d1c3752e08937d6a8732d1369c16ce249c8619e2e5a7abcfedd8ce87bb
Sep 19 04:15:02.970233 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:02.970206    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pll6q" event={"ID":"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f","Type":"ContainerStarted","Data":"82341c19c4a3fb1c4b5ed152f2095b962d84121a9a177df0ec9ab7489bb6914d"}
Sep 19 04:15:02.970600 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:02.970258    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pll6q" event={"ID":"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f","Type":"ContainerStarted","Data":"9e725ba06493dd0e58f2daabb87df481e82d62e4fdbe6403ef6303119ee9789d"}
Sep 19 04:15:02.970600 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:02.970277    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pll6q" event={"ID":"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f","Type":"ContainerStarted","Data":"bad836d1c3752e08937d6a8732d1369c16ce249c8619e2e5a7abcfedd8ce87bb"}
Sep 19 04:15:04.979472 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:04.979430    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pll6q" event={"ID":"a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f","Type":"ContainerStarted","Data":"813652762de40c3a77726bfcad0089cc40c85f781a931072027b5c51a30b14a9"}
Sep 19 04:15:06.998761 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:06.998692    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pll6q" podStartSLOduration=36.021535672 podStartE2EDuration="37.998669608s" totalImagesPullingTime="1.977133936s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:14:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:05.011633832 +0000 UTC m=+84.989830222" watchObservedRunningTime="2026-09-19 04:15:06.998669608 +0000 UTC m=+86.976865998"
Sep 19 04:15:06.999154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:06.998896    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz"]
Sep 19 04:15:07.001960 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.001940    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz"
Sep 19 04:15:07.006230 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.006207    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 19 04:15:07.007146 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.007129    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-v9qj9\""
Sep 19 04:15:07.007435 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.007417    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 19 04:15:07.007506 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.007466    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 19 04:15:07.007572 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.007524    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 19 04:15:07.070608 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.070573    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz"]
Sep 19 04:15:07.101221 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.101188    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ss5q\" (UniqueName: \"kubernetes.io/projected/2ada3587-9809-4c6a-b16e-0040a6e4b736-kube-api-access-9ss5q\") pod \"managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz\" (UID: \"2ada3587-9809-4c6a-b16e-0040a6e4b736\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz"
Sep 19 04:15:07.101221 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.101227    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ada3587-9809-4c6a-b16e-0040a6e4b736-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz\" (UID: \"2ada3587-9809-4c6a-b16e-0040a6e4b736\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz"
Sep 19 04:15:07.104415 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.104389    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:07.134236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.134202    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"]
Sep 19 04:15:07.137221 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.137205    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.155379 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.155352    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 19 04:15:07.157355 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.157334    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tnxhx\""
Sep 19 04:15:07.157502 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.157484    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 19 04:15:07.157560 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.157501    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 19 04:15:07.185293 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.185257    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-hqfrk"]
Sep 19 04:15:07.188352 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.188335    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-hqfrk"
Sep 19 04:15:07.192162 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.192137    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-kkv7j\""
Sep 19 04:15:07.192331 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.192313    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 19 04:15:07.193530 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.193506    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"]
Sep 19 04:15:07.202208 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.202186    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-image-registry-private-configuration\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.202312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.202217    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-registry-certificates\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.202312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.202260    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-bound-sa-token\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.202312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.202282    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-registry-tls\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.202439 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.202326    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx469\" (UniqueName: \"kubernetes.io/projected/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-kube-api-access-zx469\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.202439 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.202350    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ss5q\" (UniqueName: \"kubernetes.io/projected/2ada3587-9809-4c6a-b16e-0040a6e4b736-kube-api-access-9ss5q\") pod \"managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz\" (UID: \"2ada3587-9809-4c6a-b16e-0040a6e4b736\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz"
Sep 19 04:15:07.202439 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.202364    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-ca-trust-extracted\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.202439 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.202390    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ada3587-9809-4c6a-b16e-0040a6e4b736-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz\" (UID: \"2ada3587-9809-4c6a-b16e-0040a6e4b736\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz"
Sep 19 04:15:07.202439 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.202406    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-installation-pull-secrets\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.202439 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.202429    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-trusted-ca\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.202813 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.202795    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 19 04:15:07.205008 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.204982    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2ada3587-9809-4c6a-b16e-0040a6e4b736-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz\" (UID: \"2ada3587-9809-4c6a-b16e-0040a6e4b736\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz"
Sep 19 04:15:07.223660 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.223628    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-hqfrk"]
Sep 19 04:15:07.225463 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.225441    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ss5q\" (UniqueName: \"kubernetes.io/projected/2ada3587-9809-4c6a-b16e-0040a6e4b736-kube-api-access-9ss5q\") pod \"managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz\" (UID: \"2ada3587-9809-4c6a-b16e-0040a6e4b736\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz"
Sep 19 04:15:07.303298 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.303212    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-ca-trust-extracted\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.303298 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.303250    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-installation-pull-secrets\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.303298 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.303280    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-trusted-ca\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.303563 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.303315    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-image-registry-private-configuration\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.303563 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.303334    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-registry-certificates\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.303563 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.303375    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-bound-sa-token\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.303563 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.303406    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-registry-tls\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.303563 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.303472    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/91e0a3bc-8cf2-450f-8ee6-6ec648efec4b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-hqfrk\" (UID: \"91e0a3bc-8cf2-450f-8ee6-6ec648efec4b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-hqfrk"
Sep 19 04:15:07.303563 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.303518    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx469\" (UniqueName: \"kubernetes.io/projected/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-kube-api-access-zx469\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.304474 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.304285    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-ca-trust-extracted\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.304474 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.304420    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-trusted-ca\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.304686 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.304662    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-registry-certificates\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.306008 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.305986    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-image-registry-private-configuration\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.306096 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.306013    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-registry-tls\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.306096 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.306090    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-installation-pull-secrets\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.324071 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.324046    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz"
Sep 19 04:15:07.326715 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.326691    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx469\" (UniqueName: \"kubernetes.io/projected/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-kube-api-access-zx469\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.330014 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.329956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26ad0ea5-7db9-4dc8-b574-a1c12434ee5d-bound-sa-token\") pod \"image-registry-6dd6b64c5d-5fzq7\" (UID: \"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d\") " pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.332681 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.332642    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:07.404307 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.404275    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/91e0a3bc-8cf2-450f-8ee6-6ec648efec4b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-hqfrk\" (UID: \"91e0a3bc-8cf2-450f-8ee6-6ec648efec4b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-hqfrk"
Sep 19 04:15:07.407357 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.407308    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/91e0a3bc-8cf2-450f-8ee6-6ec648efec4b-tls-certificates\") pod \"prometheus-operator-admission-webhook-5c6747dc7b-hqfrk\" (UID: \"91e0a3bc-8cf2-450f-8ee6-6ec648efec4b\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-hqfrk"
Sep 19 04:15:07.445765 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.445729    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.473482 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.473435    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:07.498086 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.498058    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-hqfrk"
Sep 19 04:15:07.617222 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.617139    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz"]
Sep 19 04:15:07.619976 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:15:07.619948    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ada3587_9809_4c6a_b16e_0040a6e4b736.slice/crio-3b7727375cded19a02d992017d3a2a211c6e10e80ee9a1314846be3546358a04 WatchSource:0}: Error finding container 3b7727375cded19a02d992017d3a2a211c6e10e80ee9a1314846be3546358a04: Status 404 returned error can't find the container with id 3b7727375cded19a02d992017d3a2a211c6e10e80ee9a1314846be3546358a04
Sep 19 04:15:07.623879 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.623856    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:07.735312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.735289    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"]
Sep 19 04:15:07.737109 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:15:07.737081    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ad0ea5_7db9_4dc8_b574_a1c12434ee5d.slice/crio-b74611621e09ea13063d6f8b313a7d81d73b8aca1d587ffbffe79f602d608468 WatchSource:0}: Error finding container b74611621e09ea13063d6f8b313a7d81d73b8aca1d587ffbffe79f602d608468: Status 404 returned error can't find the container with id b74611621e09ea13063d6f8b313a7d81d73b8aca1d587ffbffe79f602d608468
Sep 19 04:15:07.789200 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.789166    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-hqfrk"]
Sep 19 04:15:07.792385 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:15:07.792360    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e0a3bc_8cf2_450f_8ee6_6ec648efec4b.slice/crio-30a7a209f7fd64a1d56cfd523203def49e7f9cb17e55225d891876a2c30bffa9 WatchSource:0}: Error finding container 30a7a209f7fd64a1d56cfd523203def49e7f9cb17e55225d891876a2c30bffa9: Status 404 returned error can't find the container with id 30a7a209f7fd64a1d56cfd523203def49e7f9cb17e55225d891876a2c30bffa9
Sep 19 04:15:07.996123 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.996075    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7" event={"ID":"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d","Type":"ContainerStarted","Data":"c1f176e839e24c1af49d1ba5db5e2b8769df75e37a7af12e19130c47f4408eec"}
Sep 19 04:15:07.996303 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.996161    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7" event={"ID":"26ad0ea5-7db9-4dc8-b574-a1c12434ee5d","Type":"ContainerStarted","Data":"b74611621e09ea13063d6f8b313a7d81d73b8aca1d587ffbffe79f602d608468"}
Sep 19 04:15:07.996303 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.996223    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:07.997424 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.997393    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz" event={"ID":"2ada3587-9809-4c6a-b16e-0040a6e4b736","Type":"ContainerStarted","Data":"3b7727375cded19a02d992017d3a2a211c6e10e80ee9a1314846be3546358a04"}
Sep 19 04:15:07.998593 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:07.998571    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-hqfrk" event={"ID":"91e0a3bc-8cf2-450f-8ee6-6ec648efec4b","Type":"ContainerStarted","Data":"30a7a209f7fd64a1d56cfd523203def49e7f9cb17e55225d891876a2c30bffa9"}
Sep 19 04:15:08.045954 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:08.045902    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7" podStartSLOduration=1.04588508 podStartE2EDuration="1.04588508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:15:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:08.04500402 +0000 UTC m=+88.023200413" watchObservedRunningTime="2026-09-19 04:15:08.04588508 +0000 UTC m=+88.024081467"
Sep 19 04:15:09.004075 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:09.004034    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-hqfrk" event={"ID":"91e0a3bc-8cf2-450f-8ee6-6ec648efec4b","Type":"ContainerStarted","Data":"2e77e7a84f7e45da425a70cfc1edddf13f98571f0df2c77a133f19b7b4575c12"}
Sep 19 04:15:09.004431 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:09.004414    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-hqfrk"
Sep 19 04:15:09.008985 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:09.008963    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-hqfrk"
Sep 19 04:15:09.024174 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:09.024035    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5c6747dc7b-hqfrk" podStartSLOduration=1.019665653 podStartE2EDuration="2.024017336s" totalImagesPullingTime="1.004351683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:09.023449085 +0000 UTC m=+89.001645479" watchObservedRunningTime="2026-09-19 04:15:09.024017336 +0000 UTC m=+89.002213727"
Sep 19 04:15:09.479648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:09.479589    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:09.599708 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:09.599620    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:09.892474 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:09.892432    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:12.015775 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:12.015715    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz" event={"ID":"2ada3587-9809-4c6a-b16e-0040a6e4b736","Type":"ContainerStarted","Data":"600a1f2bfe6f3705a06ebc05b90adb5d40dfc2e682ba7b0b7adefb5cc7b5db54"}
Sep 19 04:15:12.033147 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:12.033090    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5c4d8c6b68-jntmz" podStartSLOduration=2.610399396 podStartE2EDuration="6.033073659s" totalImagesPullingTime="3.422674263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:12.032638897 +0000 UTC m=+92.010835288" watchObservedRunningTime="2026-09-19 04:15:12.033073659 +0000 UTC m=+92.011270049"
Sep 19 04:15:13.875997 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:13.875962    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:16.716918 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:16.716885    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:17.119303 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.119223    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:17.519289 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.519242    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"]
Sep 19 04:15:17.522813 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.522784    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"]
Sep 19 04:15:17.522941 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.522838    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.524736 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.524719    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"
Sep 19 04:15:17.529246 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.529159    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 19 04:15:17.529323 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.529275    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 19 04:15:17.529396 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.529378    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 19 04:15:17.530488 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.530471    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-m6v94\""
Sep 19 04:15:17.532519 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.532503    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 19 04:15:17.541357 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.541339    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 19 04:15:17.541965 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.541952    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 19 04:15:17.542080 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.542070    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-q85kr\""
Sep 19 04:15:17.592168 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.592140    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"]
Sep 19 04:15:17.601981 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.601954    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"]
Sep 19 04:15:17.650988 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.650957    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:17.690176 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.690144    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91acc5d8-f9ae-46b4-849e-956c1b633b42-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.690345 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.690208    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5af773fa-b943-4f5a-9c14-ba0bf6e8aa07-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-9rxxp\" (UID: \"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"
Sep 19 04:15:17.690438 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.690419    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/91acc5d8-f9ae-46b4-849e-956c1b633b42-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.690501 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.690475    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/91acc5d8-f9ae-46b4-849e-956c1b633b42-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.690554 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.690518    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/91acc5d8-f9ae-46b4-849e-956c1b633b42-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.690601 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.690559    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5af773fa-b943-4f5a-9c14-ba0bf6e8aa07-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-9rxxp\" (UID: \"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"
Sep 19 04:15:17.690639 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.690621    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjf4n\" (UniqueName: \"kubernetes.io/projected/91acc5d8-f9ae-46b4-849e-956c1b633b42-kube-api-access-kjf4n\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.690671 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.690650    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5af773fa-b943-4f5a-9c14-ba0bf6e8aa07-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-9rxxp\" (UID: \"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"
Sep 19 04:15:17.690671 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.690667    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfhmc\" (UniqueName: \"kubernetes.io/projected/5af773fa-b943-4f5a-9c14-ba0bf6e8aa07-kube-api-access-qfhmc\") pod \"openshift-state-metrics-86c5bc79d6-9rxxp\" (UID: \"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"
Sep 19 04:15:17.690793 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.690744    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91acc5d8-f9ae-46b4-849e-956c1b633b42-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.694400 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.694380    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8x6mv"]
Sep 19 04:15:17.696531 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.696517    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.704071 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.704052    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 19 04:15:17.705903 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.705886    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 19 04:15:17.705982 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.705933    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 19 04:15:17.706264 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.706248    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rp7q2\""
Sep 19 04:15:17.791488 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791408    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef666e8f-6ef2-46ed-b997-3724db846512-sys\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.791488 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791451    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5af773fa-b943-4f5a-9c14-ba0bf6e8aa07-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-9rxxp\" (UID: \"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"
Sep 19 04:15:17.791488 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791477    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-wtmp\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791518    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjf4n\" (UniqueName: \"kubernetes.io/projected/91acc5d8-f9ae-46b4-849e-956c1b633b42-kube-api-access-kjf4n\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791537    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5af773fa-b943-4f5a-9c14-ba0bf6e8aa07-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-9rxxp\" (UID: \"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791557    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfhmc\" (UniqueName: \"kubernetes.io/projected/5af773fa-b943-4f5a-9c14-ba0bf6e8aa07-kube-api-access-qfhmc\") pod \"openshift-state-metrics-86c5bc79d6-9rxxp\" (UID: \"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791583    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2gts\" (UniqueName: \"kubernetes.io/projected/ef666e8f-6ef2-46ed-b997-3724db846512-kube-api-access-q2gts\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791622    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef666e8f-6ef2-46ed-b997-3724db846512-metrics-client-ca\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791662    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91acc5d8-f9ae-46b4-849e-956c1b633b42-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef666e8f-6ef2-46ed-b997-3724db846512-root\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791797    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-accelerators-collector-config\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791825    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-textfile\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791853    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91acc5d8-f9ae-46b4-849e-956c1b633b42-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791899    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-tls\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791928    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5af773fa-b943-4f5a-9c14-ba0bf6e8aa07-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-9rxxp\" (UID: \"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791956    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/91acc5d8-f9ae-46b4-849e-956c1b633b42-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.791994    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/91acc5d8-f9ae-46b4-849e-956c1b633b42-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.792063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.792044    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.792691 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.792077    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/91acc5d8-f9ae-46b4-849e-956c1b633b42-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.792691 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.792351    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5af773fa-b943-4f5a-9c14-ba0bf6e8aa07-metrics-client-ca\") pod \"openshift-state-metrics-86c5bc79d6-9rxxp\" (UID: \"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"
Sep 19 04:15:17.792691 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.792441    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/91acc5d8-f9ae-46b4-849e-956c1b633b42-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.792691 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.792563    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/91acc5d8-f9ae-46b4-849e-956c1b633b42-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.792894 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.792876    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/91acc5d8-f9ae-46b4-849e-956c1b633b42-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.794325 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.794295    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5af773fa-b943-4f5a-9c14-ba0bf6e8aa07-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-86c5bc79d6-9rxxp\" (UID: \"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"
Sep 19 04:15:17.794441 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.794351    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/91acc5d8-f9ae-46b4-849e-956c1b633b42-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.794597 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.794580    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/91acc5d8-f9ae-46b4-849e-956c1b633b42-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.794833 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.794815    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5af773fa-b943-4f5a-9c14-ba0bf6e8aa07-openshift-state-metrics-tls\") pod \"openshift-state-metrics-86c5bc79d6-9rxxp\" (UID: \"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"
Sep 19 04:15:17.816371 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.816340    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfhmc\" (UniqueName: \"kubernetes.io/projected/5af773fa-b943-4f5a-9c14-ba0bf6e8aa07-kube-api-access-qfhmc\") pod \"openshift-state-metrics-86c5bc79d6-9rxxp\" (UID: \"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07\") " pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"
Sep 19 04:15:17.816480 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.816460    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjf4n\" (UniqueName: \"kubernetes.io/projected/91acc5d8-f9ae-46b4-849e-956c1b633b42-kube-api-access-kjf4n\") pod \"kube-state-metrics-84c885658c-wkbrh\" (UID: \"91acc5d8-f9ae-46b4-849e-956c1b633b42\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.832162 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.832135    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"
Sep 19 04:15:17.837606 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.837592    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"
Sep 19 04:15:17.849672 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.849641    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:17.893476 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.893441    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef666e8f-6ef2-46ed-b997-3724db846512-root\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.893604 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.893492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-accelerators-collector-config\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.893604 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.893525    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-textfile\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.893604 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.893575    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-tls\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.894235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.893646    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.894235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.893686    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef666e8f-6ef2-46ed-b997-3724db846512-sys\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.894235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.893720    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-wtmp\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.894235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.893863    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2gts\" (UniqueName: \"kubernetes.io/projected/ef666e8f-6ef2-46ed-b997-3724db846512-kube-api-access-q2gts\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.894235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.893893    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef666e8f-6ef2-46ed-b997-3724db846512-metrics-client-ca\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.894235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.893954    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef666e8f-6ef2-46ed-b997-3724db846512-sys\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.894562 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.894234    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-accelerators-collector-config\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.894562 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.894340    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-wtmp\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.894562 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.894385    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-textfile\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.895012 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.894969    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef666e8f-6ef2-46ed-b997-3724db846512-metrics-client-ca\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.895423 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.893573    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef666e8f-6ef2-46ed-b997-3724db846512-root\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.897461 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.897413    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-tls\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.897980 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.897934    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef666e8f-6ef2-46ed-b997-3724db846512-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:17.907721 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.907692    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hzrtl"
Sep 19 04:15:17.941091 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:17.941059    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2gts\" (UniqueName: \"kubernetes.io/projected/ef666e8f-6ef2-46ed-b997-3724db846512-kube-api-access-q2gts\") pod \"node-exporter-8x6mv\" (UID: \"ef666e8f-6ef2-46ed-b997-3724db846512\") " pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:18.005400 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:18.005368    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8x6mv"
Sep 19 04:15:18.015644 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:15:18.015614    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef666e8f_6ef2_46ed_b997_3724db846512.slice/crio-59835cccd09e24b43c79452b0a4ba4392eaca689f962e096643d5037138e30b2 WatchSource:0}: Error finding container 59835cccd09e24b43c79452b0a4ba4392eaca689f962e096643d5037138e30b2: Status 404 returned error can't find the container with id 59835cccd09e24b43c79452b0a4ba4392eaca689f962e096643d5037138e30b2
Sep 19 04:15:18.037597 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:18.037566    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8x6mv" event={"ID":"ef666e8f-6ef2-46ed-b997-3724db846512","Type":"ContainerStarted","Data":"59835cccd09e24b43c79452b0a4ba4392eaca689f962e096643d5037138e30b2"}
Sep 19 04:15:18.133722 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:18.133693    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-wkbrh"]
Sep 19 04:15:18.135545 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:15:18.135513    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5af773fa_b943_4f5a_9c14_ba0bf6e8aa07.slice/crio-8503b4ca79fcebdf7ac8eba60f1cfe291f3ddf4544f4d1de7fa4d736e72b0b6d WatchSource:0}: Error finding container 8503b4ca79fcebdf7ac8eba60f1cfe291f3ddf4544f4d1de7fa4d736e72b0b6d: Status 404 returned error can't find the container with id 8503b4ca79fcebdf7ac8eba60f1cfe291f3ddf4544f4d1de7fa4d736e72b0b6d
Sep 19 04:15:18.136434 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:15:18.136404    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91acc5d8_f9ae_46b4_849e_956c1b633b42.slice/crio-26225f8c479d49501cc1b6ce5c9264851fb704dd1c28122a6a691e0d533f5543 WatchSource:0}: Error finding container 26225f8c479d49501cc1b6ce5c9264851fb704dd1c28122a6a691e0d533f5543: Status 404 returned error can't find the container with id 26225f8c479d49501cc1b6ce5c9264851fb704dd1c28122a6a691e0d533f5543
Sep 19 04:15:18.137031 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:18.137006    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp"]
Sep 19 04:15:18.191435 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:18.191412    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:18.423931 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:18.423841    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:18.594012 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:18.593975    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:18.716451 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:18.716373    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:18.803009 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:18.802976    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:15:18.807133 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:18.806414    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d6e6655e-0f9b-4a74-8846-79c07b83f45a-metrics-tls\") pod \"dns-default-kscs4\" (UID: \"d6e6655e-0f9b-4a74-8846-79c07b83f45a\") " pod="openshift-dns/dns-default-kscs4"
Sep 19 04:15:19.047301 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:19.044816    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh" event={"ID":"91acc5d8-f9ae-46b4-849e-956c1b633b42","Type":"ContainerStarted","Data":"26225f8c479d49501cc1b6ce5c9264851fb704dd1c28122a6a691e0d533f5543"}
Sep 19 04:15:19.047301 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:19.047186    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5s7cn\""
Sep 19 04:15:19.049610 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:19.049568    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp" event={"ID":"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07","Type":"ContainerStarted","Data":"00c4861e6aff10693205b249998c13ccf574fff0c0d61ee85804ce8a97b1e576"}
Sep 19 04:15:19.049765 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:19.049631    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp" event={"ID":"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07","Type":"ContainerStarted","Data":"6efce277f9f01b719de7afcb28f7350df2d6f109cbd73f5213dcbd4577eb26d1"}
Sep 19 04:15:19.049765 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:19.049660    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp" event={"ID":"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07","Type":"ContainerStarted","Data":"8503b4ca79fcebdf7ac8eba60f1cfe291f3ddf4544f4d1de7fa4d736e72b0b6d"}
Sep 19 04:15:19.053848 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:19.053825    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kscs4"
Sep 19 04:15:19.898776 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:19.898717    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kscs4"]
Sep 19 04:15:19.904055 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:15:19.904031    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e6655e_0f9b_4a74_8846_79c07b83f45a.slice/crio-794aa9e261c0d4d5f2e3ed3fe514c2a9fa00baaea34515d357cb18fd1b5f2d0d WatchSource:0}: Error finding container 794aa9e261c0d4d5f2e3ed3fe514c2a9fa00baaea34515d357cb18fd1b5f2d0d: Status 404 returned error can't find the container with id 794aa9e261c0d4d5f2e3ed3fe514c2a9fa00baaea34515d357cb18fd1b5f2d0d
Sep 19 04:15:20.057261 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:20.057227    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp" event={"ID":"5af773fa-b943-4f5a-9c14-ba0bf6e8aa07","Type":"ContainerStarted","Data":"272fc4951fbe5b244f3694de6011d980e5458deb2abdd3383173c94a363130ae"}
Sep 19 04:15:20.058562 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:20.058523    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kscs4" event={"ID":"d6e6655e-0f9b-4a74-8846-79c07b83f45a","Type":"ContainerStarted","Data":"794aa9e261c0d4d5f2e3ed3fe514c2a9fa00baaea34515d357cb18fd1b5f2d0d"}
Sep 19 04:15:20.060413 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:20.060385    2569 generic.go:356] "Generic (PLEG): container finished" podID="ef666e8f-6ef2-46ed-b997-3724db846512" containerID="57c28c9aff9309951424d1293b393e3f097da375e34df5a4ad5738b396cbadb6" exitCode=0
Sep 19 04:15:20.060518 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:20.060460    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8x6mv" event={"ID":"ef666e8f-6ef2-46ed-b997-3724db846512","Type":"ContainerDied","Data":"57c28c9aff9309951424d1293b393e3f097da375e34df5a4ad5738b396cbadb6"}
Sep 19 04:15:20.063007 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:20.062982    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh" event={"ID":"91acc5d8-f9ae-46b4-849e-956c1b633b42","Type":"ContainerStarted","Data":"c19d1c862027be59bfe52390e6346cf70e15d6cec70b79d8d4f6f4b2089c9f52"}
Sep 19 04:15:20.063115 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:20.063036    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh" event={"ID":"91acc5d8-f9ae-46b4-849e-956c1b633b42","Type":"ContainerStarted","Data":"130ecb7821249b2a55a7f65784dee992748d19324aa66a5a084ee6bd7dddc331"}
Sep 19 04:15:20.063115 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:20.063066    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh" event={"ID":"91acc5d8-f9ae-46b4-849e-956c1b633b42","Type":"ContainerStarted","Data":"baca9aaa49c53e2c76bf480b195eb7785f43fc1a10f8daf662276c884f334712"}
Sep 19 04:15:20.089940 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:20.089897    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-86c5bc79d6-9rxxp" podStartSLOduration=1.729930581 podStartE2EDuration="3.089880361s" totalImagesPullingTime="1.35994978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:20.089373365 +0000 UTC m=+100.067569754" watchObservedRunningTime="2026-09-19 04:15:20.089880361 +0000 UTC m=+100.068076776"
Sep 19 04:15:20.207696 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:20.207634    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-wkbrh" podStartSLOduration=1.729292521 podStartE2EDuration="3.207611239s" totalImagesPullingTime="1.478318718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:20.206396642 +0000 UTC m=+100.184593036" watchObservedRunningTime="2026-09-19 04:15:20.207611239 +0000 UTC m=+100.185807633"
Sep 19 04:15:20.554288 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:20.554196    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:20.697143 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:20.697097    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:21.069953 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:21.069913    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8x6mv" event={"ID":"ef666e8f-6ef2-46ed-b997-3724db846512","Type":"ContainerStarted","Data":"8bf78fa25074ce9bbdcf782055f4da8e380575bdae6686c413b0ce2011ff0b9d"}
Sep 19 04:15:21.070423 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:21.070016    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8x6mv" event={"ID":"ef666e8f-6ef2-46ed-b997-3724db846512","Type":"ContainerStarted","Data":"9e86385fca0bc1b17d9546f8adb98e05f1f8b043acd004f4edd425d1b4da562e"}
Sep 19 04:15:21.105154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:21.105099    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8x6mv" podStartSLOduration=2.407595254 podStartE2EDuration="4.105081744s" totalImagesPullingTime="1.598632187s" totalInitContainerRuntime="98.854303ms" isStatefulPod=true podCreationTimestamp="2026-09-19 04:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:21.104687307 +0000 UTC m=+101.082883699" watchObservedRunningTime="2026-09-19 04:15:21.105081744 +0000 UTC m=+101.083278134"
Sep 19 04:15:21.708431 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:21.708394    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:22.076837 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:22.076800    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kscs4" event={"ID":"d6e6655e-0f9b-4a74-8846-79c07b83f45a","Type":"ContainerStarted","Data":"c97dddf7e0547edb2a94e32b5154b39dca8cb4cdd1a6c57da5981061be782bea"}
Sep 19 04:15:22.077251 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:22.076873    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kscs4" event={"ID":"d6e6655e-0f9b-4a74-8846-79c07b83f45a","Type":"ContainerStarted","Data":"51047027d65334a9e9ce573d0b4a54d90f5666935b3347c17a778d4edb65bcab"}
Sep 19 04:15:22.515942 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:22.515908    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:23.080604 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.080574    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kscs4"
Sep 19 04:15:23.102419 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.102372    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-kscs4" podStartSLOduration=67.24222461 podStartE2EDuration="1m9.102349581s" totalImagesPullingTime="1.860124971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:14:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:23.101337951 +0000 UTC m=+103.079534341" watchObservedRunningTime="2026-09-19 04:15:23.102349581 +0000 UTC m=+103.080545972"
Sep 19 04:15:23.932485 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.932447    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:23.936004 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.935978    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 04:15:23.938742 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.938724    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.948916 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.948895    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 19 04:15:23.949008 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.948937    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 19 04:15:23.949008 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.948948    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 19 04:15:23.949250 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.949237    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 19 04:15:23.949311 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.949295    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-64fv4\""
Sep 19 04:15:23.949389 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.949371    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 19 04:15:23.949450 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.949386    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-32k0b9nu0v5ql\""
Sep 19 04:15:23.949495 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.949465    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 19 04:15:23.950017 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.950001    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 19 04:15:23.950096 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.950004    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 19 04:15:23.950513 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.950495    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 19 04:15:23.950574 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.950495    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 19 04:15:23.950610 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.950534    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 19 04:15:23.950927 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.950909    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 19 04:15:23.952251 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.952232    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 19 04:15:23.955699 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.955682    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 19 04:15:23.961351 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961328    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961442 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961442 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961387    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961442 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961411    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4znhs\" (UniqueName: \"kubernetes.io/projected/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-kube-api-access-4znhs\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961442 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961432    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961611 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961474    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961611 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961526    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961611 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961562    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961611 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961579    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961611 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961604    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961833 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961619    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961833 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961642    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961833 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961679    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961833 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961704    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961833 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961833 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961736    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-config\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961833 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961792    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.961833 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961831    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.962113 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961858    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.962113 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961883    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:23.962113 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.961942    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 19 04:15:23.978326 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:23.978302    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 04:15:24.062298 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062254    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062298 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062296    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062518 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062321    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4znhs\" (UniqueName: \"kubernetes.io/projected/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-kube-api-access-4znhs\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062518 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062504    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062620 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062542    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062620 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062576    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062727 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062623    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062727 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062639    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062727 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062676    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062727 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062703    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062958 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062741    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062958 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062801    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062958 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062828    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062958 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062856    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062958 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062883    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-config\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062958 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062908    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.062958 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062945    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.063307 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062968    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.063307 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.062992    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.063307 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.063049    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.063307 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.063057    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.063496 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.063346    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.063624 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.063598    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.064007 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.063978    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.064368 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.064346    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.065856 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.065829    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.066390 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.066364    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.066950 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.066522    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.066950 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.066912    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-web-config\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.067265 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.067235    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.067343 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.067259    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.067343 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.067280    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.067584 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.067563    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.067867 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.067844    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.068105 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.068084    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.069252 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.069221    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-config-out\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.069357 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.069313    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-config\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.069471 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.069449    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.069605 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.069584    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.071910 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.071889    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4znhs\" (UniqueName: \"kubernetes.io/projected/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-kube-api-access-4znhs\") pod \"prometheus-k8s-0\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.247655 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.247570    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:24.545523 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:24.545385    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 04:15:24.548204 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:15:24.548176    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3e6fc4_666b_4b0d_87e6_0fb1ef67776b.slice/crio-e19527bcd1b314e4b734cdf14b2583b83b3a2b9aea721c193a00beb5f5dcec9c WatchSource:0}: Error finding container e19527bcd1b314e4b734cdf14b2583b83b3a2b9aea721c193a00beb5f5dcec9c: Status 404 returned error can't find the container with id e19527bcd1b314e4b734cdf14b2583b83b3a2b9aea721c193a00beb5f5dcec9c
Sep 19 04:15:25.091515 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:25.091478    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerStarted","Data":"e19527bcd1b314e4b734cdf14b2583b83b3a2b9aea721c193a00beb5f5dcec9c"}
Sep 19 04:15:26.096970 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:26.096876    2569 generic.go:356] "Generic (PLEG): container finished" podID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerID="3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30" exitCode=0
Sep 19 04:15:26.097381 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:26.096963    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerDied","Data":"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"}
Sep 19 04:15:27.451565 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:27.451528    2569 patch_prober.go:28] interesting pod/image-registry-6dd6b64c5d-5fzq7 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 19 04:15:27.452040 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:27.451599    2569 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7" podUID="26ad0ea5-7db9-4dc8-b574-a1c12434ee5d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 04:15:29.010151 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:29.010121    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6dd6b64c5d-5fzq7"
Sep 19 04:15:29.307959 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:29.307929    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:29.448704 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:29.448662    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:30.116613 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:30.116572    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerStarted","Data":"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"}
Sep 19 04:15:30.117022 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:30.116677    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerStarted","Data":"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"}
Sep 19 04:15:32.129328 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:32.129290    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerStarted","Data":"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"}
Sep 19 04:15:32.129687 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:32.129373    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerStarted","Data":"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"}
Sep 19 04:15:32.129687 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:32.129426    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerStarted","Data":"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"}
Sep 19 04:15:32.129687 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:32.129468    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerStarted","Data":"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"}
Sep 19 04:15:32.169355 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:32.169288    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.028814951 podStartE2EDuration="9.169264265s" totalImagesPullingTime="6.12177577s" totalInitContainerRuntime="18.673544ms" isStatefulPod=false podCreationTimestamp="2026-09-19 04:15:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:32.16720343 +0000 UTC m=+112.145399861" watchObservedRunningTime="2026-09-19 04:15:32.169264265 +0000 UTC m=+112.147460656"
Sep 19 04:15:32.425401 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:32.425312    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:32.527492 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:32.527458    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:32.615370 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:32.615340    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:33.087368 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:33.087341    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kscs4"
Sep 19 04:15:33.279861 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:33.279827    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:33.381720 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:33.381687    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:34.245439 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:34.245396    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:34.248248 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:34.248229    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:15:34.340494 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:34.340453    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:34.461337 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:34.461285    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:34.669589 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:34.669553    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:34.769986 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:34.769954    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:34.871794 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:34.871743    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:35.234023 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:35.233987    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:35.305692 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:35.305663    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:35.694766 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:35.694730    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:36.047149 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:36.047075    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:36.554914 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:36.554879    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:36.671974 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:36.671934    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:36.982926 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:36.982888    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:37.083584 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:37.083553    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:42.870329 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:42.870296    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:42.961528 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:42.961497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:43.110960 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:43.110927    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:43.264710 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:43.264675    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:43.870638 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:43.870576    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:43.971979 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:43.971943    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:45.186822 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:45.186706    2569 generic.go:356] "Generic (PLEG): container finished" podID="1a634168-a302-4db0-9e10-0afd4756c0b0" containerID="294af0f6e26e0677c6f756c51a4ba93aa340983893020cd22e1891c12b7d6962" exitCode=0
Sep 19 04:15:45.186822 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:45.186737    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn" event={"ID":"1a634168-a302-4db0-9e10-0afd4756c0b0","Type":"ContainerDied","Data":"294af0f6e26e0677c6f756c51a4ba93aa340983893020cd22e1891c12b7d6962"}
Sep 19 04:15:45.187322 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:45.187124    2569 scope.go:117] "RemoveContainer" containerID="294af0f6e26e0677c6f756c51a4ba93aa340983893020cd22e1891c12b7d6962"
Sep 19 04:15:45.770022 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:45.769989    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:45.893874 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:45.893835    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:46.193253 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:46.193220    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57cdc4b768-hzwkn" event={"ID":"1a634168-a302-4db0-9e10-0afd4756c0b0","Type":"ContainerStarted","Data":"c9972460b70ca65ab562435cb38bab20ef8a995d8889d2e984beaaaf393fc1ae"}
Sep 19 04:15:49.559835 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:49.559808    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:49.686812 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:49.686778    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:50.399655 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:50.399622    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs\") pod \"network-metrics-daemon-twvwv\" (UID: \"8003fa5c-0817-4994-8405-7bc431ab1c36\") " pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:15:50.402186 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:50.402157    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8003fa5c-0817-4994-8405-7bc431ab1c36-metrics-certs\") pod \"network-metrics-daemon-twvwv\" (UID: \"8003fa5c-0817-4994-8405-7bc431ab1c36\") " pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:15:50.660233 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:50.660142    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zg2ns\""
Sep 19 04:15:50.667591 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:50.667551    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twvwv"
Sep 19 04:15:50.944505 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:50.944432    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-twvwv"]
Sep 19 04:15:50.947060 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:15:50.947031    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8003fa5c_0817_4994_8405_7bc431ab1c36.slice/crio-c49d353d0e895bffa8476f8901d4a5936937b8dc0424ca999708e3ab17d56306 WatchSource:0}: Error finding container c49d353d0e895bffa8476f8901d4a5936937b8dc0424ca999708e3ab17d56306: Status 404 returned error can't find the container with id c49d353d0e895bffa8476f8901d4a5936937b8dc0424ca999708e3ab17d56306
Sep 19 04:15:51.212863 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:51.212773    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-twvwv" event={"ID":"8003fa5c-0817-4994-8405-7bc431ab1c36","Type":"ContainerStarted","Data":"c49d353d0e895bffa8476f8901d4a5936937b8dc0424ca999708e3ab17d56306"}
Sep 19 04:15:51.896909 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:51.896848    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:52.025154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:52.025112    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:52.218058 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:52.218015    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-twvwv" event={"ID":"8003fa5c-0817-4994-8405-7bc431ab1c36","Type":"ContainerStarted","Data":"db39a1dcce26cb164a4f9f8f2cffb0ec8bb2c393861616aec6034fb97d35e5e7"}
Sep 19 04:15:52.218243 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:52.218085    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-twvwv" event={"ID":"8003fa5c-0817-4994-8405-7bc431ab1c36","Type":"ContainerStarted","Data":"3b6329cc33b4c3e836e9f740ea925bb1479420d315a3b213fab9397cc734f2c3"}
Sep 19 04:15:52.245526 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:52.245464    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-twvwv" podStartSLOduration=131.351148718 podStartE2EDuration="2m12.245442769s" totalImagesPullingTime="894.294051ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:52.242656389 +0000 UTC m=+132.220852777" watchObservedRunningTime="2026-09-19 04:15:52.245442769 +0000 UTC m=+132.223639161"
Sep 19 04:15:52.414057 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:52.414012    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:52.576394 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:52.576316    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:53.730126 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:53.730090    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:53.883870 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:53.883833    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:56.045230 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:56.045195    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-nz85f_56c0a386-20f4-4ad1-8b1e-9040d461cf1f/cluster-monitoring-operator/0.log"
Sep 19 04:15:56.064310 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:56.064278    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:56.141846 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:56.141813    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:15:56.234898 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:56.234868    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-wkbrh_91acc5d8-f9ae-46b4-849e-956c1b633b42/kube-state-metrics/0.log"
Sep 19 04:15:56.435736 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:56.435708    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-wkbrh_91acc5d8-f9ae-46b4-849e-956c1b633b42/kube-rbac-proxy-main/0.log"
Sep 19 04:15:56.634885 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:56.634855    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-wkbrh_91acc5d8-f9ae-46b4-849e-956c1b633b42/kube-rbac-proxy-self/0.log"
Sep 19 04:15:57.238764 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:57.238725    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8x6mv_ef666e8f-6ef2-46ed-b997-3724db846512/init-textfile/0.log"
Sep 19 04:15:57.444406 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:57.444376    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8x6mv_ef666e8f-6ef2-46ed-b997-3724db846512/node-exporter/0.log"
Sep 19 04:15:57.637050 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:57.637026    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8x6mv_ef666e8f-6ef2-46ed-b997-3724db846512/kube-rbac-proxy/0.log"
Sep 19 04:15:59.035287 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:59.035251    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-9rxxp_5af773fa-b943-4f5a-9c14-ba0bf6e8aa07/kube-rbac-proxy-main/0.log"
Sep 19 04:15:59.238889 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:59.238862    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-9rxxp_5af773fa-b943-4f5a-9c14-ba0bf6e8aa07/kube-rbac-proxy-self/0.log"
Sep 19 04:15:59.438926 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:59.438897    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-9rxxp_5af773fa-b943-4f5a-9c14-ba0bf6e8aa07/openshift-state-metrics/0.log"
Sep 19 04:15:59.635158 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:59.635132    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b/init-config-reloader/0.log"
Sep 19 04:15:59.836728 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:15:59.836651    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b/prometheus/0.log"
Sep 19 04:16:00.039929 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:00.039898    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b/config-reloader/0.log"
Sep 19 04:16:00.235619 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:00.235590    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b/thanos-sidecar/0.log"
Sep 19 04:16:00.437539 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:00.437512    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b/kube-rbac-proxy-web/0.log"
Sep 19 04:16:00.635327 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:00.635305    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b/kube-rbac-proxy/0.log"
Sep 19 04:16:00.843815 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:00.843786    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b/kube-rbac-proxy-thanos/0.log"
Sep 19 04:16:00.939182 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:00.939103    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:01.434279 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:01.434247    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-hqfrk_91e0a3bc-8cf2-450f-8ee6-6ec648efec4b/prometheus-operator-admission-webhook/0.log"
Sep 19 04:16:05.126591 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:05.126514    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:05.270430 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:05.270397    2569 generic.go:356] "Generic (PLEG): container finished" podID="4e30d573-f91e-4e5e-89ac-0314996c20a7" containerID="532594a2868405e1560ac0a18927c57e057165fc125cc07badbf35cbbf4fb4a8" exitCode=0
Sep 19 04:16:05.270590 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:05.270464    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf" event={"ID":"4e30d573-f91e-4e5e-89ac-0314996c20a7","Type":"ContainerDied","Data":"532594a2868405e1560ac0a18927c57e057165fc125cc07badbf35cbbf4fb4a8"}
Sep 19 04:16:05.270818 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:05.270804    2569 scope.go:117] "RemoveContainer" containerID="532594a2868405e1560ac0a18927c57e057165fc125cc07badbf35cbbf4fb4a8"
Sep 19 04:16:05.280782 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:05.280732    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:05.885341 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:05.885304    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:05.989113 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:05.989084    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:06.278207 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:06.278128    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-flldf" event={"ID":"4e30d573-f91e-4e5e-89ac-0314996c20a7","Type":"ContainerStarted","Data":"9da87d586785f21bb00090cfddcd95642b34b1c089a78aa3a73ec9f656972495"}
Sep 19 04:16:06.921589 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:06.921556    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:07.012742 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:07.012712    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:07.339791 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:07.339667    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:07.451699 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:07.451628    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:22.005778 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:22.005701    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:22.129086 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:22.129051    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:24.248834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:24.248791    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:24.269558 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:24.269530    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:24.377847 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:24.377819    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:33.881535 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:33.881442    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:34.183525 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:34.183428    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:34.449656 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:34.449557    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:34.600530 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:34.600483    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:42.881727 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:42.881697    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 04:16:42.882269 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:42.882008    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="prometheus" containerID="cri-o://32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d" gracePeriod=600
Sep 19 04:16:42.882269 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:42.882061    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="thanos-sidecar" containerID="cri-o://8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312" gracePeriod=600
Sep 19 04:16:42.882269 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:42.882079    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6" gracePeriod=600
Sep 19 04:16:42.882269 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:42.882088    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="config-reloader" containerID="cri-o://1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d" gracePeriod=600
Sep 19 04:16:42.882269 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:42.882105    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="kube-rbac-proxy-web" containerID="cri-o://8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920" gracePeriod=600
Sep 19 04:16:42.882269 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:42.882047    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="kube-rbac-proxy" containerID="cri-o://cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973" gracePeriod=600
Sep 19 04:16:43.131356 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.131328    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.248995 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.248911    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-tls-assets\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.248995 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.248959    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-config-out\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249209 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.248996    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-tls\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249209 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249021    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4znhs\" (UniqueName: \"kubernetes.io/projected/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-kube-api-access-4znhs\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249209 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249046    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-grpc-tls\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249209 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249066    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-config\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249209 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249093    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-2\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249209 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249117    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-1\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249209 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249150    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-metrics-client-certs\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249209 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249175    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-trusted-ca-bundle\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249209 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249209    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-kubelet-serving-ca-bundle\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249647 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249242    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-0\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249647 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249267    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-thanos-prometheus-http-client-file\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249647 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249305    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249647 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249354    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-kube-rbac-proxy\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249647 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249403    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-db\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249647 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249428    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-metrics-client-ca\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249647 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249454    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-serving-certs-ca-bundle\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249647 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249489    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.249647 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.249523    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-web-config\") pod \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\" (UID: \"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b\") "
Sep 19 04:16:43.251381 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.251342    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:16:43.251835 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.251802    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:16:43.251835 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.251823    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:16:43.252263 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.252236    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:43.252405 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.252374    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:16:43.252475 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.252450    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-config-out" (OuterVolumeSpecName: "config-out") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:16:43.253109 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.253086    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:16:43.253296 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.253277    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:43.253504 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.253487    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-config" (OuterVolumeSpecName: "config") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:43.253619 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.253523    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:16:43.253697 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.253666    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-kube-api-access-4znhs" (OuterVolumeSpecName: "kube-api-access-4znhs") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "kube-api-access-4znhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:16:43.253817 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.253696    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:16:43.253910 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.253718    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:16:43.253993 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.253811    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:43.254080 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.253993    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:43.254171 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.254096    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:16:43.254636 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.254604    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:43.255385 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.255355    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:43.255522 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.255507    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:43.265029 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.265002    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-web-config" (OuterVolumeSpecName: "web-config") pod "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" (UID: "2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:43.350496 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350459    2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-grpc-tls\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350496 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350490    2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-config\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350496 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350503    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350516    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350530    2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-metrics-client-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350541    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350585    2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350598    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350609    2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350629    2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350642    2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-kube-rbac-proxy\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350654    2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-prometheus-k8s-db\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350665    2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-metrics-client-ca\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350676    2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350688    2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350700    2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-web-config\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350712    2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-tls-assets\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350724    2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-config-out\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350736    2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.350834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.350765    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4znhs\" (UniqueName: \"kubernetes.io/projected/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b-kube-api-access-4znhs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:16:43.439633 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439596    2569 generic.go:356] "Generic (PLEG): container finished" podID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerID="cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6" exitCode=0
Sep 19 04:16:43.439633 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439622    2569 generic.go:356] "Generic (PLEG): container finished" podID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerID="cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973" exitCode=0
Sep 19 04:16:43.439633 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439628    2569 generic.go:356] "Generic (PLEG): container finished" podID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerID="8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920" exitCode=0
Sep 19 04:16:43.439633 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439634    2569 generic.go:356] "Generic (PLEG): container finished" podID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerID="8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312" exitCode=0
Sep 19 04:16:43.439633 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439639    2569 generic.go:356] "Generic (PLEG): container finished" podID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerID="1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d" exitCode=0
Sep 19 04:16:43.439633 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439643    2569 generic.go:356] "Generic (PLEG): container finished" podID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerID="32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d" exitCode=0
Sep 19 04:16:43.440229 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439683    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerDied","Data":"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"}
Sep 19 04:16:43.440229 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439694    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.440229 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439807    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerDied","Data":"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"}
Sep 19 04:16:43.440229 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439836    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerDied","Data":"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"}
Sep 19 04:16:43.440229 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439859    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerDied","Data":"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"}
Sep 19 04:16:43.440229 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439871    2569 scope.go:117] "RemoveContainer" containerID="cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"
Sep 19 04:16:43.440229 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439885    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerDied","Data":"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"}
Sep 19 04:16:43.440229 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439910    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerDied","Data":"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"}
Sep 19 04:16:43.440229 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.439931    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b","Type":"ContainerDied","Data":"e19527bcd1b314e4b734cdf14b2583b83b3a2b9aea721c193a00beb5f5dcec9c"}
Sep 19 04:16:43.449155 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.449142    2569 scope.go:117] "RemoveContainer" containerID="cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"
Sep 19 04:16:43.456191 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.456175    2569 scope.go:117] "RemoveContainer" containerID="8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"
Sep 19 04:16:43.463045 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.463027    2569 scope.go:117] "RemoveContainer" containerID="8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"
Sep 19 04:16:43.470162 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.470113    2569 scope.go:117] "RemoveContainer" containerID="1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"
Sep 19 04:16:43.472109 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.472088    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 04:16:43.478108 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.478088    2569 scope.go:117] "RemoveContainer" containerID="32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"
Sep 19 04:16:43.480576 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.480558    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 04:16:43.485465 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.485449    2569 scope.go:117] "RemoveContainer" containerID="3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"
Sep 19 04:16:43.492500 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.492482    2569 scope.go:117] "RemoveContainer" containerID="cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"
Sep 19 04:16:43.492794 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:16:43.492772    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6\": container with ID starting with cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6 not found: ID does not exist" containerID="cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"
Sep 19 04:16:43.492856 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.492803    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"} err="failed to get container status \"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6\": rpc error: code = NotFound desc = could not find container \"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6\": container with ID starting with cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6 not found: ID does not exist"
Sep 19 04:16:43.492894 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.492860    2569 scope.go:117] "RemoveContainer" containerID="cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"
Sep 19 04:16:43.493114 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:16:43.493096    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973\": container with ID starting with cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973 not found: ID does not exist" containerID="cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"
Sep 19 04:16:43.493157 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.493120    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"} err="failed to get container status \"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973\": rpc error: code = NotFound desc = could not find container \"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973\": container with ID starting with cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973 not found: ID does not exist"
Sep 19 04:16:43.493157 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.493140    2569 scope.go:117] "RemoveContainer" containerID="8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"
Sep 19 04:16:43.493386 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:16:43.493370    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920\": container with ID starting with 8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920 not found: ID does not exist" containerID="8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"
Sep 19 04:16:43.493421 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.493392    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"} err="failed to get container status \"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920\": rpc error: code = NotFound desc = could not find container \"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920\": container with ID starting with 8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920 not found: ID does not exist"
Sep 19 04:16:43.493421 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.493411    2569 scope.go:117] "RemoveContainer" containerID="8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"
Sep 19 04:16:43.493635 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:16:43.493622    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312\": container with ID starting with 8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312 not found: ID does not exist" containerID="8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"
Sep 19 04:16:43.493675 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.493639    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"} err="failed to get container status \"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312\": rpc error: code = NotFound desc = could not find container \"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312\": container with ID starting with 8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312 not found: ID does not exist"
Sep 19 04:16:43.493675 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.493655    2569 scope.go:117] "RemoveContainer" containerID="1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"
Sep 19 04:16:43.493905 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:16:43.493885    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d\": container with ID starting with 1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d not found: ID does not exist" containerID="1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"
Sep 19 04:16:43.493956 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.493914    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"} err="failed to get container status \"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d\": rpc error: code = NotFound desc = could not find container \"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d\": container with ID starting with 1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d not found: ID does not exist"
Sep 19 04:16:43.493956 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.493936    2569 scope.go:117] "RemoveContainer" containerID="32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"
Sep 19 04:16:43.494183 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:16:43.494168    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d\": container with ID starting with 32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d not found: ID does not exist" containerID="32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"
Sep 19 04:16:43.494226 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.494185    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"} err="failed to get container status \"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d\": rpc error: code = NotFound desc = could not find container \"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d\": container with ID starting with 32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d not found: ID does not exist"
Sep 19 04:16:43.494226 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.494203    2569 scope.go:117] "RemoveContainer" containerID="3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"
Sep 19 04:16:43.494450 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:16:43.494435    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30\": container with ID starting with 3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30 not found: ID does not exist" containerID="3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"
Sep 19 04:16:43.494502 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.494450    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"} err="failed to get container status \"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30\": rpc error: code = NotFound desc = could not find container \"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30\": container with ID starting with 3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30 not found: ID does not exist"
Sep 19 04:16:43.494502 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.494462    2569 scope.go:117] "RemoveContainer" containerID="cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"
Sep 19 04:16:43.494693 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.494676    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"} err="failed to get container status \"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6\": rpc error: code = NotFound desc = could not find container \"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6\": container with ID starting with cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6 not found: ID does not exist"
Sep 19 04:16:43.494739 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.494695    2569 scope.go:117] "RemoveContainer" containerID="cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"
Sep 19 04:16:43.494977 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.494957    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"} err="failed to get container status \"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973\": rpc error: code = NotFound desc = could not find container \"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973\": container with ID starting with cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973 not found: ID does not exist"
Sep 19 04:16:43.495024 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.494979    2569 scope.go:117] "RemoveContainer" containerID="8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"
Sep 19 04:16:43.495199 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.495184    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"} err="failed to get container status \"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920\": rpc error: code = NotFound desc = could not find container \"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920\": container with ID starting with 8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920 not found: ID does not exist"
Sep 19 04:16:43.495239 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.495199    2569 scope.go:117] "RemoveContainer" containerID="8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"
Sep 19 04:16:43.495403 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.495387    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"} err="failed to get container status \"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312\": rpc error: code = NotFound desc = could not find container \"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312\": container with ID starting with 8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312 not found: ID does not exist"
Sep 19 04:16:43.495440 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.495404    2569 scope.go:117] "RemoveContainer" containerID="1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"
Sep 19 04:16:43.495623 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.495603    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"} err="failed to get container status \"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d\": rpc error: code = NotFound desc = could not find container \"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d\": container with ID starting with 1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d not found: ID does not exist"
Sep 19 04:16:43.495668 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.495623    2569 scope.go:117] "RemoveContainer" containerID="32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"
Sep 19 04:16:43.495861 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.495846    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"} err="failed to get container status \"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d\": rpc error: code = NotFound desc = could not find container \"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d\": container with ID starting with 32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d not found: ID does not exist"
Sep 19 04:16:43.495908 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.495861    2569 scope.go:117] "RemoveContainer" containerID="3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"
Sep 19 04:16:43.496083 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.496066    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"} err="failed to get container status \"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30\": rpc error: code = NotFound desc = could not find container \"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30\": container with ID starting with 3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30 not found: ID does not exist"
Sep 19 04:16:43.496123 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.496083    2569 scope.go:117] "RemoveContainer" containerID="cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"
Sep 19 04:16:43.496288 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.496270    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"} err="failed to get container status \"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6\": rpc error: code = NotFound desc = could not find container \"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6\": container with ID starting with cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6 not found: ID does not exist"
Sep 19 04:16:43.496383 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.496288    2569 scope.go:117] "RemoveContainer" containerID="cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"
Sep 19 04:16:43.496542 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.496521    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"} err="failed to get container status \"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973\": rpc error: code = NotFound desc = could not find container \"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973\": container with ID starting with cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973 not found: ID does not exist"
Sep 19 04:16:43.496589 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.496542    2569 scope.go:117] "RemoveContainer" containerID="8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"
Sep 19 04:16:43.496764 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.496730    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"} err="failed to get container status \"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920\": rpc error: code = NotFound desc = could not find container \"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920\": container with ID starting with 8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920 not found: ID does not exist"
Sep 19 04:16:43.496809 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.496763    2569 scope.go:117] "RemoveContainer" containerID="8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"
Sep 19 04:16:43.496996 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.496972    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"} err="failed to get container status \"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312\": rpc error: code = NotFound desc = could not find container \"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312\": container with ID starting with 8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312 not found: ID does not exist"
Sep 19 04:16:43.497038 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.497000    2569 scope.go:117] "RemoveContainer" containerID="1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"
Sep 19 04:16:43.497224 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.497208    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"} err="failed to get container status \"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d\": rpc error: code = NotFound desc = could not find container \"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d\": container with ID starting with 1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d not found: ID does not exist"
Sep 19 04:16:43.497262 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.497225    2569 scope.go:117] "RemoveContainer" containerID="32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"
Sep 19 04:16:43.497451 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.497435    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"} err="failed to get container status \"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d\": rpc error: code = NotFound desc = could not find container \"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d\": container with ID starting with 32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d not found: ID does not exist"
Sep 19 04:16:43.497451 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.497449    2569 scope.go:117] "RemoveContainer" containerID="3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"
Sep 19 04:16:43.497649 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.497632    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"} err="failed to get container status \"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30\": rpc error: code = NotFound desc = could not find container \"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30\": container with ID starting with 3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30 not found: ID does not exist"
Sep 19 04:16:43.497689 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.497650    2569 scope.go:117] "RemoveContainer" containerID="cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"
Sep 19 04:16:43.497876 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.497861    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"} err="failed to get container status \"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6\": rpc error: code = NotFound desc = could not find container \"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6\": container with ID starting with cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6 not found: ID does not exist"
Sep 19 04:16:43.497924 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.497876    2569 scope.go:117] "RemoveContainer" containerID="cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"
Sep 19 04:16:43.498082 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.498063    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"} err="failed to get container status \"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973\": rpc error: code = NotFound desc = could not find container \"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973\": container with ID starting with cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973 not found: ID does not exist"
Sep 19 04:16:43.498129 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.498084    2569 scope.go:117] "RemoveContainer" containerID="8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"
Sep 19 04:16:43.498313 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.498295    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"} err="failed to get container status \"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920\": rpc error: code = NotFound desc = could not find container \"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920\": container with ID starting with 8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920 not found: ID does not exist"
Sep 19 04:16:43.498365 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.498313    2569 scope.go:117] "RemoveContainer" containerID="8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"
Sep 19 04:16:43.498519 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.498498    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"} err="failed to get container status \"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312\": rpc error: code = NotFound desc = could not find container \"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312\": container with ID starting with 8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312 not found: ID does not exist"
Sep 19 04:16:43.498559 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.498521    2569 scope.go:117] "RemoveContainer" containerID="1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"
Sep 19 04:16:43.498733 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.498714    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"} err="failed to get container status \"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d\": rpc error: code = NotFound desc = could not find container \"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d\": container with ID starting with 1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d not found: ID does not exist"
Sep 19 04:16:43.498832 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.498734    2569 scope.go:117] "RemoveContainer" containerID="32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"
Sep 19 04:16:43.498982 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.498966    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"} err="failed to get container status \"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d\": rpc error: code = NotFound desc = could not find container \"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d\": container with ID starting with 32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d not found: ID does not exist"
Sep 19 04:16:43.499049 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.498982    2569 scope.go:117] "RemoveContainer" containerID="3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"
Sep 19 04:16:43.499182 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.499162    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"} err="failed to get container status \"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30\": rpc error: code = NotFound desc = could not find container \"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30\": container with ID starting with 3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30 not found: ID does not exist"
Sep 19 04:16:43.499258 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.499184    2569 scope.go:117] "RemoveContainer" containerID="cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"
Sep 19 04:16:43.499382 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.499367    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"} err="failed to get container status \"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6\": rpc error: code = NotFound desc = could not find container \"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6\": container with ID starting with cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6 not found: ID does not exist"
Sep 19 04:16:43.499422 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.499383    2569 scope.go:117] "RemoveContainer" containerID="cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"
Sep 19 04:16:43.499598 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.499580    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"} err="failed to get container status \"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973\": rpc error: code = NotFound desc = could not find container \"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973\": container with ID starting with cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973 not found: ID does not exist"
Sep 19 04:16:43.499650 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.499598    2569 scope.go:117] "RemoveContainer" containerID="8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"
Sep 19 04:16:43.499820 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.499804    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"} err="failed to get container status \"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920\": rpc error: code = NotFound desc = could not find container \"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920\": container with ID starting with 8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920 not found: ID does not exist"
Sep 19 04:16:43.499859 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.499822    2569 scope.go:117] "RemoveContainer" containerID="8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"
Sep 19 04:16:43.500051 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.500036    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"} err="failed to get container status \"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312\": rpc error: code = NotFound desc = could not find container \"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312\": container with ID starting with 8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312 not found: ID does not exist"
Sep 19 04:16:43.500092 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.500050    2569 scope.go:117] "RemoveContainer" containerID="1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"
Sep 19 04:16:43.500273 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.500256    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"} err="failed to get container status \"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d\": rpc error: code = NotFound desc = could not find container \"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d\": container with ID starting with 1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d not found: ID does not exist"
Sep 19 04:16:43.500323 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.500273    2569 scope.go:117] "RemoveContainer" containerID="32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"
Sep 19 04:16:43.500469 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.500455    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"} err="failed to get container status \"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d\": rpc error: code = NotFound desc = could not find container \"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d\": container with ID starting with 32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d not found: ID does not exist"
Sep 19 04:16:43.500566 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.500470    2569 scope.go:117] "RemoveContainer" containerID="3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"
Sep 19 04:16:43.500712 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.500695    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"} err="failed to get container status \"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30\": rpc error: code = NotFound desc = could not find container \"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30\": container with ID starting with 3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30 not found: ID does not exist"
Sep 19 04:16:43.500774 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.500711    2569 scope.go:117] "RemoveContainer" containerID="cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"
Sep 19 04:16:43.500965 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.500948    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6"} err="failed to get container status \"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6\": rpc error: code = NotFound desc = could not find container \"cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6\": container with ID starting with cc35df06a5d23036add6c6ba31397cf4bf6801770d5e32b0a89e8f85cfb0bcd6 not found: ID does not exist"
Sep 19 04:16:43.501007 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.500967    2569 scope.go:117] "RemoveContainer" containerID="cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"
Sep 19 04:16:43.501196 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.501179    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973"} err="failed to get container status \"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973\": rpc error: code = NotFound desc = could not find container \"cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973\": container with ID starting with cacac876cc930a0901e28121cf92c0ea444020e2b11c9c0d40ea8ba8b464a973 not found: ID does not exist"
Sep 19 04:16:43.501240 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.501196    2569 scope.go:117] "RemoveContainer" containerID="8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"
Sep 19 04:16:43.501419 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.501405    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920"} err="failed to get container status \"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920\": rpc error: code = NotFound desc = could not find container \"8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920\": container with ID starting with 8902b421efe003f77eef6e22dd1671adc3e0f9c4f284cc31cd6234ed81bdb920 not found: ID does not exist"
Sep 19 04:16:43.501464 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.501419    2569 scope.go:117] "RemoveContainer" containerID="8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"
Sep 19 04:16:43.501645 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.501629    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312"} err="failed to get container status \"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312\": rpc error: code = NotFound desc = could not find container \"8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312\": container with ID starting with 8dd83f7c728de67ebf02959f67e967fbf04c66d8808f56c78b0c1c397c0dd312 not found: ID does not exist"
Sep 19 04:16:43.501687 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.501645    2569 scope.go:117] "RemoveContainer" containerID="1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"
Sep 19 04:16:43.501909 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.501891    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d"} err="failed to get container status \"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d\": rpc error: code = NotFound desc = could not find container \"1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d\": container with ID starting with 1d32fe7942047ba709bfce26586cb102aa071931614b015309328d0d4ee3a23d not found: ID does not exist"
Sep 19 04:16:43.501958 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.501912    2569 scope.go:117] "RemoveContainer" containerID="32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"
Sep 19 04:16:43.502145 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.502129    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d"} err="failed to get container status \"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d\": rpc error: code = NotFound desc = could not find container \"32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d\": container with ID starting with 32ef603a2218de45b1dc6a36048871a8eed5e77131b03ecc78fffbb131259e6d not found: ID does not exist"
Sep 19 04:16:43.502186 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.502146    2569 scope.go:117] "RemoveContainer" containerID="3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"
Sep 19 04:16:43.502366 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.502351    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30"} err="failed to get container status \"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30\": rpc error: code = NotFound desc = could not find container \"3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30\": container with ID starting with 3995467eb3aca2043d0810a71fc3d53d4dde474019210772efbed60ef395ad30 not found: ID does not exist"
Sep 19 04:16:43.536018 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.535987    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 04:16:43.536274 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536263    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="thanos-sidecar"
Sep 19 04:16:43.536315 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536275    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="thanos-sidecar"
Sep 19 04:16:43.536315 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536296    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="init-config-reloader"
Sep 19 04:16:43.536315 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536302    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="init-config-reloader"
Sep 19 04:16:43.536315 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536308    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="kube-rbac-proxy-thanos"
Sep 19 04:16:43.536315 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536315    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="kube-rbac-proxy-thanos"
Sep 19 04:16:43.536453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536323    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="kube-rbac-proxy-web"
Sep 19 04:16:43.536453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536328    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="kube-rbac-proxy-web"
Sep 19 04:16:43.536453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536333    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="kube-rbac-proxy"
Sep 19 04:16:43.536453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536338    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="kube-rbac-proxy"
Sep 19 04:16:43.536453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536343    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="prometheus"
Sep 19 04:16:43.536453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536348    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="prometheus"
Sep 19 04:16:43.536453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536353    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="config-reloader"
Sep 19 04:16:43.536453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536358    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="config-reloader"
Sep 19 04:16:43.536453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536401    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="kube-rbac-proxy"
Sep 19 04:16:43.536453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536410    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="prometheus"
Sep 19 04:16:43.536453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536417    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="config-reloader"
Sep 19 04:16:43.536453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536423    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="thanos-sidecar"
Sep 19 04:16:43.536453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536428    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="kube-rbac-proxy-web"
Sep 19 04:16:43.536453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.536435    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" containerName="kube-rbac-proxy-thanos"
Sep 19 04:16:43.541587 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.541571    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.551238 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.551211    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 19 04:16:43.551238 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.551237    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 19 04:16:43.551466 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.551261    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 19 04:16:43.551519 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.551493    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 19 04:16:43.551772 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.551738    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 19 04:16:43.551858 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.551787    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 19 04:16:43.551911 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.551894    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 19 04:16:43.551953 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.551914    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 19 04:16:43.552168 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.552155    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-32k0b9nu0v5ql\""
Sep 19 04:16:43.552212 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.552159    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 19 04:16:43.552212 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.552182    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 19 04:16:43.552434 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.552421    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 19 04:16:43.557214 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.557198    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 19 04:16:43.571438 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.571412    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 19 04:16:43.571743 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.571726    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 19 04:16:43.572843 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.572816    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 19 04:16:43.581891 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.581871    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-64fv4\""
Sep 19 04:16:43.652344 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652304    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/067a46b1-bcd6-4b8f-b676-c10a28c4102d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.652521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652351    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.652521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652390    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-web-config\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.652521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652425    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.652521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652447    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.652521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652470    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.652706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652520    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.652706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652550    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.652706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652576    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.652706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652592    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/067a46b1-bcd6-4b8f-b676-c10a28c4102d-config-out\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.652706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652612    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.652706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652639    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.652706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652680    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.652706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652707    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.653003 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652723    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.653003 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652740    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.653003 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652780    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thmpp\" (UniqueName: \"kubernetes.io/projected/067a46b1-bcd6-4b8f-b676-c10a28c4102d-kube-api-access-thmpp\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.653003 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652809    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-config\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.653003 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652836    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.653003 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.652852    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.686778 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.686731    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 04:16:43.754300 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754207    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754300 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754239    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754300 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754260    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754300 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754277    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754300 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754296    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754323    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754348    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/067a46b1-bcd6-4b8f-b676-c10a28c4102d-config-out\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754375    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754395    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754421    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754450    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754474    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754503    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754533    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thmpp\" (UniqueName: \"kubernetes.io/projected/067a46b1-bcd6-4b8f-b676-c10a28c4102d-kube-api-access-thmpp\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754566    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-config\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754594    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.754648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754631    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.755532 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754675    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/067a46b1-bcd6-4b8f-b676-c10a28c4102d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.755532 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754711    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.755532 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.754775    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-web-config\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.755532 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.755143    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.755532 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.755330    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.755532 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.755350    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.755914 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.755870    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.756679 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.756649    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.758848 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.757712    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.758848 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.758252    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.758848 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.758271    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.758848 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.758691    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.758848 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.758717    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-web-config\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.759403 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.759151    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.759403 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.759166    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.759403 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.759349    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/067a46b1-bcd6-4b8f-b676-c10a28c4102d-config-out\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.759617 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.759576    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.759662 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.759645    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/067a46b1-bcd6-4b8f-b676-c10a28c4102d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.759729 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.759709    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/067a46b1-bcd6-4b8f-b676-c10a28c4102d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.760799 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.760783    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.760914 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.760899    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-config\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.761179 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.761160    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/067a46b1-bcd6-4b8f-b676-c10a28c4102d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.766204 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.766187    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thmpp\" (UniqueName: \"kubernetes.io/projected/067a46b1-bcd6-4b8f-b676-c10a28c4102d-kube-api-access-thmpp\") pod \"prometheus-k8s-0\" (UID: \"067a46b1-bcd6-4b8f-b676-c10a28c4102d\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:43.850646 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:43.850599    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:44.147364 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:44.147334    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 19 04:16:44.149187 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:16:44.149161    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod067a46b1_bcd6_4b8f_b676_c10a28c4102d.slice/crio-2c1ec903921b8968cec2091b9b8e60ec37cfbc7863e5c57159f58d93805d1048 WatchSource:0}: Error finding container 2c1ec903921b8968cec2091b9b8e60ec37cfbc7863e5c57159f58d93805d1048: Status 404 returned error can't find the container with id 2c1ec903921b8968cec2091b9b8e60ec37cfbc7863e5c57159f58d93805d1048
Sep 19 04:16:44.452449 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:44.452360    2569 generic.go:356] "Generic (PLEG): container finished" podID="067a46b1-bcd6-4b8f-b676-c10a28c4102d" containerID="7f39c2c72243438adb16a227b4aadb0ce3172e10f3459ab4f61484c9df9b9574" exitCode=0
Sep 19 04:16:44.452449 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:44.452436    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"067a46b1-bcd6-4b8f-b676-c10a28c4102d","Type":"ContainerDied","Data":"7f39c2c72243438adb16a227b4aadb0ce3172e10f3459ab4f61484c9df9b9574"}
Sep 19 04:16:44.452625 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:44.452514    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"067a46b1-bcd6-4b8f-b676-c10a28c4102d","Type":"ContainerStarted","Data":"2c1ec903921b8968cec2091b9b8e60ec37cfbc7863e5c57159f58d93805d1048"}
Sep 19 04:16:44.542240 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:44.542207    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b" path="/var/lib/kubelet/pods/2b3e6fc4-666b-4b0d-87e6-0fb1ef67776b/volumes"
Sep 19 04:16:44.604037 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:44.604003    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:44.768844 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:44.768822    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:45.459188 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:45.459152    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"067a46b1-bcd6-4b8f-b676-c10a28c4102d","Type":"ContainerStarted","Data":"d974d65632223ec2908c4c1ef988e86526d96c38a611838414d8cf047af144b0"}
Sep 19 04:16:45.459574 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:45.459216    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"067a46b1-bcd6-4b8f-b676-c10a28c4102d","Type":"ContainerStarted","Data":"de8729b0641c4b078e56d695076036005c6e4c055893059ea47ecf35cd3cab0c"}
Sep 19 04:16:45.459574 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:45.459245    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"067a46b1-bcd6-4b8f-b676-c10a28c4102d","Type":"ContainerStarted","Data":"cddba6340d3a42dd873e7c310b7bdd1860e562ea85dbfb1127844f71858ba4b0"}
Sep 19 04:16:45.459574 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:45.459270    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"067a46b1-bcd6-4b8f-b676-c10a28c4102d","Type":"ContainerStarted","Data":"8135e35ecac5f85e58f84b00f38daf4e171106c8abedfd4824cf51ae039632a3"}
Sep 19 04:16:45.459574 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:45.459299    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"067a46b1-bcd6-4b8f-b676-c10a28c4102d","Type":"ContainerStarted","Data":"5c7f8bf03b52e2453b5221398ec09acaba67abd95335f2eeb512e3b250db00e2"}
Sep 19 04:16:45.459574 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:45.459321    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"067a46b1-bcd6-4b8f-b676-c10a28c4102d","Type":"ContainerStarted","Data":"1263fd7afa3b65f29a0206476c341e0331c7526d03aee2d6a4c55874f4f3de33"}
Sep 19 04:16:45.495647 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:45.495617    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:45.525438 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:45.525388    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5062357520000003 podStartE2EDuration="2.525358999s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.123247ms" isStatefulPod=false podCreationTimestamp="2026-09-19 04:16:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:16:45.524798672 +0000 UTC m=+185.502995066" watchObservedRunningTime="2026-09-19 04:16:45.525358999 +0000 UTC m=+185.503555390"
Sep 19 04:16:45.689316 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:45.689284    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:48.216665 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:48.216627    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:48.315610 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:48.315579    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:48.851671 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:48.851619    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:16:51.884132 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:51.884096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:16:51.980786 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:16:51.980738    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:17:24.585575 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:17:24.585542    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:17:25.064705 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:17:25.064674    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:17:25.285305 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:17:25.285267    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:17:43.851333 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:17:43.851280    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:17:43.867963 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:17:43.867927    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:17:44.717153 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:17:44.717120    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 19 04:17:53.183949 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:17:53.183913    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:17:53.368636 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:17:53.368602    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:17:53.499364 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:17:53.499270    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:17:55.188298 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:17:55.188266    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:17:55.292500 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:17:55.292463    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:17:56.648401 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:17:56.648366    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:17:59.871444 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:17:59.871410    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:17:59.972523 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:17:59.972484    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:01.198964 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:01.198924    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:01.384946 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:01.384915    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:01.606738 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:01.606705    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:01.828370 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:01.828259    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:04.589768 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:04.589729    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:15.163785 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:15.163727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:15.259301 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:15.259262    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:16.556618 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:16.556586    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-89jnp"]
Sep 19 04:18:16.559612 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:16.559595    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-89jnp"
Sep 19 04:18:16.566600 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:16.566579    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-g4rmb\""
Sep 19 04:18:16.567505 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:16.567475    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Sep 19 04:18:16.569532 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:16.569516    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Sep 19 04:18:16.637136 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:16.637100    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48b71620-d109-47a5-bc24-a1d6fcded750-tmp\") pod \"jobset-operator-56d489b4b8-89jnp\" (UID: \"48b71620-d109-47a5-bc24-a1d6fcded750\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-89jnp"
Sep 19 04:18:16.637334 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:16.637236    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qm7d\" (UniqueName: \"kubernetes.io/projected/48b71620-d109-47a5-bc24-a1d6fcded750-kube-api-access-7qm7d\") pod \"jobset-operator-56d489b4b8-89jnp\" (UID: \"48b71620-d109-47a5-bc24-a1d6fcded750\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-89jnp"
Sep 19 04:18:16.639342 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:16.639306    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-89jnp"]
Sep 19 04:18:16.737839 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:16.737801    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qm7d\" (UniqueName: \"kubernetes.io/projected/48b71620-d109-47a5-bc24-a1d6fcded750-kube-api-access-7qm7d\") pod \"jobset-operator-56d489b4b8-89jnp\" (UID: \"48b71620-d109-47a5-bc24-a1d6fcded750\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-89jnp"
Sep 19 04:18:16.738080 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:16.738050    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48b71620-d109-47a5-bc24-a1d6fcded750-tmp\") pod \"jobset-operator-56d489b4b8-89jnp\" (UID: \"48b71620-d109-47a5-bc24-a1d6fcded750\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-89jnp"
Sep 19 04:18:16.738448 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:16.738430    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48b71620-d109-47a5-bc24-a1d6fcded750-tmp\") pod \"jobset-operator-56d489b4b8-89jnp\" (UID: \"48b71620-d109-47a5-bc24-a1d6fcded750\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-89jnp"
Sep 19 04:18:16.758208 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:16.758174    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qm7d\" (UniqueName: \"kubernetes.io/projected/48b71620-d109-47a5-bc24-a1d6fcded750-kube-api-access-7qm7d\") pod \"jobset-operator-56d489b4b8-89jnp\" (UID: \"48b71620-d109-47a5-bc24-a1d6fcded750\") " pod="openshift-jobset-operator/jobset-operator-56d489b4b8-89jnp"
Sep 19 04:18:16.869143 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:16.869048    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-89jnp"
Sep 19 04:18:17.160500 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:17.160465    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-56d489b4b8-89jnp"]
Sep 19 04:18:17.163510 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:18:17.163482    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48b71620_d109_47a5_bc24_a1d6fcded750.slice/crio-78ce63d06eb8d1520b19094a77ca7a58584e18e8f48ea155057c662ca223dc1a WatchSource:0}: Error finding container 78ce63d06eb8d1520b19094a77ca7a58584e18e8f48ea155057c662ca223dc1a: Status 404 returned error can't find the container with id 78ce63d06eb8d1520b19094a77ca7a58584e18e8f48ea155057c662ca223dc1a
Sep 19 04:18:17.832014 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:17.831984    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-89jnp" event={"ID":"48b71620-d109-47a5-bc24-a1d6fcded750","Type":"ContainerStarted","Data":"78ce63d06eb8d1520b19094a77ca7a58584e18e8f48ea155057c662ca223dc1a"}
Sep 19 04:18:19.842799 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:19.842769    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-89jnp" event={"ID":"48b71620-d109-47a5-bc24-a1d6fcded750","Type":"ContainerStarted","Data":"2abe1b193b05747d6d768a250c9ea7f6e49c32d8e49ed65d8fbcd4d693e39125"}
Sep 19 04:18:19.868878 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:19.868816    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-56d489b4b8-89jnp" podStartSLOduration=1.293489249 podStartE2EDuration="3.868793936s" totalImagesPullingTime="2.575304687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:18:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:18:19.865918062 +0000 UTC m=+279.844114471" watchObservedRunningTime="2026-09-19 04:18:19.868793936 +0000 UTC m=+279.846990327"
Sep 19 04:18:21.708479 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:21.708445    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:21.807063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:21.807029    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:23.094229 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.094192    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:23.236405 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.236374    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"]
Sep 19 04:18:23.239891 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.239876    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.243429 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.243393    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Sep 19 04:18:23.243429 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.243422    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-6cqv5\""
Sep 19 04:18:23.243610 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.243568    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Sep 19 04:18:23.244220 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.244204    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 19 04:18:23.244220 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.244209    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 19 04:18:23.244391 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.244243    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Sep 19 04:18:23.267317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.267291    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"]
Sep 19 04:18:23.288166 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.288130    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3164a1ad-65fd-4997-8f7b-a70905ece297-webhook-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.288388 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.288271    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3164a1ad-65fd-4997-8f7b-a70905ece297-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.288388 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.288310    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3164a1ad-65fd-4997-8f7b-a70905ece297-manifests\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.288388 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.288364    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnh2v\" (UniqueName: \"kubernetes.io/projected/3164a1ad-65fd-4997-8f7b-a70905ece297-kube-api-access-lnh2v\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.288566 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.288419    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3164a1ad-65fd-4997-8f7b-a70905ece297-tmp\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.288566 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.288451    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3164a1ad-65fd-4997-8f7b-a70905ece297-metrics-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.389630 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.389600    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3164a1ad-65fd-4997-8f7b-a70905ece297-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.389840 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.389639    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3164a1ad-65fd-4997-8f7b-a70905ece297-manifests\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.389840 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.389682    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnh2v\" (UniqueName: \"kubernetes.io/projected/3164a1ad-65fd-4997-8f7b-a70905ece297-kube-api-access-lnh2v\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.389840 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.389724    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3164a1ad-65fd-4997-8f7b-a70905ece297-tmp\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.389840 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.389795    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3164a1ad-65fd-4997-8f7b-a70905ece297-metrics-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.389840 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.389818    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3164a1ad-65fd-4997-8f7b-a70905ece297-webhook-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.390165 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.390140    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3164a1ad-65fd-4997-8f7b-a70905ece297-manifests\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.392233 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.392210    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3164a1ad-65fd-4997-8f7b-a70905ece297-tmp\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.392447 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.392428    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3164a1ad-65fd-4997-8f7b-a70905ece297-webhook-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.392822 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.392806    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3164a1ad-65fd-4997-8f7b-a70905ece297-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.392955 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.392936    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3164a1ad-65fd-4997-8f7b-a70905ece297-metrics-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.400952 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.400925    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:23.404099 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.404074    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnh2v\" (UniqueName: \"kubernetes.io/projected/3164a1ad-65fd-4997-8f7b-a70905ece297-kube-api-access-lnh2v\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jntql\" (UID: \"3164a1ad-65fd-4997-8f7b-a70905ece297\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.515821 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.515780    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:23.549947 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.549909    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:23.655381 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.655299    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:23.753648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.753616    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:23.846382 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.846330    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"]
Sep 19 04:18:23.848574 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:18:23.848553    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3164a1ad_65fd_4997_8f7b_a70905ece297.slice/crio-0adaf1c710999e1766fa1d4ee6cfc6658235bbc533b0753397c006ca6dc05e70 WatchSource:0}: Error finding container 0adaf1c710999e1766fa1d4ee6cfc6658235bbc533b0753397c006ca6dc05e70: Status 404 returned error can't find the container with id 0adaf1c710999e1766fa1d4ee6cfc6658235bbc533b0753397c006ca6dc05e70
Sep 19 04:18:23.862667 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.862640    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql" event={"ID":"3164a1ad-65fd-4997-8f7b-a70905ece297","Type":"ContainerStarted","Data":"0adaf1c710999e1766fa1d4ee6cfc6658235bbc533b0753397c006ca6dc05e70"}
Sep 19 04:18:23.866088 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:23.866057    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:25.685432 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:25.685393    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:27.884924 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:27.884891    2569 generic.go:356] "Generic (PLEG): container finished" podID="3164a1ad-65fd-4997-8f7b-a70905ece297" containerID="2fbadd9cff3c3e508e861604d3056b8f31f3f1e793396786fd18a90e3310cd79" exitCode=0
Sep 19 04:18:27.885414 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:27.884956    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql" event={"ID":"3164a1ad-65fd-4997-8f7b-a70905ece297","Type":"ContainerDied","Data":"2fbadd9cff3c3e508e861604d3056b8f31f3f1e793396786fd18a90e3310cd79"}
Sep 19 04:18:28.862669 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:28.862637    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:28.891969 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:28.891938    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql" event={"ID":"3164a1ad-65fd-4997-8f7b-a70905ece297","Type":"ContainerStarted","Data":"0f0b5b120a738fcef4daf7d14ef69715c46bf441e629a242be7f7b85747bfeed"}
Sep 19 04:18:28.892347 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:28.892043    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:28.954767 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:28.954707    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql" podStartSLOduration=2.01572385 podStartE2EDuration="5.954690436s" totalImagesPullingTime="3.524153472s" totalInitContainerRuntime="414.813114ms" isStatefulPod=false podCreationTimestamp="2026-09-19 04:18:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:18:28.94746339 +0000 UTC m=+288.925659779" watchObservedRunningTime="2026-09-19 04:18:28.954690436 +0000 UTC m=+288.932886827"
Sep 19 04:18:29.062370 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:29.062333    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:29.304395 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:29.304365    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:29.906014 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:29.905985    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:33.144651 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:33.144614    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:33.568813 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:33.568685    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:33.951201 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:33.951168    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:34.666866 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:34.666839    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:35.488222 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:35.488189    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:36.198964 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:36.198932    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:37.983329 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:37.983289    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:39.899503 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:39.899470    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jntql"
Sep 19 04:18:40.331494 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:40.331417    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:40.427319 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:40.427291    2569 kubelet.go:1648] "Image garbage collection succeeded"
Sep 19 04:18:41.564365 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:41.564324    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:41.773320 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:41.773273    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:42.026226 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.026195    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:42.155332 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.155289    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:42.217339 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.217302    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-shhqh"]
Sep 19 04:18:42.220487 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.220471    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-shhqh"
Sep 19 04:18:42.224071 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.224050    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wv6pf\""
Sep 19 04:18:42.224774 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.224732    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 19 04:18:42.224877 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.224800    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 19 04:18:42.239448 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.239422    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-shhqh"]
Sep 19 04:18:42.359592 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.359521    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fffjl\" (UniqueName: \"kubernetes.io/projected/7ab72f23-6a4c-420c-ac04-4515802b69cd-kube-api-access-fffjl\") pod \"cert-manager-webhook-6486ffd997-shhqh\" (UID: \"7ab72f23-6a4c-420c-ac04-4515802b69cd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-shhqh"
Sep 19 04:18:42.359592 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.359580    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ab72f23-6a4c-420c-ac04-4515802b69cd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-shhqh\" (UID: \"7ab72f23-6a4c-420c-ac04-4515802b69cd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-shhqh"
Sep 19 04:18:42.461061 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.461013    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fffjl\" (UniqueName: \"kubernetes.io/projected/7ab72f23-6a4c-420c-ac04-4515802b69cd-kube-api-access-fffjl\") pod \"cert-manager-webhook-6486ffd997-shhqh\" (UID: \"7ab72f23-6a4c-420c-ac04-4515802b69cd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-shhqh"
Sep 19 04:18:42.461251 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.461090    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ab72f23-6a4c-420c-ac04-4515802b69cd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-shhqh\" (UID: \"7ab72f23-6a4c-420c-ac04-4515802b69cd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-shhqh"
Sep 19 04:18:42.477149 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.477123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:42.478555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.478525    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fffjl\" (UniqueName: \"kubernetes.io/projected/7ab72f23-6a4c-420c-ac04-4515802b69cd-kube-api-access-fffjl\") pod \"cert-manager-webhook-6486ffd997-shhqh\" (UID: \"7ab72f23-6a4c-420c-ac04-4515802b69cd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-shhqh"
Sep 19 04:18:42.483521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.483500    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ab72f23-6a4c-420c-ac04-4515802b69cd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-shhqh\" (UID: \"7ab72f23-6a4c-420c-ac04-4515802b69cd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-shhqh"
Sep 19 04:18:42.529605 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.529572    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-shhqh"
Sep 19 04:18:42.866312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.866280    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-shhqh"]
Sep 19 04:18:42.869408 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:18:42.869374    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ab72f23_6a4c_420c_ac04_4515802b69cd.slice/crio-0cf9cf7757c2172b645a06c5de7724e0363ef6ce4690c76c82a1b3af31201e3f WatchSource:0}: Error finding container 0cf9cf7757c2172b645a06c5de7724e0363ef6ce4690c76c82a1b3af31201e3f: Status 404 returned error can't find the container with id 0cf9cf7757c2172b645a06c5de7724e0363ef6ce4690c76c82a1b3af31201e3f
Sep 19 04:18:42.871520 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.871505    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 04:18:42.953024 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:42.952991    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-shhqh" event={"ID":"7ab72f23-6a4c-420c-ac04-4515802b69cd","Type":"ContainerStarted","Data":"0cf9cf7757c2172b645a06c5de7724e0363ef6ce4690c76c82a1b3af31201e3f"}
Sep 19 04:18:44.294094 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:44.294051    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:44.559234 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:44.559144    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:44.692822 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:44.692783    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xbl2k"]
Sep 19 04:18:44.710282 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:44.710249    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xbl2k"]
Sep 19 04:18:44.710545 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:44.710353    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbl2k"
Sep 19 04:18:44.713925 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:44.713892    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4bnhz\""
Sep 19 04:18:44.781008 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:44.780884    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39d4837c-b4d9-4b66-97f1-b4d0404628c1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xbl2k\" (UID: \"39d4837c-b4d9-4b66-97f1-b4d0404628c1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbl2k"
Sep 19 04:18:44.781008 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:44.780930    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxl7z\" (UniqueName: \"kubernetes.io/projected/39d4837c-b4d9-4b66-97f1-b4d0404628c1-kube-api-access-xxl7z\") pod \"cert-manager-cainjector-559cdd8c87-xbl2k\" (UID: \"39d4837c-b4d9-4b66-97f1-b4d0404628c1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbl2k"
Sep 19 04:18:44.882040 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:44.882001    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39d4837c-b4d9-4b66-97f1-b4d0404628c1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xbl2k\" (UID: \"39d4837c-b4d9-4b66-97f1-b4d0404628c1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbl2k"
Sep 19 04:18:44.882227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:44.882049    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxl7z\" (UniqueName: \"kubernetes.io/projected/39d4837c-b4d9-4b66-97f1-b4d0404628c1-kube-api-access-xxl7z\") pod \"cert-manager-cainjector-559cdd8c87-xbl2k\" (UID: \"39d4837c-b4d9-4b66-97f1-b4d0404628c1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbl2k"
Sep 19 04:18:44.896520 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:44.896462    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/39d4837c-b4d9-4b66-97f1-b4d0404628c1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xbl2k\" (UID: \"39d4837c-b4d9-4b66-97f1-b4d0404628c1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbl2k"
Sep 19 04:18:44.899266 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:44.899214    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxl7z\" (UniqueName: \"kubernetes.io/projected/39d4837c-b4d9-4b66-97f1-b4d0404628c1-kube-api-access-xxl7z\") pod \"cert-manager-cainjector-559cdd8c87-xbl2k\" (UID: \"39d4837c-b4d9-4b66-97f1-b4d0404628c1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbl2k"
Sep 19 04:18:45.024387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:45.024356    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbl2k"
Sep 19 04:18:46.910059 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:46.910029    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xbl2k"]
Sep 19 04:18:46.910620 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:18:46.910593    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod39d4837c_b4d9_4b66_97f1_b4d0404628c1.slice/crio-aceaf71f9cbdc489b57d955a28d0a9317f1cbe36114eb3a2f7a7c3dac4637aec WatchSource:0}: Error finding container aceaf71f9cbdc489b57d955a28d0a9317f1cbe36114eb3a2f7a7c3dac4637aec: Status 404 returned error can't find the container with id aceaf71f9cbdc489b57d955a28d0a9317f1cbe36114eb3a2f7a7c3dac4637aec
Sep 19 04:18:46.975608 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:46.975580    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-shhqh" event={"ID":"7ab72f23-6a4c-420c-ac04-4515802b69cd","Type":"ContainerStarted","Data":"19a5e8e8536c5cb572f308833a0b794cece7b3b9d10eb2c4526f26657e4395ac"}
Sep 19 04:18:46.975736 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:46.975692    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-shhqh"
Sep 19 04:18:46.977298 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:46.977275    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbl2k" event={"ID":"39d4837c-b4d9-4b66-97f1-b4d0404628c1","Type":"ContainerStarted","Data":"aceaf71f9cbdc489b57d955a28d0a9317f1cbe36114eb3a2f7a7c3dac4637aec"}
Sep 19 04:18:47.023696 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:47.023638    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-shhqh" podStartSLOduration=1.237848172 podStartE2EDuration="5.023622592s" totalImagesPullingTime="3.78577442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:18:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:18:47.022259412 +0000 UTC m=+307.000455802" watchObservedRunningTime="2026-09-19 04:18:47.023622592 +0000 UTC m=+307.001818981"
Sep 19 04:18:47.983364 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:47.983326    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbl2k" event={"ID":"39d4837c-b4d9-4b66-97f1-b4d0404628c1","Type":"ContainerStarted","Data":"ee308ac7a33c1e16b595279bee5f88db7a5c49ba29521541602df3a399cf2e99"}
Sep 19 04:18:48.422831 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:48.422792    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:49.913467 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:49.913432    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:51.517323 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:51.517287    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:52.986288 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:52.986255    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-shhqh"
Sep 19 04:18:53.017488 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.017435    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xbl2k" podStartSLOduration=9.017419031 podStartE2EDuration="9.017419031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:18:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:18:47.102161602 +0000 UTC m=+307.080357992" watchObservedRunningTime="2026-09-19 04:18:53.017419031 +0000 UTC m=+312.995615456"
Sep 19 04:18:53.193301 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.193264    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:53.247718 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.247646    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xdxks"]
Sep 19 04:18:53.251563 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.251542    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xdxks"
Sep 19 04:18:53.254978 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.254959    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zlt58\""
Sep 19 04:18:53.324042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.324013    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xdxks"]
Sep 19 04:18:53.353101 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.353066    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:53.358117 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.358087    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14372179-a2fb-4ecc-8bcf-9dbf63596328-bound-sa-token\") pod \"cert-manager-55b4d954d5-xdxks\" (UID: \"14372179-a2fb-4ecc-8bcf-9dbf63596328\") " pod="cert-manager/cert-manager-55b4d954d5-xdxks"
Sep 19 04:18:53.358267 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.358144    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw245\" (UniqueName: \"kubernetes.io/projected/14372179-a2fb-4ecc-8bcf-9dbf63596328-kube-api-access-lw245\") pod \"cert-manager-55b4d954d5-xdxks\" (UID: \"14372179-a2fb-4ecc-8bcf-9dbf63596328\") " pod="cert-manager/cert-manager-55b4d954d5-xdxks"
Sep 19 04:18:53.458848 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.458813    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14372179-a2fb-4ecc-8bcf-9dbf63596328-bound-sa-token\") pod \"cert-manager-55b4d954d5-xdxks\" (UID: \"14372179-a2fb-4ecc-8bcf-9dbf63596328\") " pod="cert-manager/cert-manager-55b4d954d5-xdxks"
Sep 19 04:18:53.459045 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.458880    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw245\" (UniqueName: \"kubernetes.io/projected/14372179-a2fb-4ecc-8bcf-9dbf63596328-kube-api-access-lw245\") pod \"cert-manager-55b4d954d5-xdxks\" (UID: \"14372179-a2fb-4ecc-8bcf-9dbf63596328\") " pod="cert-manager/cert-manager-55b4d954d5-xdxks"
Sep 19 04:18:53.494144 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.494118    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/14372179-a2fb-4ecc-8bcf-9dbf63596328-bound-sa-token\") pod \"cert-manager-55b4d954d5-xdxks\" (UID: \"14372179-a2fb-4ecc-8bcf-9dbf63596328\") " pod="cert-manager/cert-manager-55b4d954d5-xdxks"
Sep 19 04:18:53.494694 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.494667    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw245\" (UniqueName: \"kubernetes.io/projected/14372179-a2fb-4ecc-8bcf-9dbf63596328-kube-api-access-lw245\") pod \"cert-manager-55b4d954d5-xdxks\" (UID: \"14372179-a2fb-4ecc-8bcf-9dbf63596328\") " pod="cert-manager/cert-manager-55b4d954d5-xdxks"
Sep 19 04:18:53.560592 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.560511    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xdxks"
Sep 19 04:18:53.603282 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.603251    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:53.785921 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.785885    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6644598669-gvdvd"]
Sep 19 04:18:53.790381 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.790360    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6644598669-gvdvd"
Sep 19 04:18:53.797326 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.797304    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 19 04:18:53.797785 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.797769    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 19 04:18:53.797977 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.797965    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 19 04:18:53.799127 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.799113    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 19 04:18:53.806865 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.806850    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-prgcf\""
Sep 19 04:18:53.841021 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.840957    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6644598669-gvdvd"]
Sep 19 04:18:53.861927 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.861904    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6d96e68-1f9b-4607-8b11-a12822c777e7-tls-certs\") pod \"kube-auth-proxy-6644598669-gvdvd\" (UID: \"f6d96e68-1f9b-4607-8b11-a12822c777e7\") " pod="openshift-ingress/kube-auth-proxy-6644598669-gvdvd"
Sep 19 04:18:53.862065 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.862033    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6d96e68-1f9b-4607-8b11-a12822c777e7-tmp\") pod \"kube-auth-proxy-6644598669-gvdvd\" (UID: \"f6d96e68-1f9b-4607-8b11-a12822c777e7\") " pod="openshift-ingress/kube-auth-proxy-6644598669-gvdvd"
Sep 19 04:18:53.862127 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.862068    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mww5\" (UniqueName: \"kubernetes.io/projected/f6d96e68-1f9b-4607-8b11-a12822c777e7-kube-api-access-8mww5\") pod \"kube-auth-proxy-6644598669-gvdvd\" (UID: \"f6d96e68-1f9b-4607-8b11-a12822c777e7\") " pod="openshift-ingress/kube-auth-proxy-6644598669-gvdvd"
Sep 19 04:18:53.881160 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.881135    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xdxks"]
Sep 19 04:18:53.884517 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:18:53.884494    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14372179_a2fb_4ecc_8bcf_9dbf63596328.slice/crio-03c6862acde3994eb77846b5d680fb337b3ce3046950e9dccf15b530081da807 WatchSource:0}: Error finding container 03c6862acde3994eb77846b5d680fb337b3ce3046950e9dccf15b530081da807: Status 404 returned error can't find the container with id 03c6862acde3994eb77846b5d680fb337b3ce3046950e9dccf15b530081da807
Sep 19 04:18:53.904062 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.904021    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:53.962898 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.962874    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6d96e68-1f9b-4607-8b11-a12822c777e7-tmp\") pod \"kube-auth-proxy-6644598669-gvdvd\" (UID: \"f6d96e68-1f9b-4607-8b11-a12822c777e7\") " pod="openshift-ingress/kube-auth-proxy-6644598669-gvdvd"
Sep 19 04:18:53.963056 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.962906    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mww5\" (UniqueName: \"kubernetes.io/projected/f6d96e68-1f9b-4607-8b11-a12822c777e7-kube-api-access-8mww5\") pod \"kube-auth-proxy-6644598669-gvdvd\" (UID: \"f6d96e68-1f9b-4607-8b11-a12822c777e7\") " pod="openshift-ingress/kube-auth-proxy-6644598669-gvdvd"
Sep 19 04:18:53.963056 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.962946    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6d96e68-1f9b-4607-8b11-a12822c777e7-tls-certs\") pod \"kube-auth-proxy-6644598669-gvdvd\" (UID: \"f6d96e68-1f9b-4607-8b11-a12822c777e7\") " pod="openshift-ingress/kube-auth-proxy-6644598669-gvdvd"
Sep 19 04:18:53.965394 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.965370    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6d96e68-1f9b-4607-8b11-a12822c777e7-tmp\") pod \"kube-auth-proxy-6644598669-gvdvd\" (UID: \"f6d96e68-1f9b-4607-8b11-a12822c777e7\") " pod="openshift-ingress/kube-auth-proxy-6644598669-gvdvd"
Sep 19 04:18:53.965496 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:53.965433    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6d96e68-1f9b-4607-8b11-a12822c777e7-tls-certs\") pod \"kube-auth-proxy-6644598669-gvdvd\" (UID: \"f6d96e68-1f9b-4607-8b11-a12822c777e7\") " pod="openshift-ingress/kube-auth-proxy-6644598669-gvdvd"
Sep 19 04:18:54.011443 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:54.011396    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mww5\" (UniqueName: \"kubernetes.io/projected/f6d96e68-1f9b-4607-8b11-a12822c777e7-kube-api-access-8mww5\") pod \"kube-auth-proxy-6644598669-gvdvd\" (UID: \"f6d96e68-1f9b-4607-8b11-a12822c777e7\") " pod="openshift-ingress/kube-auth-proxy-6644598669-gvdvd"
Sep 19 04:18:54.013172 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:54.013143    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xdxks" event={"ID":"14372179-a2fb-4ecc-8bcf-9dbf63596328","Type":"ContainerStarted","Data":"0137acc0479b6603db585429048fd76403bf46fcc35000e22769474ff8adaeae"}
Sep 19 04:18:54.013295 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:54.013187    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xdxks" event={"ID":"14372179-a2fb-4ecc-8bcf-9dbf63596328","Type":"ContainerStarted","Data":"03c6862acde3994eb77846b5d680fb337b3ce3046950e9dccf15b530081da807"}
Sep 19 04:18:54.059160 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:54.059105    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-xdxks" podStartSLOduration=1.059088613 podStartE2EDuration="1.059088613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:18:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:18:54.057983718 +0000 UTC m=+314.036180106" watchObservedRunningTime="2026-09-19 04:18:54.059088613 +0000 UTC m=+314.037285003"
Sep 19 04:18:54.080653 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:54.080623    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:54.100606 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:54.100537    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6644598669-gvdvd"
Sep 19 04:18:54.256626 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:54.256590    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:54.394962 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:54.394925    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6644598669-gvdvd"]
Sep 19 04:18:54.397719 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:18:54.397697    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d96e68_1f9b_4607_8b11_a12822c777e7.slice/crio-344673714bfa12b5a07b2690f658d46e4331e132b8fce67ff4cf0f3eba1e031f WatchSource:0}: Error finding container 344673714bfa12b5a07b2690f658d46e4331e132b8fce67ff4cf0f3eba1e031f: Status 404 returned error can't find the container with id 344673714bfa12b5a07b2690f658d46e4331e132b8fce67ff4cf0f3eba1e031f
Sep 19 04:18:54.427322 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:54.427300    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:55.019342 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:55.019308    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6644598669-gvdvd" event={"ID":"f6d96e68-1f9b-4607-8b11-a12822c777e7","Type":"ContainerStarted","Data":"344673714bfa12b5a07b2690f658d46e4331e132b8fce67ff4cf0f3eba1e031f"}
Sep 19 04:18:55.617063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:55.617018    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:55.910471 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:55.910423    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:18:57.030361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:57.030320    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6644598669-gvdvd" event={"ID":"f6d96e68-1f9b-4607-8b11-a12822c777e7","Type":"ContainerStarted","Data":"0da1d0c5f3fe910fd269dab2f834da41f661a5691c5dd12e453acce4bfbddbc9"}
Sep 19 04:18:57.095679 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:18:57.095632    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6644598669-gvdvd" podStartSLOduration=2.363248715 podStartE2EDuration="4.095616835s" totalImagesPullingTime="1.73236812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:18:57.093470079 +0000 UTC m=+317.071666469" watchObservedRunningTime="2026-09-19 04:18:57.095616835 +0000 UTC m=+317.073813225"
Sep 19 04:19:00.172604 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:00.172569    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:00.329677 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:00.329638    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:00.623042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:00.622950    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:00.757241 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:00.757210    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:00.980678 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:00.980648    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:01.106324 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:01.106294    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:08.160064 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:08.160031    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:08.362656 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:08.362625    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:08.482530 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:08.482456    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:11.020875 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:11.020845    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:11.185473 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:11.185438    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:13.285709 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:13.285671    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:13.512190 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:13.512159    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:14.526473 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:14.526439    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:14.598077 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:14.598041    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:18.565294 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:18.565259    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:18.774487 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:18.774453    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:18.964373 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:18.964340    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:19.091382 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:19.091342    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:27.266159 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:27.266126    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:27.364196 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:27.364159    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:28.217167 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:28.217141    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:28.283168 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:28.283132    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:51.834892 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:51.834693    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:52.197609 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.197562    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:52.524664 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.524587    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7db885c774-tlnqv"]
Sep 19 04:19:52.527930 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.527915    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7db885c774-tlnqv"
Sep 19 04:19:52.542817 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.542787    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 19 04:19:52.542950 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.542852    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 19 04:19:52.542950 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.542885    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Sep 19 04:19:52.543071 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.543012    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 19 04:19:52.543153 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.543138    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4kw2j\""
Sep 19 04:19:52.572933 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.572907    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:52.580629 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.580601    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7db885c774-tlnqv"]
Sep 19 04:19:52.661848 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.661821    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd8a7025-a9bc-4827-a89e-a9994cdc0288-cert\") pod \"odh-model-controller-7db885c774-tlnqv\" (UID: \"fd8a7025-a9bc-4827-a89e-a9994cdc0288\") " pod="opendatahub/odh-model-controller-7db885c774-tlnqv"
Sep 19 04:19:52.661848 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.661851    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd8a7025-a9bc-4827-a89e-a9994cdc0288-metrics-certs\") pod \"odh-model-controller-7db885c774-tlnqv\" (UID: \"fd8a7025-a9bc-4827-a89e-a9994cdc0288\") " pod="opendatahub/odh-model-controller-7db885c774-tlnqv"
Sep 19 04:19:52.662061 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.661883    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kp4pz\" (UniqueName: \"kubernetes.io/projected/fd8a7025-a9bc-4827-a89e-a9994cdc0288-kube-api-access-kp4pz\") pod \"odh-model-controller-7db885c774-tlnqv\" (UID: \"fd8a7025-a9bc-4827-a89e-a9994cdc0288\") " pod="opendatahub/odh-model-controller-7db885c774-tlnqv"
Sep 19 04:19:52.757438 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.757403    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:52.762577 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.762548    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kp4pz\" (UniqueName: \"kubernetes.io/projected/fd8a7025-a9bc-4827-a89e-a9994cdc0288-kube-api-access-kp4pz\") pod \"odh-model-controller-7db885c774-tlnqv\" (UID: \"fd8a7025-a9bc-4827-a89e-a9994cdc0288\") " pod="opendatahub/odh-model-controller-7db885c774-tlnqv"
Sep 19 04:19:52.762692 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.762676    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd8a7025-a9bc-4827-a89e-a9994cdc0288-cert\") pod \"odh-model-controller-7db885c774-tlnqv\" (UID: \"fd8a7025-a9bc-4827-a89e-a9994cdc0288\") " pod="opendatahub/odh-model-controller-7db885c774-tlnqv"
Sep 19 04:19:52.762741 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.762704    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd8a7025-a9bc-4827-a89e-a9994cdc0288-metrics-certs\") pod \"odh-model-controller-7db885c774-tlnqv\" (UID: \"fd8a7025-a9bc-4827-a89e-a9994cdc0288\") " pod="opendatahub/odh-model-controller-7db885c774-tlnqv"
Sep 19 04:19:52.765210 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.765179    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fd8a7025-a9bc-4827-a89e-a9994cdc0288-cert\") pod \"odh-model-controller-7db885c774-tlnqv\" (UID: \"fd8a7025-a9bc-4827-a89e-a9994cdc0288\") " pod="opendatahub/odh-model-controller-7db885c774-tlnqv"
Sep 19 04:19:52.765334 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.765314    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd8a7025-a9bc-4827-a89e-a9994cdc0288-metrics-certs\") pod \"odh-model-controller-7db885c774-tlnqv\" (UID: \"fd8a7025-a9bc-4827-a89e-a9994cdc0288\") " pod="opendatahub/odh-model-controller-7db885c774-tlnqv"
Sep 19 04:19:52.774364 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.774344    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kp4pz\" (UniqueName: \"kubernetes.io/projected/fd8a7025-a9bc-4827-a89e-a9994cdc0288-kube-api-access-kp4pz\") pod \"odh-model-controller-7db885c774-tlnqv\" (UID: \"fd8a7025-a9bc-4827-a89e-a9994cdc0288\") " pod="opendatahub/odh-model-controller-7db885c774-tlnqv"
Sep 19 04:19:52.838589 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.838502    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7db885c774-tlnqv"
Sep 19 04:19:52.948480 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:52.948443    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:53.134526 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:53.134499    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7db885c774-tlnqv"]
Sep 19 04:19:53.136285 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:19:53.136260    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8a7025_a9bc_4827_a89e_a9994cdc0288.slice/crio-270a7ba524e4e760175db256486664c06106b6b2ce28af01b9ebb09164886e41 WatchSource:0}: Error finding container 270a7ba524e4e760175db256486664c06106b6b2ce28af01b9ebb09164886e41: Status 404 returned error can't find the container with id 270a7ba524e4e760175db256486664c06106b6b2ce28af01b9ebb09164886e41
Sep 19 04:19:53.292572 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:53.292531    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7db885c774-tlnqv" event={"ID":"fd8a7025-a9bc-4827-a89e-a9994cdc0288","Type":"ContainerStarted","Data":"270a7ba524e4e760175db256486664c06106b6b2ce28af01b9ebb09164886e41"}
Sep 19 04:19:54.663906 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:54.663855    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:54.765939 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:54.765907    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:54.899219 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:54.899186    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:55.108931 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:55.108849    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:19:56.310008 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:56.309978    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7db885c774-tlnqv" event={"ID":"fd8a7025-a9bc-4827-a89e-a9994cdc0288","Type":"ContainerStarted","Data":"e8117e2728bdc35df4b677e26271abf5a527f6f6e5f403114fbd6c148e069259"}
Sep 19 04:19:56.310402 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:56.310102    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7db885c774-tlnqv"
Sep 19 04:19:56.347252 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:19:56.347202    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7db885c774-tlnqv" podStartSLOduration=1.683321147 podStartE2EDuration="4.347183361s" totalImagesPullingTime="2.663862214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:19:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:19:56.344575171 +0000 UTC m=+376.322771561" watchObservedRunningTime="2026-09-19 04:19:56.347183361 +0000 UTC m=+376.325379751"
Sep 19 04:20:05.590489 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:05.590454    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:20:05.705973 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:05.705944    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:20:06.251370 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.251339    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"]
Sep 19 04:20:06.257635 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.257614    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:06.261879 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.261857    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-t85rx\""
Sep 19 04:20:06.261879 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.261874    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Sep 19 04:20:06.262047 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.261861    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Sep 19 04:20:06.262047 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.261867    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Sep 19 04:20:06.267084 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.267064    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"]
Sep 19 04:20:06.284468 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.284448    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b117ee71-62fb-4917-8f04-99ae8473a3da-manager-config\") pod \"jobset-controller-manager-cb8bdffdf-cxjp9\" (UID: \"b117ee71-62fb-4917-8f04-99ae8473a3da\") " pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:06.284566 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.284496    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b117ee71-62fb-4917-8f04-99ae8473a3da-cert\") pod \"jobset-controller-manager-cb8bdffdf-cxjp9\" (UID: \"b117ee71-62fb-4917-8f04-99ae8473a3da\") " pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:06.284566 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.284527    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcvm8\" (UniqueName: \"kubernetes.io/projected/b117ee71-62fb-4917-8f04-99ae8473a3da-kube-api-access-kcvm8\") pod \"jobset-controller-manager-cb8bdffdf-cxjp9\" (UID: \"b117ee71-62fb-4917-8f04-99ae8473a3da\") " pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:06.284637 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.284576    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b117ee71-62fb-4917-8f04-99ae8473a3da-metrics-certs\") pod \"jobset-controller-manager-cb8bdffdf-cxjp9\" (UID: \"b117ee71-62fb-4917-8f04-99ae8473a3da\") " pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:06.385213 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.385186    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b117ee71-62fb-4917-8f04-99ae8473a3da-metrics-certs\") pod \"jobset-controller-manager-cb8bdffdf-cxjp9\" (UID: \"b117ee71-62fb-4917-8f04-99ae8473a3da\") " pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:06.385403 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.385239    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b117ee71-62fb-4917-8f04-99ae8473a3da-manager-config\") pod \"jobset-controller-manager-cb8bdffdf-cxjp9\" (UID: \"b117ee71-62fb-4917-8f04-99ae8473a3da\") " pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:06.385403 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.385276    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b117ee71-62fb-4917-8f04-99ae8473a3da-cert\") pod \"jobset-controller-manager-cb8bdffdf-cxjp9\" (UID: \"b117ee71-62fb-4917-8f04-99ae8473a3da\") " pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:06.385403 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.385302    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcvm8\" (UniqueName: \"kubernetes.io/projected/b117ee71-62fb-4917-8f04-99ae8473a3da-kube-api-access-kcvm8\") pod \"jobset-controller-manager-cb8bdffdf-cxjp9\" (UID: \"b117ee71-62fb-4917-8f04-99ae8473a3da\") " pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:06.386071 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.386052    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b117ee71-62fb-4917-8f04-99ae8473a3da-manager-config\") pod \"jobset-controller-manager-cb8bdffdf-cxjp9\" (UID: \"b117ee71-62fb-4917-8f04-99ae8473a3da\") " pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:06.387872 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.387850    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b117ee71-62fb-4917-8f04-99ae8473a3da-cert\") pod \"jobset-controller-manager-cb8bdffdf-cxjp9\" (UID: \"b117ee71-62fb-4917-8f04-99ae8473a3da\") " pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:06.387961 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.387910    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b117ee71-62fb-4917-8f04-99ae8473a3da-metrics-certs\") pod \"jobset-controller-manager-cb8bdffdf-cxjp9\" (UID: \"b117ee71-62fb-4917-8f04-99ae8473a3da\") " pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:06.394900 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.394881    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcvm8\" (UniqueName: \"kubernetes.io/projected/b117ee71-62fb-4917-8f04-99ae8473a3da-kube-api-access-kcvm8\") pod \"jobset-controller-manager-cb8bdffdf-cxjp9\" (UID: \"b117ee71-62fb-4917-8f04-99ae8473a3da\") " pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:06.568130 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.568057    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:06.851565 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:06.851542    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"]
Sep 19 04:20:06.854020 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:20:06.853991    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb117ee71_62fb_4917_8f04_99ae8473a3da.slice/crio-5efda198f468d7d4a8a7ab4e1fa94c928b02d260d41f8e600feb394b375ba14e WatchSource:0}: Error finding container 5efda198f468d7d4a8a7ab4e1fa94c928b02d260d41f8e600feb394b375ba14e: Status 404 returned error can't find the container with id 5efda198f468d7d4a8a7ab4e1fa94c928b02d260d41f8e600feb394b375ba14e
Sep 19 04:20:07.317094 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:07.317048    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7db885c774-tlnqv"
Sep 19 04:20:07.362165 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:07.362132    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9" event={"ID":"b117ee71-62fb-4917-8f04-99ae8473a3da","Type":"ContainerStarted","Data":"5efda198f468d7d4a8a7ab4e1fa94c928b02d260d41f8e600feb394b375ba14e"}
Sep 19 04:20:10.379249 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:10.379209    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9" event={"ID":"b117ee71-62fb-4917-8f04-99ae8473a3da","Type":"ContainerStarted","Data":"bc4468951eb31c9d9898026d0591e04e8f55d4724d3e9c43146584b720642d16"}
Sep 19 04:20:10.379699 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:10.379317    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:20:10.403174 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:10.403120    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9" podStartSLOduration=1.584172042 podStartE2EDuration="4.403105245s" totalImagesPullingTime="2.818933203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:20:10.400384834 +0000 UTC m=+390.378581222" watchObservedRunningTime="2026-09-19 04:20:10.403105245 +0000 UTC m=+390.381301636"
Sep 19 04:20:21.389152 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:20:21.389124    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-cb8bdffdf-cxjp9"
Sep 19 04:21:22.358118 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:21:22.358085    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:21:22.807437 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:21:22.807401    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:21:33.748116 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:21:33.748071    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:21:33.849531 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:21:33.849497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:21:33.976322 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:21:33.976291    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:22:01.466666 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:22:01.466627    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:22:04.592765 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:22:04.592689    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:22:04.693821 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:22:04.693792    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:23:03.186461 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:23:03.186367    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:23:16.182621 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:23:16.182572    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:24:58.495317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:24:58.495286    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:25:50.738302 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:25:50.738206    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:27:17.158081 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:27:17.157995    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:29:28.756519 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:29:28.756480    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:29:28.840338 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:29:28.840308    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:29:28.938386 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:29:28.938344    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:29:29.585715 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:29:29.585662    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:29:29.689896 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:29:29.689863    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:29:48.245731 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:29:48.245691    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:29:48.344815 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:29:48.344776    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:29:48.781347 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:29:48.781307    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:06.494509 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:06.494415    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:07.853082 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:07.853040    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:09.217581 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:09.217546    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:09.331846 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:09.331805    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:40.825629 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:40.825590    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:40.979091 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:40.979062    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:42.455435 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:42.455399    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:42.553323 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:42.553278    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:42.641334 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:42.641300    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:42.747585 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:42.747496    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:42.999397 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:42.999321    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:43.103132 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:43.103104    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:52.313122 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.313086    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:52.595363 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.595275    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:52.732082 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.732045    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"]
Sep 19 04:30:52.735529 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.735511    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:52.738790 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.738768    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 19 04:30:52.738901 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.738879    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 04:30:52.739835 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.739817    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 19 04:30:52.739835 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.739817    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 19 04:30:52.740083 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.740066    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7pswq\""
Sep 19 04:30:52.764293 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.764270    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"]
Sep 19 04:30:52.797863 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.797839    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-openshift-service-ca\") pod \"maas-api-68cb6dd889-mkp4q\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:52.798027 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.797875    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-maas-api-tls\") pod \"maas-api-68cb6dd889-mkp4q\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:52.798027 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.797909    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thxp2\" (UniqueName: \"kubernetes.io/projected/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-kube-api-access-thxp2\") pod \"maas-api-68cb6dd889-mkp4q\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:52.798027 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.798003    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-metrics-certs\") pod \"maas-api-68cb6dd889-mkp4q\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:52.899185 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.899151    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-metrics-certs\") pod \"maas-api-68cb6dd889-mkp4q\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:52.899355 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.899210    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-openshift-service-ca\") pod \"maas-api-68cb6dd889-mkp4q\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:52.899355 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.899236    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-maas-api-tls\") pod \"maas-api-68cb6dd889-mkp4q\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:52.899355 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.899268    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thxp2\" (UniqueName: \"kubernetes.io/projected/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-kube-api-access-thxp2\") pod \"maas-api-68cb6dd889-mkp4q\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:52.900029 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.899961    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-openshift-service-ca\") pod \"maas-api-68cb6dd889-mkp4q\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:52.901893 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.901871    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-maas-api-tls\") pod \"maas-api-68cb6dd889-mkp4q\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:52.901983 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.901935    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-metrics-certs\") pod \"maas-api-68cb6dd889-mkp4q\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:52.917476 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:52.917453    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thxp2\" (UniqueName: \"kubernetes.io/projected/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-kube-api-access-thxp2\") pod \"maas-api-68cb6dd889-mkp4q\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:53.046441 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:53.046408    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:53.322966 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:53.322940    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"]
Sep 19 04:30:53.325668 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:30:53.325641    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8044e0c9_dc99_49ed_b64b_b81b64e7b53b.slice/crio-dc7ca9b4bdc0f63fd35af469ff07d5ae7b4914b409197e9beb2451be1e51c4cf WatchSource:0}: Error finding container dc7ca9b4bdc0f63fd35af469ff07d5ae7b4914b409197e9beb2451be1e51c4cf: Status 404 returned error can't find the container with id dc7ca9b4bdc0f63fd35af469ff07d5ae7b4914b409197e9beb2451be1e51c4cf
Sep 19 04:30:53.327000 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:53.326978    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 04:30:54.333470 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:54.333427    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q" event={"ID":"8044e0c9-dc99-49ed-b64b-b81b64e7b53b","Type":"ContainerStarted","Data":"dc7ca9b4bdc0f63fd35af469ff07d5ae7b4914b409197e9beb2451be1e51c4cf"}
Sep 19 04:30:55.363153 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:55.363118    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:55.494691 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:55.494659    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:30:56.345387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:56.345353    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q" event={"ID":"8044e0c9-dc99-49ed-b64b-b81b64e7b53b","Type":"ContainerStarted","Data":"033897e8cf2132cb13af709007a3aa5d316b36f7d4b7ff76ea93496ad22293c9"}
Sep 19 04:30:56.345580 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:56.345442    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:30:56.363907 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:30:56.363853    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q" podStartSLOduration=2.059479902 podStartE2EDuration="4.363834254s" totalImagesPullingTime="2.304354352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:30:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:30:56.363353863 +0000 UTC m=+1036.341550244" watchObservedRunningTime="2026-09-19 04:30:56.363834254 +0000 UTC m=+1036.342030648"
Sep 19 04:31:02.356427 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:02.356398    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 04:31:05.613979 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:05.613941    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:31:19.374585 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:19.374549    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:31:33.239160 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.238872    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"]
Sep 19 04:31:33.245138 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.245114    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.248334 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.248308    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 19 04:31:33.249112 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.249092    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 19 04:31:33.249314 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.249092    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 19 04:31:33.249314 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.249095    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lbmbg\""
Sep 19 04:31:33.259196 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.259170    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"]
Sep 19 04:31:33.265743 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.265717    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spk4t\" (UniqueName: \"kubernetes.io/projected/0b06bbaf-22b8-497b-a20e-f0271782bf18-kube-api-access-spk4t\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.265848 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.265773    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b06bbaf-22b8-497b-a20e-f0271782bf18-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.265889 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.265852    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b06bbaf-22b8-497b-a20e-f0271782bf18-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.265927 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.265893    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b06bbaf-22b8-497b-a20e-f0271782bf18-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.265986 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.265970    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b06bbaf-22b8-497b-a20e-f0271782bf18-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.266020 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.266008    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b06bbaf-22b8-497b-a20e-f0271782bf18-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.295289 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.295240    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:31:33.366720 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.366690    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spk4t\" (UniqueName: \"kubernetes.io/projected/0b06bbaf-22b8-497b-a20e-f0271782bf18-kube-api-access-spk4t\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.366912 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.366731    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b06bbaf-22b8-497b-a20e-f0271782bf18-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.366912 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.366777    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b06bbaf-22b8-497b-a20e-f0271782bf18-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.366912 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.366846    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b06bbaf-22b8-497b-a20e-f0271782bf18-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.366912 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.366904    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b06bbaf-22b8-497b-a20e-f0271782bf18-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.367112 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.367016    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b06bbaf-22b8-497b-a20e-f0271782bf18-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.367164 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.367141    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0b06bbaf-22b8-497b-a20e-f0271782bf18-home\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.367214 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.367198    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0b06bbaf-22b8-497b-a20e-f0271782bf18-model-cache\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.367382 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.367358    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0b06bbaf-22b8-497b-a20e-f0271782bf18-tmp-dir\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.369250 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.369230    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0b06bbaf-22b8-497b-a20e-f0271782bf18-dshm\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.369385 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.369367    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0b06bbaf-22b8-497b-a20e-f0271782bf18-tls-certs\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.376162 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.376143    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spk4t\" (UniqueName: \"kubernetes.io/projected/0b06bbaf-22b8-497b-a20e-f0271782bf18-kube-api-access-spk4t\") pod \"e2e-embedding-simulated-kserve-698db7d589-qqqxg\" (UID: \"0b06bbaf-22b8-497b-a20e-f0271782bf18\") " pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.556946 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.556864    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:33.832084 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:33.831995    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"]
Sep 19 04:31:33.835287 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:31:33.835260    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b06bbaf_22b8_497b_a20e_f0271782bf18.slice/crio-95d52babded290df5326662051a43ebe4053a2255776db056a0529341e3c3a2a WatchSource:0}: Error finding container 95d52babded290df5326662051a43ebe4053a2255776db056a0529341e3c3a2a: Status 404 returned error can't find the container with id 95d52babded290df5326662051a43ebe4053a2255776db056a0529341e3c3a2a
Sep 19 04:31:34.539153 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:34.539115    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg" event={"ID":"0b06bbaf-22b8-497b-a20e-f0271782bf18","Type":"ContainerStarted","Data":"95d52babded290df5326662051a43ebe4053a2255776db056a0529341e3c3a2a"}
Sep 19 04:31:35.538885 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:35.538851    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg" event={"ID":"0b06bbaf-22b8-497b-a20e-f0271782bf18","Type":"ContainerStarted","Data":"9efc418c0d28ca2a9fca3d026b89ead96f48a1a575dc7365ddabe9f2586bb9fc"}
Sep 19 04:31:35.556976 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:35.556945    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:35.558977 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:35.558934    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg" podStartSLOduration=1.532011687 podStartE2EDuration="2.558919262s" totalImagesPullingTime="1.026907575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:31:35.556998414 +0000 UTC m=+1075.535194805" watchObservedRunningTime="2026-09-19 04:31:35.558919262 +0000 UTC m=+1075.537115651"
Sep 19 04:31:43.557020 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:43.556985    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:43.569423 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:43.569402    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:43.584186 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:43.584162    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-698db7d589-qqqxg"
Sep 19 04:31:49.276222 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:49.276186    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:31:54.765396 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:54.765365    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:31:54.824598 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:54.824556    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:31:57.969478 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:31:57.969442    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:32:05.488920 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:05.488882    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:32:38.040382 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.040351    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"]
Sep 19 04:32:38.043699 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.043682    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.046864 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.046846    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 19 04:32:38.060417 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.060395    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"]
Sep 19 04:32:38.104324 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.104293    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:32:38.135503 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.135463    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.135636 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.135544    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.135636 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.135580    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.135636 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.135622    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jctmm\" (UniqueName: \"kubernetes.io/projected/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-kube-api-access-jctmm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.135744 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.135660    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.135744 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.135679    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.236840 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.236805    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.237023 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.236864    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jctmm\" (UniqueName: \"kubernetes.io/projected/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-kube-api-access-jctmm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.237023 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.236917    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.237023 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.236940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.237023 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.236973    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.237221 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.237038    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.237290 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.237265    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.237345 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.237310    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-home\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.237385 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.237374    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.239402 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.239375    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-dshm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.239631 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.239610    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.246967 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.246946    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jctmm\" (UniqueName: \"kubernetes.io/projected/5dd41c47-e07d-4cbf-8468-0fc493c0bea5-kube-api-access-jctmm\") pod \"premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5\" (UID: \"5dd41c47-e07d-4cbf-8468-0fc493c0bea5\") " pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.353035 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.352953    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:38.624203 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.624177    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"]
Sep 19 04:32:38.626703 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:32:38.626665    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dd41c47_e07d_4cbf_8468_0fc493c0bea5.slice/crio-49bea9dd646d054d7cbc6470ab128ffb0449e7a48f97bfcdbef12b237d7c553f WatchSource:0}: Error finding container 49bea9dd646d054d7cbc6470ab128ffb0449e7a48f97bfcdbef12b237d7c553f: Status 404 returned error can't find the container with id 49bea9dd646d054d7cbc6470ab128ffb0449e7a48f97bfcdbef12b237d7c553f
Sep 19 04:32:38.839256 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:38.839229    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5" event={"ID":"5dd41c47-e07d-4cbf-8468-0fc493c0bea5","Type":"ContainerStarted","Data":"49bea9dd646d054d7cbc6470ab128ffb0449e7a48f97bfcdbef12b237d7c553f"}
Sep 19 04:32:39.846081 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:39.846040    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5" event={"ID":"5dd41c47-e07d-4cbf-8468-0fc493c0bea5","Type":"ContainerStarted","Data":"947569b415426fda19c7c43ce81a12fae1bfb8d5a5ceea83d0766c4845fb0df3"}
Sep 19 04:32:39.864851 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:39.864802    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5" podStartSLOduration=1.694567638 podStartE2EDuration="1.86478555s" totalImagesPullingTime="170.217912ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:32:39.863529627 +0000 UTC m=+1139.841726039" watchObservedRunningTime="2026-09-19 04:32:39.86478555 +0000 UTC m=+1139.842981940"
Sep 19 04:32:40.353728 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:40.353694    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:48.353302 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:48.353271    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:48.365800 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:48.365738    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:32:48.899579 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:32:48.899551    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5"
Sep 19 04:33:25.362865 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:25.362826    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:25.596403 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:25.596375    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:26.576157 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:26.576129    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:26.684161 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:26.684128    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:46.413536 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:46.413495    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:46.648838 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:46.648791    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:46.857863 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:46.857780    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:47.162818 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:47.162786    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:47.408608 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:47.408576    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:47.610130 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:47.610037    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:47.809775 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:47.809711    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:47.959357 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:47.959322    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:48.364241 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:48.364155    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:48.512671 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:48.512628    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-10388-5213e6"]
Sep 19 04:33:48.515937 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:48.515913    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10388-5213e6"
Sep 19 04:33:48.518422 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:48.518401    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6vmt9\""
Sep 19 04:33:48.522831 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:48.522801    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-10388-5213e6"]
Sep 19 04:33:48.691405 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:48.691365    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbjkw\" (UniqueName: \"kubernetes.io/projected/5234e574-a8b3-4f5d-a186-d3c55ffa8fcd-kube-api-access-mbjkw\") pod \"test-curl-10388-5213e6\" (UID: \"5234e574-a8b3-4f5d-a186-d3c55ffa8fcd\") " pod="opendatahub/test-curl-10388-5213e6"
Sep 19 04:33:48.792381 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:48.792342    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbjkw\" (UniqueName: \"kubernetes.io/projected/5234e574-a8b3-4f5d-a186-d3c55ffa8fcd-kube-api-access-mbjkw\") pod \"test-curl-10388-5213e6\" (UID: \"5234e574-a8b3-4f5d-a186-d3c55ffa8fcd\") " pod="opendatahub/test-curl-10388-5213e6"
Sep 19 04:33:48.805769 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:48.803908    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbjkw\" (UniqueName: \"kubernetes.io/projected/5234e574-a8b3-4f5d-a186-d3c55ffa8fcd-kube-api-access-mbjkw\") pod \"test-curl-10388-5213e6\" (UID: \"5234e574-a8b3-4f5d-a186-d3c55ffa8fcd\") " pod="opendatahub/test-curl-10388-5213e6"
Sep 19 04:33:48.826359 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:48.826320    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10388-5213e6"
Sep 19 04:33:49.106661 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:49.106636    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-10388-5213e6"]
Sep 19 04:33:49.108488 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:33:49.108460    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5234e574_a8b3_4f5d_a186_d3c55ffa8fcd.slice/crio-d6ccd64e41c5bc9c32035c514c9a1eb9adfc92300b0109986a684d91e0a01c52 WatchSource:0}: Error finding container d6ccd64e41c5bc9c32035c514c9a1eb9adfc92300b0109986a684d91e0a01c52: Status 404 returned error can't find the container with id d6ccd64e41c5bc9c32035c514c9a1eb9adfc92300b0109986a684d91e0a01c52
Sep 19 04:33:49.173595 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:49.173564    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-10388-5213e6" event={"ID":"5234e574-a8b3-4f5d-a186-d3c55ffa8fcd","Type":"ContainerStarted","Data":"d6ccd64e41c5bc9c32035c514c9a1eb9adfc92300b0109986a684d91e0a01c52"}
Sep 19 04:33:50.179770 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:50.179723    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-10388-5213e6" event={"ID":"5234e574-a8b3-4f5d-a186-d3c55ffa8fcd","Type":"ContainerStarted","Data":"f6ea1f5455701c9250c827d5fa0b75cae1fa0881d3c10ccb3c8f844255429c84"}
Sep 19 04:33:50.195785 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:50.195713    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-10388-5213e6" podStartSLOduration=1.2962039810000001 podStartE2EDuration="2.195695944s" totalImagesPullingTime="899.491963ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:33:50.19480521 +0000 UTC m=+1210.173001601" watchObservedRunningTime="2026-09-19 04:33:50.195695944 +0000 UTC m=+1210.173892333"
Sep 19 04:33:50.311436 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:50.311331    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:50.439448 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:50.439415    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:50.543357 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:50.543314    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:50.868395 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:50.868353    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-10388-5213e6"]
Sep 19 04:33:50.875601 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:50.875572    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-10388-5213e6"]
Sep 19 04:33:51.030878 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.030796    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-10388-fab034"]
Sep 19 04:33:51.031170 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.031155    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5234e574-a8b3-4f5d-a186-d3c55ffa8fcd" containerName="test-curl-10388-5213e6"
Sep 19 04:33:51.031217 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.031171    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5234e574-a8b3-4f5d-a186-d3c55ffa8fcd" containerName="test-curl-10388-5213e6"
Sep 19 04:33:51.031252 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.031240    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5234e574-a8b3-4f5d-a186-d3c55ffa8fcd" containerName="test-curl-10388-5213e6"
Sep 19 04:33:51.034245 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.034229    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10388-fab034"
Sep 19 04:33:51.043330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.043301    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-10388-fab034"]
Sep 19 04:33:51.185665 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:33:51.185630    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-10388-5213e6" container="test-curl-10388-5213e6"
Sep 19 04:33:51.217821 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.217793    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5zbs\" (UniqueName: \"kubernetes.io/projected/085a7e7c-4d0c-49c0-a038-8d9275dccc7b-kube-api-access-w5zbs\") pod \"test-curl-10388-fab034\" (UID: \"085a7e7c-4d0c-49c0-a038-8d9275dccc7b\") " pod="opendatahub/test-curl-10388-fab034"
Sep 19 04:33:51.318943 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.318866    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5zbs\" (UniqueName: \"kubernetes.io/projected/085a7e7c-4d0c-49c0-a038-8d9275dccc7b-kube-api-access-w5zbs\") pod \"test-curl-10388-fab034\" (UID: \"085a7e7c-4d0c-49c0-a038-8d9275dccc7b\") " pod="opendatahub/test-curl-10388-fab034"
Sep 19 04:33:51.327607 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.327578    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5zbs\" (UniqueName: \"kubernetes.io/projected/085a7e7c-4d0c-49c0-a038-8d9275dccc7b-kube-api-access-w5zbs\") pod \"test-curl-10388-fab034\" (UID: \"085a7e7c-4d0c-49c0-a038-8d9275dccc7b\") " pod="opendatahub/test-curl-10388-fab034"
Sep 19 04:33:51.344614 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.344579    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10388-fab034"
Sep 19 04:33:51.564787 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.564739    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"]
Sep 19 04:33:51.568534 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.568515    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:51.571152 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.571098    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-87e3e6-serving-cert\""
Sep 19 04:33:51.580770 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.580683    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"]
Sep 19 04:33:51.585902 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.585866    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:51.628199 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.628172    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-10388-fab034"]
Sep 19 04:33:51.628685 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:33:51.628659    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod085a7e7c_4d0c_49c0_a038_8d9275dccc7b.slice/crio-05f83758809de7bb7f7461c55b5ea0868e9de137d7fcad54723e540956b443f5 WatchSource:0}: Error finding container 05f83758809de7bb7f7461c55b5ea0868e9de137d7fcad54723e540956b443f5: Status 404 returned error can't find the container with id 05f83758809de7bb7f7461c55b5ea0868e9de137d7fcad54723e540956b443f5
Sep 19 04:33:51.669379 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.669351    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:51.722962 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.722937    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkpnf\" (UniqueName: \"kubernetes.io/projected/cbc30208-fb02-4fdd-8484-0dbac4b1d070-kube-api-access-nkpnf\") pod \"maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:51.723110 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.722973    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbc30208-fb02-4fdd-8484-0dbac4b1d070-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:51.723110 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.723039    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-maas-api-tls\") pod \"maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:51.723235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.723171    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-metrics-certs\") pod \"maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:51.823952 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.823863    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkpnf\" (UniqueName: \"kubernetes.io/projected/cbc30208-fb02-4fdd-8484-0dbac4b1d070-kube-api-access-nkpnf\") pod \"maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:51.823952 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.823901    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbc30208-fb02-4fdd-8484-0dbac4b1d070-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:51.823952 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.823928    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-maas-api-tls\") pod \"maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:51.824236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.824020    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-metrics-certs\") pod \"maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:51.824236 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:33:51.824075    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-serving-cert: secret "maas-api-e2e-worker-w0-87e3e6-serving-cert" not found
Sep 19 04:33:51.824236 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:33:51.824144    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-maas-api-tls podName:cbc30208-fb02-4fdd-8484-0dbac4b1d070 nodeName:}" failed. No retries permitted until 2026-09-19 04:33:52.324125106 +0000 UTC m=+1212.302321481 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-maas-api-tls") pod "maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm" (UID: "cbc30208-fb02-4fdd-8484-0dbac4b1d070") : secret "maas-api-e2e-worker-w0-87e3e6-serving-cert" not found
Sep 19 04:33:51.824610 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.824587    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbc30208-fb02-4fdd-8484-0dbac4b1d070-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:51.826523 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.826507    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-metrics-certs\") pod \"maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:51.836272 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.836249    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkpnf\" (UniqueName: \"kubernetes.io/projected/cbc30208-fb02-4fdd-8484-0dbac4b1d070-kube-api-access-nkpnf\") pod \"maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:51.970302 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:51.970264    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:52.192385 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:52.192344    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-10388-fab034" event={"ID":"085a7e7c-4d0c-49c0-a038-8d9275dccc7b","Type":"ContainerStarted","Data":"651db7f268042d197bcd365d66def18ae8a9825f75e28d19a6c7b9720512df29"}
Sep 19 04:33:52.192911 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:52.192396    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-10388-fab034" event={"ID":"085a7e7c-4d0c-49c0-a038-8d9275dccc7b","Type":"ContainerStarted","Data":"05f83758809de7bb7f7461c55b5ea0868e9de137d7fcad54723e540956b443f5"}
Sep 19 04:33:52.192911 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:52.192532    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-10388-5213e6" podUID="5234e574-a8b3-4f5d-a186-d3c55ffa8fcd" containerName="test-curl-10388-5213e6" containerID="cri-o://f6ea1f5455701c9250c827d5fa0b75cae1fa0881d3c10ccb3c8f844255429c84" gracePeriod=2
Sep 19 04:33:52.208085 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:52.208055    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:52.216144 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:52.216095    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-10388-fab034" podStartSLOduration=1.216078433 podStartE2EDuration="1.216078433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:33:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:33:52.215357722 +0000 UTC m=+1212.193554125" watchObservedRunningTime="2026-09-19 04:33:52.216078433 +0000 UTC m=+1212.194274822"
Sep 19 04:33:52.217624 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:33:52.217595    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-10388-5213e6\" is forbidden: User \"system:node:ip-10-0-130-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-52.ec2.internal' and this object" podUID="5234e574-a8b3-4f5d-a186-d3c55ffa8fcd" pod="opendatahub/test-curl-10388-5213e6"
Sep 19 04:33:52.303016 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:52.302986    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:52.329079 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:52.329042    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-maas-api-tls\") pod \"maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:52.331594 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:52.331572    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-maas-api-tls\") pod \"maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:52.480564 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:52.480471    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:52.777957 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:52.777930    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"]
Sep 19 04:33:52.882763 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:52.879607    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-10388-fab034"]
Sep 19 04:33:52.886362 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:52.886333    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-10388-fab034"]
Sep 19 04:33:52.943583 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:52.943546    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:53.197979 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.197935    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm" event={"ID":"cbc30208-fb02-4fdd-8484-0dbac4b1d070","Type":"ContainerStarted","Data":"c5edae4bd8f04e350464f62c317c7bc94b58727d7f985ea2995eeafcac3e19e4"}
Sep 19 04:33:53.198577 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:33:53.198212    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-10388-fab034" container="test-curl-10388-fab034"
Sep 19 04:33:53.417253 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.417210    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:53.713017 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.712980    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"]
Sep 19 04:33:53.713415 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.713401    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="085a7e7c-4d0c-49c0-a038-8d9275dccc7b" containerName="test-curl-10388-fab034"
Sep 19 04:33:53.713477 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.713416    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="085a7e7c-4d0c-49c0-a038-8d9275dccc7b" containerName="test-curl-10388-fab034"
Sep 19 04:33:53.713514 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.713479    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="085a7e7c-4d0c-49c0-a038-8d9275dccc7b" containerName="test-curl-10388-fab034"
Sep 19 04:33:53.716965 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.716943    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.720408 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.720385    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-a42681-openshift-default-dockercfg-xq24k\""
Sep 19 04:33:53.720408 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.720402    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 19 04:33:53.732985 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.732954    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"]
Sep 19 04:33:53.740451 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.740425    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-workload-certs\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.740603 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.740482    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-workload-socket\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.740603 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.740507    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-podinfo\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.740603 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.740531    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-token\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.740806 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.740611    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mpjc\" (UniqueName: \"kubernetes.io/projected/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-kube-api-access-2mpjc\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.740806 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.740650    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-envoy\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.740806 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.740711    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istiod-ca-cert\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.740806 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.740769    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-data\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.741022 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.740817    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-credential-socket\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.758577 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.758546    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:53.841919 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.841875    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mpjc\" (UniqueName: \"kubernetes.io/projected/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-kube-api-access-2mpjc\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.841919 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.841922    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-envoy\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.842189 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.841965    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istiod-ca-cert\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.842189 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.841990    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-data\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.842189 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.842034    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-credential-socket\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.842189 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.842077    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-workload-certs\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.842189 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.842137    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-workload-socket\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.842189 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.842160    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-podinfo\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.842491 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.842192    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-token\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.842659 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.842632    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-credential-socket\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.842734 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.842659    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-workload-certs\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.842965 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.842942    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-workload-socket\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.843191 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.843133    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-data\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.843271 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.843219    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istiod-ca-cert\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.845091 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.845073    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-envoy\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.845611 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.845590    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-podinfo\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.861197 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.861166    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-token\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:53.862675 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:53.862652    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mpjc\" (UniqueName: \"kubernetes.io/projected/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-kube-api-access-2mpjc\") pod \"e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") " pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:54.026800 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.026679    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:54.028467 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.028444    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:54.149584 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.149552    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:54.205470 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.205438    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm" event={"ID":"cbc30208-fb02-4fdd-8484-0dbac4b1d070","Type":"ContainerStarted","Data":"c44def5b2f747c503fea9e3688e2a7a0368076e00720dd18ad69f45d783483f9"}
Sep 19 04:33:54.206092 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.205570    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-10388-fab034" podUID="085a7e7c-4d0c-49c0-a038-8d9275dccc7b" containerName="test-curl-10388-fab034" containerID="cri-o://651db7f268042d197bcd365d66def18ae8a9825f75e28d19a6c7b9720512df29" gracePeriod=2
Sep 19 04:33:54.206092 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.205706    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:33:54.237854 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.237799    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm" podStartSLOduration=2.840720399 podStartE2EDuration="3.237781663s" totalImagesPullingTime="397.061264ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:33:54.236091564 +0000 UTC m=+1214.214287955" watchObservedRunningTime="2026-09-19 04:33:54.237781663 +0000 UTC m=+1214.215978044"
Sep 19 04:33:54.239972 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:33:54.239947    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-10388-fab034\" is forbidden: User \"system:node:ip-10-0-130-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-52.ec2.internal' and this object" podUID="085a7e7c-4d0c-49c0-a038-8d9275dccc7b" pod="opendatahub/test-curl-10388-fab034"
Sep 19 04:33:54.243705 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:33:54.243667    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-10388-fab034\" is forbidden: User \"system:node:ip-10-0-130-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-52.ec2.internal' and this object" podUID="085a7e7c-4d0c-49c0-a038-8d9275dccc7b" pod="opendatahub/test-curl-10388-fab034"
Sep 19 04:33:54.316671 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.316580    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"]
Sep 19 04:33:54.320505 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:33:54.320474    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae8aafc_bcaf_47b3_9c62_5d81c7b256aa.slice/crio-db758df652877e60964b2f3acfa24c3f3f9701f85afb8ddc1b340064db60fc01 WatchSource:0}: Error finding container db758df652877e60964b2f3acfa24c3f3f9701f85afb8ddc1b340064db60fc01: Status 404 returned error can't find the container with id db758df652877e60964b2f3acfa24c3f3f9701f85afb8ddc1b340064db60fc01
Sep 19 04:33:54.374090 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.374063    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:54.388417 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.388398    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10388-5213e6"
Sep 19 04:33:54.391122 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:33:54.391096    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-10388-fab034\" is forbidden: User \"system:node:ip-10-0-130-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-52.ec2.internal' and this object" podUID="085a7e7c-4d0c-49c0-a038-8d9275dccc7b" pod="opendatahub/test-curl-10388-fab034"
Sep 19 04:33:54.448570 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.448536    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbjkw\" (UniqueName: \"kubernetes.io/projected/5234e574-a8b3-4f5d-a186-d3c55ffa8fcd-kube-api-access-mbjkw\") pod \"5234e574-a8b3-4f5d-a186-d3c55ffa8fcd\" (UID: \"5234e574-a8b3-4f5d-a186-d3c55ffa8fcd\") "
Sep 19 04:33:54.450950 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.450923    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5234e574-a8b3-4f5d-a186-d3c55ffa8fcd-kube-api-access-mbjkw" (OuterVolumeSpecName: "kube-api-access-mbjkw") pod "5234e574-a8b3-4f5d-a186-d3c55ffa8fcd" (UID: "5234e574-a8b3-4f5d-a186-d3c55ffa8fcd"). InnerVolumeSpecName "kube-api-access-mbjkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:33:54.540865 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.540837    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5234e574-a8b3-4f5d-a186-d3c55ffa8fcd" path="/var/lib/kubelet/pods/5234e574-a8b3-4f5d-a186-d3c55ffa8fcd/volumes"
Sep 19 04:33:54.550017 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.549994    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbjkw\" (UniqueName: \"kubernetes.io/projected/5234e574-a8b3-4f5d-a186-d3c55ffa8fcd-kube-api-access-mbjkw\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:33:54.847671 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.847639    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:54.964882 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:54.964841    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:55.075813 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.075783    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"]
Sep 19 04:33:55.079400 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.079375    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"
Sep 19 04:33:55.082028 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.082008    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-d0f416\""
Sep 19 04:33:55.082203 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.082184    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-d0f416-dockercfg-g5rkk\""
Sep 19 04:33:55.100131 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.100059    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"]
Sep 19 04:33:55.154545 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.154504    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s99l5\" (UniqueName: \"kubernetes.io/projected/62527046-f698-49bf-925e-65c89bed12e7-kube-api-access-s99l5\") pod \"payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs\" (UID: \"62527046-f698-49bf-925e-65c89bed12e7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"
Sep 19 04:33:55.154717 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.154614    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62527046-f698-49bf-925e-65c89bed12e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs\" (UID: \"62527046-f698-49bf-925e-65c89bed12e7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"
Sep 19 04:33:55.213490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.213454    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" event={"ID":"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa","Type":"ContainerStarted","Data":"db758df652877e60964b2f3acfa24c3f3f9701f85afb8ddc1b340064db60fc01"}
Sep 19 04:33:55.215058 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.215029    2569 generic.go:356] "Generic (PLEG): container finished" podID="5234e574-a8b3-4f5d-a186-d3c55ffa8fcd" containerID="f6ea1f5455701c9250c827d5fa0b75cae1fa0881d3c10ccb3c8f844255429c84" exitCode=137
Sep 19 04:33:55.215204 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.215100    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10388-5213e6"
Sep 19 04:33:55.215204 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.215157    2569 scope.go:117] "RemoveContainer" containerID="f6ea1f5455701c9250c827d5fa0b75cae1fa0881d3c10ccb3c8f844255429c84"
Sep 19 04:33:55.237763 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.237727    2569 scope.go:117] "RemoveContainer" containerID="f6ea1f5455701c9250c827d5fa0b75cae1fa0881d3c10ccb3c8f844255429c84"
Sep 19 04:33:55.238086 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:33:55.238067    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6ea1f5455701c9250c827d5fa0b75cae1fa0881d3c10ccb3c8f844255429c84\": container with ID starting with f6ea1f5455701c9250c827d5fa0b75cae1fa0881d3c10ccb3c8f844255429c84 not found: ID does not exist" containerID="f6ea1f5455701c9250c827d5fa0b75cae1fa0881d3c10ccb3c8f844255429c84"
Sep 19 04:33:55.238169 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.238096    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6ea1f5455701c9250c827d5fa0b75cae1fa0881d3c10ccb3c8f844255429c84"} err="failed to get container status \"f6ea1f5455701c9250c827d5fa0b75cae1fa0881d3c10ccb3c8f844255429c84\": rpc error: code = NotFound desc = could not find container \"f6ea1f5455701c9250c827d5fa0b75cae1fa0881d3c10ccb3c8f844255429c84\": container with ID starting with f6ea1f5455701c9250c827d5fa0b75cae1fa0881d3c10ccb3c8f844255429c84 not found: ID does not exist"
Sep 19 04:33:55.255720 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.255699    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s99l5\" (UniqueName: \"kubernetes.io/projected/62527046-f698-49bf-925e-65c89bed12e7-kube-api-access-s99l5\") pod \"payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs\" (UID: \"62527046-f698-49bf-925e-65c89bed12e7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"
Sep 19 04:33:55.255839 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.255792    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62527046-f698-49bf-925e-65c89bed12e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs\" (UID: \"62527046-f698-49bf-925e-65c89bed12e7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"
Sep 19 04:33:55.256647 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.256626    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62527046-f698-49bf-925e-65c89bed12e7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs\" (UID: \"62527046-f698-49bf-925e-65c89bed12e7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"
Sep 19 04:33:55.269832 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.269813    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s99l5\" (UniqueName: \"kubernetes.io/projected/62527046-f698-49bf-925e-65c89bed12e7-kube-api-access-s99l5\") pod \"payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs\" (UID: \"62527046-f698-49bf-925e-65c89bed12e7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"
Sep 19 04:33:55.391961 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.391917    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"
Sep 19 04:33:55.670831 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.670716    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:55.698593 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:55.698570    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"]
Sep 19 04:33:55.700962 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:33:55.700936    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62527046_f698_49bf_925e_65c89bed12e7.slice/crio-90107d4a7e2bc59718d11b2f04615f267a6d5c81f81eb0231471056fc955ab99 WatchSource:0}: Error finding container 90107d4a7e2bc59718d11b2f04615f267a6d5c81f81eb0231471056fc955ab99: Status 404 returned error can't find the container with id 90107d4a7e2bc59718d11b2f04615f267a6d5c81f81eb0231471056fc955ab99
Sep 19 04:33:56.223105 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:56.223071    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs" event={"ID":"62527046-f698-49bf-925e-65c89bed12e7","Type":"ContainerStarted","Data":"90107d4a7e2bc59718d11b2f04615f267a6d5c81f81eb0231471056fc955ab99"}
Sep 19 04:33:56.838419 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:56.838386    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:33:56.838570 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:56.838456    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:33:56.838570 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:56.838481    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:33:56.915031 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:56.915009    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10388-fab034"
Sep 19 04:33:56.973557 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:56.973276    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5zbs\" (UniqueName: \"kubernetes.io/projected/085a7e7c-4d0c-49c0-a038-8d9275dccc7b-kube-api-access-w5zbs\") pod \"085a7e7c-4d0c-49c0-a038-8d9275dccc7b\" (UID: \"085a7e7c-4d0c-49c0-a038-8d9275dccc7b\") "
Sep 19 04:33:56.978017 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:56.977983    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/085a7e7c-4d0c-49c0-a038-8d9275dccc7b-kube-api-access-w5zbs" (OuterVolumeSpecName: "kube-api-access-w5zbs") pod "085a7e7c-4d0c-49c0-a038-8d9275dccc7b" (UID: "085a7e7c-4d0c-49c0-a038-8d9275dccc7b"). InnerVolumeSpecName "kube-api-access-w5zbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:33:57.046235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:57.046114    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:57.074742 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:57.074710    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5zbs\" (UniqueName: \"kubernetes.io/projected/085a7e7c-4d0c-49c0-a038-8d9275dccc7b-kube-api-access-w5zbs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:33:57.231578 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:57.231546    2569 generic.go:356] "Generic (PLEG): container finished" podID="085a7e7c-4d0c-49c0-a038-8d9275dccc7b" containerID="651db7f268042d197bcd365d66def18ae8a9825f75e28d19a6c7b9720512df29" exitCode=137
Sep 19 04:33:57.232077 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:57.231614    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10388-fab034"
Sep 19 04:33:57.232077 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:57.231667    2569 scope.go:117] "RemoveContainer" containerID="651db7f268042d197bcd365d66def18ae8a9825f75e28d19a6c7b9720512df29"
Sep 19 04:33:57.233953 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:57.233922    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" event={"ID":"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa","Type":"ContainerStarted","Data":"ae0bc765808519950e28c2133313cdd34c5a98205c6398332fd8f129a4fc470a"}
Sep 19 04:33:57.242566 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:57.242401    2569 scope.go:117] "RemoveContainer" containerID="651db7f268042d197bcd365d66def18ae8a9825f75e28d19a6c7b9720512df29"
Sep 19 04:33:57.242820 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:33:57.242790    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"651db7f268042d197bcd365d66def18ae8a9825f75e28d19a6c7b9720512df29\": container with ID starting with 651db7f268042d197bcd365d66def18ae8a9825f75e28d19a6c7b9720512df29 not found: ID does not exist" containerID="651db7f268042d197bcd365d66def18ae8a9825f75e28d19a6c7b9720512df29"
Sep 19 04:33:57.242925 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:57.242828    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"651db7f268042d197bcd365d66def18ae8a9825f75e28d19a6c7b9720512df29"} err="failed to get container status \"651db7f268042d197bcd365d66def18ae8a9825f75e28d19a6c7b9720512df29\": rpc error: code = NotFound desc = could not find container \"651db7f268042d197bcd365d66def18ae8a9825f75e28d19a6c7b9720512df29\": container with ID starting with 651db7f268042d197bcd365d66def18ae8a9825f75e28d19a6c7b9720512df29 not found: ID does not exist"
Sep 19 04:33:57.259629 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:57.259573    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" podStartSLOduration=1.744666782 podStartE2EDuration="4.25955331s" totalImagesPullingTime="2.514886528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:33:57.25655397 +0000 UTC m=+1217.234750355" watchObservedRunningTime="2026-09-19 04:33:57.25955331 +0000 UTC m=+1217.237749703"
Sep 19 04:33:57.262815 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:33:57.262776    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-10388-fab034\" is forbidden: User \"system:node:ip-10-0-130-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-52.ec2.internal' and this object" podUID="085a7e7c-4d0c-49c0-a038-8d9275dccc7b" pod="opendatahub/test-curl-10388-fab034"
Sep 19 04:33:57.682879 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:57.682841    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:57.782363 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:57.782320    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:57.959854 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:57.959769    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:58.029360 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:58.029330    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:58.034405 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:58.034383    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:58.036975 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:33:58.036949    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-10388-fab034\" is forbidden: User \"system:node:ip-10-0-130-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-52.ec2.internal' and this object" podUID="085a7e7c-4d0c-49c0-a038-8d9275dccc7b" pod="opendatahub/test-curl-10388-fab034"
Sep 19 04:33:58.241637 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:58.241529    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs" event={"ID":"62527046-f698-49bf-925e-65c89bed12e7","Type":"ContainerStarted","Data":"1d0e548b80dba6a52383ae09dca247e87a75d42619630ada7bd8570f5f71c0db"}
Sep 19 04:33:58.242056 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:58.241719    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"
Sep 19 04:33:58.242827 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:58.242796    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:58.244770 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:58.244724    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:33:58.270342 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:33:58.270301    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-10388-fab034\" is forbidden: User \"system:node:ip-10-0-130-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-52.ec2.internal' and this object" podUID="085a7e7c-4d0c-49c0-a038-8d9275dccc7b" pod="opendatahub/test-curl-10388-fab034"
Sep 19 04:33:58.270511 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:58.270291    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs" podStartSLOduration=1.301593693 podStartE2EDuration="3.270257644s" totalImagesPullingTime="1.968663951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:33:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:33:58.268147716 +0000 UTC m=+1218.246344105" watchObservedRunningTime="2026-09-19 04:33:58.270257644 +0000 UTC m=+1218.248454035"
Sep 19 04:33:58.272825 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:33:58.272791    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-10388-fab034\" is forbidden: User \"system:node:ip-10-0-130-52.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-52.ec2.internal' and this object" podUID="085a7e7c-4d0c-49c0-a038-8d9275dccc7b" pod="opendatahub/test-curl-10388-fab034"
Sep 19 04:33:58.296951 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:58.296915    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:58.539556 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:58.539456    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="085a7e7c-4d0c-49c0-a038-8d9275dccc7b" path="/var/lib/kubelet/pods/085a7e7c-4d0c-49c0-a038-8d9275dccc7b/volumes"
Sep 19 04:33:58.634495 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:58.634463    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:58.765490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:58.765446    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:59.185811 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:59.185743    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:59.304222 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:59.304188    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:33:59.785614 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:33:59.785578    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:00.220951 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:00.220922    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:34:00.697545 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:00.697512    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:01.550945 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.550912    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"]
Sep 19 04:34:01.557135 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.557107    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:01.560064 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.560040    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-a42681-serving-cert\""
Sep 19 04:34:01.569570 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.569542    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"]
Sep 19 04:34:01.593696 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.593662    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:01.621888 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.621859    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-maas-api-tls\") pod \"maas-api-e2e-autores-a42681-5564648559-wnfz6\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:01.622040 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.621892    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8g75\" (UniqueName: \"kubernetes.io/projected/e5a5171e-49d2-4a5e-8538-79cd92fab935-kube-api-access-b8g75\") pod \"maas-api-e2e-autores-a42681-5564648559-wnfz6\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:01.622040 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.622008    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5a5171e-49d2-4a5e-8538-79cd92fab935-openshift-service-ca\") pod \"maas-api-e2e-autores-a42681-5564648559-wnfz6\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:01.622118 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.622065    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-metrics-certs\") pod \"maas-api-e2e-autores-a42681-5564648559-wnfz6\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:01.673369 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.673318    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:01.723381 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.723352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-metrics-certs\") pod \"maas-api-e2e-autores-a42681-5564648559-wnfz6\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:01.723900 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.723411    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-maas-api-tls\") pod \"maas-api-e2e-autores-a42681-5564648559-wnfz6\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:01.723900 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.723437    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8g75\" (UniqueName: \"kubernetes.io/projected/e5a5171e-49d2-4a5e-8538-79cd92fab935-kube-api-access-b8g75\") pod \"maas-api-e2e-autores-a42681-5564648559-wnfz6\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:01.723900 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.723519    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5a5171e-49d2-4a5e-8538-79cd92fab935-openshift-service-ca\") pod \"maas-api-e2e-autores-a42681-5564648559-wnfz6\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:01.723900 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:34:01.723529    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-a42681-serving-cert: secret "maas-api-e2e-autores-a42681-serving-cert" not found
Sep 19 04:34:01.723900 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:34:01.723624    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-maas-api-tls podName:e5a5171e-49d2-4a5e-8538-79cd92fab935 nodeName:}" failed. No retries permitted until 2026-09-19 04:34:02.223585716 +0000 UTC m=+1222.201782084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-maas-api-tls") pod "maas-api-e2e-autores-a42681-5564648559-wnfz6" (UID: "e5a5171e-49d2-4a5e-8538-79cd92fab935") : secret "maas-api-e2e-autores-a42681-serving-cert" not found
Sep 19 04:34:01.724500 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.724478    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5a5171e-49d2-4a5e-8538-79cd92fab935-openshift-service-ca\") pod \"maas-api-e2e-autores-a42681-5564648559-wnfz6\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:01.726173 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.726148    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-metrics-certs\") pod \"maas-api-e2e-autores-a42681-5564648559-wnfz6\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:01.738467 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:01.738437    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8g75\" (UniqueName: \"kubernetes.io/projected/e5a5171e-49d2-4a5e-8538-79cd92fab935-kube-api-access-b8g75\") pod \"maas-api-e2e-autores-a42681-5564648559-wnfz6\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:02.119991 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.119944    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:02.229027 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.228991    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-maas-api-tls\") pod \"maas-api-e2e-autores-a42681-5564648559-wnfz6\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:02.231582 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.231554    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-maas-api-tls\") pod \"maas-api-e2e-autores-a42681-5564648559-wnfz6\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:02.280845 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.280814    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:02.383058 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.383024    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:02.470391 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.470362    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:02.481875 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.481841    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"]
Sep 19 04:34:02.485607 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.485582    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"
Sep 19 04:34:02.493920 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.493890    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-a42681-dockercfg-r2tqg\""
Sep 19 04:34:02.494414 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.494397    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-a42681\""
Sep 19 04:34:02.506283 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.506256    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"]
Sep 19 04:34:02.531202 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.531019    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jssb5\" (UniqueName: \"kubernetes.io/projected/581fb522-75eb-4519-a7f7-b000fa87b5ea-kube-api-access-jssb5\") pod \"payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9\" (UID: \"581fb522-75eb-4519-a7f7-b000fa87b5ea\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"
Sep 19 04:34:02.531202 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.531087    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/581fb522-75eb-4519-a7f7-b000fa87b5ea-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9\" (UID: \"581fb522-75eb-4519-a7f7-b000fa87b5ea\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"
Sep 19 04:34:02.632227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.632189    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jssb5\" (UniqueName: \"kubernetes.io/projected/581fb522-75eb-4519-a7f7-b000fa87b5ea-kube-api-access-jssb5\") pod \"payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9\" (UID: \"581fb522-75eb-4519-a7f7-b000fa87b5ea\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"
Sep 19 04:34:02.632441 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.632246    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/581fb522-75eb-4519-a7f7-b000fa87b5ea-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9\" (UID: \"581fb522-75eb-4519-a7f7-b000fa87b5ea\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"
Sep 19 04:34:02.633006 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.632988    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/581fb522-75eb-4519-a7f7-b000fa87b5ea-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9\" (UID: \"581fb522-75eb-4519-a7f7-b000fa87b5ea\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"
Sep 19 04:34:02.641919 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.641863    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jssb5\" (UniqueName: \"kubernetes.io/projected/581fb522-75eb-4519-a7f7-b000fa87b5ea-kube-api-access-jssb5\") pod \"payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9\" (UID: \"581fb522-75eb-4519-a7f7-b000fa87b5ea\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"
Sep 19 04:34:02.763475 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.763430    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"]
Sep 19 04:34:02.765935 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:34:02.765908    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a5171e_49d2_4a5e_8538_79cd92fab935.slice/crio-858cbe7f539803b2fa5e8f6bbc4920893510e2610711ccf1f1bde965bf5edfb0 WatchSource:0}: Error finding container 858cbe7f539803b2fa5e8f6bbc4920893510e2610711ccf1f1bde965bf5edfb0: Status 404 returned error can't find the container with id 858cbe7f539803b2fa5e8f6bbc4920893510e2610711ccf1f1bde965bf5edfb0
Sep 19 04:34:02.808988 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:02.808952    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"
Sep 19 04:34:03.007406 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:03.007310    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:03.100294 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:03.100271    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"]
Sep 19 04:34:03.102467 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:34:03.102432    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581fb522_75eb_4519_a7f7_b000fa87b5ea.slice/crio-e901671b3cf4f135ead5d94d219b139eac970e839fd07cd927d275a079a20f17 WatchSource:0}: Error finding container e901671b3cf4f135ead5d94d219b139eac970e839fd07cd927d275a079a20f17: Status 404 returned error can't find the container with id e901671b3cf4f135ead5d94d219b139eac970e839fd07cd927d275a079a20f17
Sep 19 04:34:03.271047 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:03.270958    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9" event={"ID":"581fb522-75eb-4519-a7f7-b000fa87b5ea","Type":"ContainerStarted","Data":"b87197fbb89c366fd698378b3ca8b476d5c59ac898ab3c2587c3ec81a6dc0c4e"}
Sep 19 04:34:03.271047 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:03.271019    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9" event={"ID":"581fb522-75eb-4519-a7f7-b000fa87b5ea","Type":"ContainerStarted","Data":"e901671b3cf4f135ead5d94d219b139eac970e839fd07cd927d275a079a20f17"}
Sep 19 04:34:03.271278 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:03.271144    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"
Sep 19 04:34:03.272655 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:03.272629    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6" event={"ID":"e5a5171e-49d2-4a5e-8538-79cd92fab935","Type":"ContainerStarted","Data":"02b0c2dc39a7d29b6a711f77838daed2caaa1ddde07b9383fab43a2b49c5b441"}
Sep 19 04:34:03.272824 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:03.272667    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6" event={"ID":"e5a5171e-49d2-4a5e-8538-79cd92fab935","Type":"ContainerStarted","Data":"858cbe7f539803b2fa5e8f6bbc4920893510e2610711ccf1f1bde965bf5edfb0"}
Sep 19 04:34:03.272824 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:03.272706    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:03.318071 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:03.318008    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9" podStartSLOduration=1.317988709 podStartE2EDuration="1.317988709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:34:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:03.316117632 +0000 UTC m=+1223.294314035" watchObservedRunningTime="2026-09-19 04:34:03.317988709 +0000 UTC m=+1223.296185104"
Sep 19 04:34:03.363807 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:03.363739    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6" podStartSLOduration=1.9786725440000001 podStartE2EDuration="2.363723115s" totalImagesPullingTime="385.050571ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:34:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:03.362925299 +0000 UTC m=+1223.341121688" watchObservedRunningTime="2026-09-19 04:34:03.363723115 +0000 UTC m=+1223.341919505"
Sep 19 04:34:03.403410 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:03.403351    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:03.549221 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:03.549140    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:04.154920 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:04.154881    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:04.396311 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:04.396273    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:05.180009 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:05.179971    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:05.698579 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:05.698517    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:05.920501 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:05.920459    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:07.043048 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:07.043014    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:08.198379 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:08.198351    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:08.299388 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:08.299356    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:08.488333 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:08.488237    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:08.984270 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:08.984241    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:09.084515 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.084478    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:09.166657 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.166625    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"]
Sep 19 04:34:09.170219 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.170204    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"
Sep 19 04:34:09.173011 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.172984    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-e8aaa06f\""
Sep 19 04:34:09.173147 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.173032    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-e8aaa06f-dockercfg-lw9jp\""
Sep 19 04:34:09.181506 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.181481    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"]
Sep 19 04:34:09.250408 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.250341    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"
Sep 19 04:34:09.285714 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.285686    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:34:09.293017 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.292980    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9f441f1-51a9-4b88-a606-debc740db0ea-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq\" (UID: \"a9f441f1-51a9-4b88-a606-debc740db0ea\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"
Sep 19 04:34:09.293160 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.293082    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkl7h\" (UniqueName: \"kubernetes.io/projected/a9f441f1-51a9-4b88-a606-debc740db0ea-kube-api-access-rkl7h\") pod \"payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq\" (UID: \"a9f441f1-51a9-4b88-a606-debc740db0ea\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"
Sep 19 04:34:09.394506 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.394476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9f441f1-51a9-4b88-a606-debc740db0ea-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq\" (UID: \"a9f441f1-51a9-4b88-a606-debc740db0ea\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"
Sep 19 04:34:09.394742 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.394719    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkl7h\" (UniqueName: \"kubernetes.io/projected/a9f441f1-51a9-4b88-a606-debc740db0ea-kube-api-access-rkl7h\") pod \"payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq\" (UID: \"a9f441f1-51a9-4b88-a606-debc740db0ea\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"
Sep 19 04:34:09.395333 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.395312    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9f441f1-51a9-4b88-a606-debc740db0ea-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq\" (UID: \"a9f441f1-51a9-4b88-a606-debc740db0ea\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"
Sep 19 04:34:09.403556 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.403523    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkl7h\" (UniqueName: \"kubernetes.io/projected/a9f441f1-51a9-4b88-a606-debc740db0ea-kube-api-access-rkl7h\") pod \"payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq\" (UID: \"a9f441f1-51a9-4b88-a606-debc740db0ea\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"
Sep 19 04:34:09.482673 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.482641    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"
Sep 19 04:34:09.517484 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.517400    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:09.623274 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.623242    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:09.766611 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.766584    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"]
Sep 19 04:34:09.768991 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:34:09.768929    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f441f1_51a9_4b88_a606_debc740db0ea.slice/crio-c9e730e585b51564a24e1aec6d85f1c1e411cbe19c2c5fea9736845e687fe25d WatchSource:0}: Error finding container c9e730e585b51564a24e1aec6d85f1c1e411cbe19c2c5fea9736845e687fe25d: Status 404 returned error can't find the container with id c9e730e585b51564a24e1aec6d85f1c1e411cbe19c2c5fea9736845e687fe25d
Sep 19 04:34:09.774423 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.774395    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:09.918306 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:09.918272    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:10.017837 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:10.017804    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:10.187981 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:10.187943    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:10.323624 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:10.323588    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq" event={"ID":"a9f441f1-51a9-4b88-a606-debc740db0ea","Type":"ContainerStarted","Data":"ab34f9dc477a1bfdbaff6213855ccbc0a30979df7d0a892606d3125edaad1a63"}
Sep 19 04:34:10.324034 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:10.323650    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq" event={"ID":"a9f441f1-51a9-4b88-a606-debc740db0ea","Type":"ContainerStarted","Data":"c9e730e585b51564a24e1aec6d85f1c1e411cbe19c2c5fea9736845e687fe25d"}
Sep 19 04:34:10.324034 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:10.323803    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"
Sep 19 04:34:10.346464 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:10.346414    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq" podStartSLOduration=1.3463973679999999 podStartE2EDuration="1.346397368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:34:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:10.344940113 +0000 UTC m=+1230.323136511" watchObservedRunningTime="2026-09-19 04:34:10.346397368 +0000 UTC m=+1230.324593758"
Sep 19 04:34:10.758491 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:10.758453    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:10.950229 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:10.950168    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:11.047500 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:11.047391    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:11.174435 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:11.174401    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:11.683810 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:11.683775    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:11.784675 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:11.784642    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:11.968835 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:11.968730    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"]
Sep 19 04:34:11.972575 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:11.972548    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"
Sep 19 04:34:11.976839 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:11.976811    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-bcbdad\""
Sep 19 04:34:11.978431 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:11.978407    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-bcbdad-dockercfg-9hvvj\""
Sep 19 04:34:11.986859 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:11.986835    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"]
Sep 19 04:34:12.122351 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:12.122315    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f3b4d07-6600-4a15-83e2-0b4dc0edc901-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg\" (UID: \"2f3b4d07-6600-4a15-83e2-0b4dc0edc901\") " pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"
Sep 19 04:34:12.122524 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:12.122363    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6lc7\" (UniqueName: \"kubernetes.io/projected/2f3b4d07-6600-4a15-83e2-0b4dc0edc901-kube-api-access-q6lc7\") pod \"payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg\" (UID: \"2f3b4d07-6600-4a15-83e2-0b4dc0edc901\") " pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"
Sep 19 04:34:12.204920 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:12.204883    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:12.223213 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:12.223142    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f3b4d07-6600-4a15-83e2-0b4dc0edc901-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg\" (UID: \"2f3b4d07-6600-4a15-83e2-0b4dc0edc901\") " pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"
Sep 19 04:34:12.223213 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:12.223201    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6lc7\" (UniqueName: \"kubernetes.io/projected/2f3b4d07-6600-4a15-83e2-0b4dc0edc901-kube-api-access-q6lc7\") pod \"payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg\" (UID: \"2f3b4d07-6600-4a15-83e2-0b4dc0edc901\") " pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"
Sep 19 04:34:12.224078 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:12.224059    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f3b4d07-6600-4a15-83e2-0b4dc0edc901-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg\" (UID: \"2f3b4d07-6600-4a15-83e2-0b4dc0edc901\") " pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"
Sep 19 04:34:12.232603 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:12.232574    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6lc7\" (UniqueName: \"kubernetes.io/projected/2f3b4d07-6600-4a15-83e2-0b4dc0edc901-kube-api-access-q6lc7\") pod \"payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg\" (UID: \"2f3b4d07-6600-4a15-83e2-0b4dc0edc901\") " pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"
Sep 19 04:34:12.284342 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:12.284311    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"
Sep 19 04:34:12.560079 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:12.560051    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"]
Sep 19 04:34:12.560231 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:12.560118    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:12.561919 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:34:12.561893    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3b4d07_6600_4a15_83e2_0b4dc0edc901.slice/crio-bc0033d9822e8311dc001aceae5cc2d41cfc8fae76b6f04d3719c49b5f4bcce2 WatchSource:0}: Error finding container bc0033d9822e8311dc001aceae5cc2d41cfc8fae76b6f04d3719c49b5f4bcce2: Status 404 returned error can't find the container with id bc0033d9822e8311dc001aceae5cc2d41cfc8fae76b6f04d3719c49b5f4bcce2
Sep 19 04:34:13.081512 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:13.081478    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:13.343327 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:13.343237    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg" event={"ID":"2f3b4d07-6600-4a15-83e2-0b4dc0edc901","Type":"ContainerStarted","Data":"4ce485b39680112990b9a4208697e5d1da0865e9d91eb140415646b80a8bee98"}
Sep 19 04:34:13.343327 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:13.343284    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg" event={"ID":"2f3b4d07-6600-4a15-83e2-0b4dc0edc901","Type":"ContainerStarted","Data":"bc0033d9822e8311dc001aceae5cc2d41cfc8fae76b6f04d3719c49b5f4bcce2"}
Sep 19 04:34:13.343327 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:13.343314    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"
Sep 19 04:34:13.367525 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:13.367477    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg" podStartSLOduration=2.367460907 podStartE2EDuration="2.367460907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:34:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:13.365401988 +0000 UTC m=+1233.343598378" watchObservedRunningTime="2026-09-19 04:34:13.367460907 +0000 UTC m=+1233.345657298"
Sep 19 04:34:14.018923 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:14.018889    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:14.222862 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:14.222832    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:14.281951 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:14.281870    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"
Sep 19 04:34:14.318057 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:14.318026    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:14.940642 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:14.940604    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:15.511770 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:15.508252    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:17.384767 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:17.384724    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:18.796223 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:18.796181    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:20.317583 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:20.317543    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:21.298502 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:21.298470    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:21.331320 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:21.331296    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"
Sep 19 04:34:22.391501 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:22.391456    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:23.204583 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:23.204536    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:23.599645 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:23.599556    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:23.904497 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:23.904459    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:24.314996 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.314920    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"]
Sep 19 04:34:24.319799 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.319783    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.331388 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.331371    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-6b1935-openshift-default-dockercfg-lsnmw\""
Sep 19 04:34:24.333718 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.333684    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:24.351900 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.351881    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"
Sep 19 04:34:24.415343 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.415307    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"]
Sep 19 04:34:24.447714 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.447682    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istiod-ca-cert\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.447919 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.447736    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-token\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.447919 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.447827    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-envoy\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.447919 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.447863    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-data\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.447919 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.447895    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-workload-socket\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.447919 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.447913    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-credential-socket\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.448174 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.447942    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2whw2\" (UniqueName: \"kubernetes.io/projected/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-kube-api-access-2whw2\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.448174 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.447975    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-podinfo\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.448174 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.448097    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-workload-certs\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.495814 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.495634    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:24.549304 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.549277    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istiod-ca-cert\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.549484 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.549332    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-token\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.549484 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.549379    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-envoy\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.549484 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.549409    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-data\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.549484 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.549448    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-workload-socket\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.549484 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.549469    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-credential-socket\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.549484 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.549485    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2whw2\" (UniqueName: \"kubernetes.io/projected/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-kube-api-access-2whw2\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.549856 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.549504    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-podinfo\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.549856 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.549564    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-workload-certs\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.549856 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.549765    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-data\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.550031 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.549991    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-credential-socket\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.550087 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.550035    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-workload-socket\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.550087 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.550073    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-workload-certs\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.550183 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.550125    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istiod-ca-cert\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.551942 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.551922    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-envoy\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.552070 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.552052    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-podinfo\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.565128 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.565069    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2whw2\" (UniqueName: \"kubernetes.io/projected/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-kube-api-access-2whw2\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.565693 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.565676    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-token\") pod \"e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") " pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.629740 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.629707    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:24.637166 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.637134    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:24.984191 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.984146    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"]
Sep 19 04:34:24.986704 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:34:24.986675    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08bffa0_d9fc_4fb6_8127_fd4d1b7bab98.slice/crio-4e74e91c7a436724b58cd70584bb08c5cdaf064b60d17f36e4d40c0cd0f16449 WatchSource:0}: Error finding container 4e74e91c7a436724b58cd70584bb08c5cdaf064b60d17f36e4d40c0cd0f16449: Status 404 returned error can't find the container with id 4e74e91c7a436724b58cd70584bb08c5cdaf064b60d17f36e4d40c0cd0f16449
Sep 19 04:34:24.989155 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.989125    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:24.989232 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.989185    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:24.989232 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:24.989214    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:25.400831 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:25.400804    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:25.421129 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:25.421090    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" event={"ID":"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98","Type":"ContainerStarted","Data":"9b21870edff444472be9e85e3b00d897687d828f2fdd81fa59c7fe1a00b9ccfe"}
Sep 19 04:34:25.421285 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:25.421148    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" event={"ID":"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98","Type":"ContainerStarted","Data":"4e74e91c7a436724b58cd70584bb08c5cdaf064b60d17f36e4d40c0cd0f16449"}
Sep 19 04:34:25.630254 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:25.630218    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:26.402612 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:26.402580    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:26.635304 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:26.635272    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:26.690344 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:26.685415    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" podStartSLOduration=2.685392745 podStartE2EDuration="2.685392745s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:25.465038542 +0000 UTC m=+1245.443234933" watchObservedRunningTime="2026-09-19 04:34:26.685392745 +0000 UTC m=+1246.663589136"
Sep 19 04:34:27.431436 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:27.431399    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:27.432344 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:27.432322    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:27.504919 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:27.504880    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:27.609726 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:27.609688    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:27.721567 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:27.721476    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:28.244741 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:28.244705    2569 patch_prober.go:28] interesting pod/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 19 04:34:28.244978 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:28.244783    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 19 04:34:28.431120 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:28.431080    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:28.437309 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:28.437282    2569 generic.go:356] "Generic (PLEG): container finished" podID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerID="ae0bc765808519950e28c2133313cdd34c5a98205c6398332fd8f129a4fc470a" exitCode=0
Sep 19 04:34:28.437459 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:28.437362    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" event={"ID":"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa","Type":"ContainerDied","Data":"ae0bc765808519950e28c2133313cdd34c5a98205c6398332fd8f129a4fc470a"}
Sep 19 04:34:28.437941 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:28.437924    2569 scope.go:117] "RemoveContainer" containerID="ae0bc765808519950e28c2133313cdd34c5a98205c6398332fd8f129a4fc470a"
Sep 19 04:34:28.438994 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:28.438966    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:28.439093 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:28.439046    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:28.439164 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:28.439096    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:29.171886 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:29.171849    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:29.445534 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:29.445447    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" event={"ID":"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa","Type":"ContainerStarted","Data":"4320fa64217f35dfad2bd70d07c2045468525ed62697054973fcf16c1dfe9c7f"}
Sep 19 04:34:30.029299 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:30.029244    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:34:30.029553 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:30.029528    2569 patch_prober.go:28] interesting pod/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 19 04:34:30.029607 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:30.029584    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 19 04:34:30.088684 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:30.088539    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:30.810659 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:30.810633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:31.029204 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:31.029170    2569 patch_prober.go:28] interesting pod/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 19 04:34:31.029385 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:31.029223    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 19 04:34:31.589895 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:31.589861    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:32.029162 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:32.029121    2569 patch_prober.go:28] interesting pod/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 19 04:34:32.029592 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:32.029196    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 19 04:34:32.520214 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:32.520159    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:32.613463 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:32.613428    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:32.757085 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:32.757043    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:33.029573 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.029533    2569 patch_prober.go:28] interesting pod/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 19 04:34:33.029985 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.029632    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 19 04:34:33.089286 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.089250    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:33.184293 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.184213    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:33.192668 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.192623    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"]
Sep 19 04:34:33.203541 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.203514    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"
Sep 19 04:34:33.206430 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.206413    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-6b1935\""
Sep 19 04:34:33.206829 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.206799    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-6b1935-dockercfg-6mst5\""
Sep 19 04:34:33.210289 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.210266    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"]
Sep 19 04:34:33.250594 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.250565    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b6a525f-ae12-4d27-8520-c801fa2bd975-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w\" (UID: \"2b6a525f-ae12-4d27-8520-c801fa2bd975\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"
Sep 19 04:34:33.250770 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.250720    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d7xm\" (UniqueName: \"kubernetes.io/projected/2b6a525f-ae12-4d27-8520-c801fa2bd975-kube-api-access-7d7xm\") pod \"payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w\" (UID: \"2b6a525f-ae12-4d27-8520-c801fa2bd975\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"
Sep 19 04:34:33.352111 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.352014    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d7xm\" (UniqueName: \"kubernetes.io/projected/2b6a525f-ae12-4d27-8520-c801fa2bd975-kube-api-access-7d7xm\") pod \"payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w\" (UID: \"2b6a525f-ae12-4d27-8520-c801fa2bd975\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"
Sep 19 04:34:33.352111 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.352075    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b6a525f-ae12-4d27-8520-c801fa2bd975-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w\" (UID: \"2b6a525f-ae12-4d27-8520-c801fa2bd975\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"
Sep 19 04:34:33.352873 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.352847    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b6a525f-ae12-4d27-8520-c801fa2bd975-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w\" (UID: \"2b6a525f-ae12-4d27-8520-c801fa2bd975\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"
Sep 19 04:34:33.361090 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.361068    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d7xm\" (UniqueName: \"kubernetes.io/projected/2b6a525f-ae12-4d27-8520-c801fa2bd975-kube-api-access-7d7xm\") pod \"payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w\" (UID: \"2b6a525f-ae12-4d27-8520-c801fa2bd975\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"
Sep 19 04:34:33.504057 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.504014    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:33.516649 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.516616    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"
Sep 19 04:34:33.800221 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:33.800183    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"]
Sep 19 04:34:33.800492 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:34:33.800461    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6a525f_ae12_4d27_8520_c801fa2bd975.slice/crio-a5ce58579925ca0ca633637ecb96450f17e525029d03b2cd1cd0122fb6784e94 WatchSource:0}: Error finding container a5ce58579925ca0ca633637ecb96450f17e525029d03b2cd1cd0122fb6784e94: Status 404 returned error can't find the container with id a5ce58579925ca0ca633637ecb96450f17e525029d03b2cd1cd0122fb6784e94
Sep 19 04:34:34.029720 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:34.029683    2569 patch_prober.go:28] interesting pod/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Sep 19 04:34:34.030124 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:34.029742    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Sep 19 04:34:34.473335 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:34.473304    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w" event={"ID":"2b6a525f-ae12-4d27-8520-c801fa2bd975","Type":"ContainerStarted","Data":"2a744ad1dd9c432f8018fbc109004ebce30572c2ee39c6dcbcf2fa401a201263"}
Sep 19 04:34:34.473551 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:34.473358    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"
Sep 19 04:34:34.473551 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:34.473382    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w" event={"ID":"2b6a525f-ae12-4d27-8520-c801fa2bd975","Type":"ContainerStarted","Data":"a5ce58579925ca0ca633637ecb96450f17e525029d03b2cd1cd0122fb6784e94"}
Sep 19 04:34:34.485345 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:34.485306    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:35.033334 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:35.033306    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:34:35.033730 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:35.033551    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:34:35.034239 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:35.034222    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:34:35.066268 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:35.066224    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w" podStartSLOduration=2.066207849 podStartE2EDuration="2.066207849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:34.499349559 +0000 UTC m=+1254.477545951" watchObservedRunningTime="2026-09-19 04:34:35.066207849 +0000 UTC m=+1255.044404238"
Sep 19 04:34:35.518135 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:35.518095    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:36.306386 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:36.306343    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:38.540129 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.540096    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"]
Sep 19 04:34:38.543648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.543633    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.547318 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.547296    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-87e3e6\"/\"openshift-service-ca.crt\""
Sep 19 04:34:38.547318 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.547320    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-87e3e6\"/\"simulator-w0-87e3e6-kserve-self-signed-certs\""
Sep 19 04:34:38.547498 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.547296    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-87e3e6\"/\"default-dockercfg-5pqd7\""
Sep 19 04:34:38.547498 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.547296    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-87e3e6\"/\"kube-root-ca.crt\""
Sep 19 04:34:38.551948 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.551930    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"]
Sep 19 04:34:38.607015 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.606986    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3509f8f9-4eca-4fe2-9702-652f14a81e54-tls-certs\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.607171 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.607035    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-model-cache\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.607171 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.607058    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-home\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.607171 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.607117    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chp4l\" (UniqueName: \"kubernetes.io/projected/3509f8f9-4eca-4fe2-9702-652f14a81e54-kube-api-access-chp4l\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.607171 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.607138    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-dshm\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.607331 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.607178    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-tmp-dir\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.681564 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.681531    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:38.708170 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.708138    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3509f8f9-4eca-4fe2-9702-652f14a81e54-tls-certs\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.708345 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.708187    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-model-cache\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.708345 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.708211    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-home\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.708469 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.708378    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chp4l\" (UniqueName: \"kubernetes.io/projected/3509f8f9-4eca-4fe2-9702-652f14a81e54-kube-api-access-chp4l\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.708469 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.708419    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-dshm\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.708469 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.708452    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-tmp-dir\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.708634 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.708612    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-model-cache\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.708634 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.708624    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-home\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.708863 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.708845    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-tmp-dir\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.710836 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.710816    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-dshm\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.711502 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.711472    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3509f8f9-4eca-4fe2-9702-652f14a81e54-tls-certs\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.717004 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.716980    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chp4l\" (UniqueName: \"kubernetes.io/projected/3509f8f9-4eca-4fe2-9702-652f14a81e54-kube-api-access-chp4l\") pod \"simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") " pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:38.777949 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.777921    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:38.854856 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:38.854768    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:39.118178 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.118073    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:39.133693 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.133667    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"]
Sep 19 04:34:39.136359 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:34:39.136317    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3509f8f9_4eca_4fe2_9702_652f14a81e54.slice/crio-e3887702b8fbc011e1bc2458aaa1d63e2b8e1a72eda79698f86578d863617095 WatchSource:0}: Error finding container e3887702b8fbc011e1bc2458aaa1d63e2b8e1a72eda79698f86578d863617095: Status 404 returned error can't find the container with id e3887702b8fbc011e1bc2458aaa1d63e2b8e1a72eda79698f86578d863617095
Sep 19 04:34:39.205179 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.205146    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:39.348964 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.348924    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:39.457879 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.457832    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:39.468910 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.468876    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"]
Sep 19 04:34:39.469156 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.469127    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq" podUID="a9f441f1-51a9-4b88-a606-debc740db0ea" containerName="payload-pre-processing" containerID="cri-o://ab34f9dc477a1bfdbaff6213855ccbc0a30979df7d0a892606d3125edaad1a63" gracePeriod=30
Sep 19 04:34:39.511177 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.511138    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn" event={"ID":"3509f8f9-4eca-4fe2-9702-652f14a81e54","Type":"ContainerStarted","Data":"b931d9488fbc146cf9f4593ac94b7d91a60e7b10932a060ff318e32ed208ea19"}
Sep 19 04:34:39.511347 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.511183    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn" event={"ID":"3509f8f9-4eca-4fe2-9702-652f14a81e54","Type":"ContainerStarted","Data":"e3887702b8fbc011e1bc2458aaa1d63e2b8e1a72eda79698f86578d863617095"}
Sep 19 04:34:39.535216 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.535163    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn" podStartSLOduration=1.5351475749999999 podStartE2EDuration="1.535147575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:34:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:39.532965025 +0000 UTC m=+1259.511161415" watchObservedRunningTime="2026-09-19 04:34:39.535147575 +0000 UTC m=+1259.513343965"
Sep 19 04:34:39.550570 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.550526    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:39.653982 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.652964    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:39.711819 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.711740    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"
Sep 19 04:34:39.796374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.796343    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:39.821360 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.821329    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rkl7h\" (UniqueName: \"kubernetes.io/projected/a9f441f1-51a9-4b88-a606-debc740db0ea-kube-api-access-rkl7h\") pod \"a9f441f1-51a9-4b88-a606-debc740db0ea\" (UID: \"a9f441f1-51a9-4b88-a606-debc740db0ea\") "
Sep 19 04:34:39.821498 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.821380    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9f441f1-51a9-4b88-a606-debc740db0ea-plugins-config-volume\") pod \"a9f441f1-51a9-4b88-a606-debc740db0ea\" (UID: \"a9f441f1-51a9-4b88-a606-debc740db0ea\") "
Sep 19 04:34:39.821781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.821726    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9f441f1-51a9-4b88-a606-debc740db0ea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a9f441f1-51a9-4b88-a606-debc740db0ea" (UID: "a9f441f1-51a9-4b88-a606-debc740db0ea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:34:39.824150 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.824126    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9f441f1-51a9-4b88-a606-debc740db0ea-kube-api-access-rkl7h" (OuterVolumeSpecName: "kube-api-access-rkl7h") pod "a9f441f1-51a9-4b88-a606-debc740db0ea" (UID: "a9f441f1-51a9-4b88-a606-debc740db0ea"). InnerVolumeSpecName "kube-api-access-rkl7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:34:39.854943 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.854915    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:39.922906 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.922868    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rkl7h\" (UniqueName: \"kubernetes.io/projected/a9f441f1-51a9-4b88-a606-debc740db0ea-kube-api-access-rkl7h\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:34:39.922906 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.922898    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9f441f1-51a9-4b88-a606-debc740db0ea-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:34:39.968799 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:39.968671    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:40.170859 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:40.170824    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:40.311043 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:40.310949    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:40.416699 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:40.416666    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:40.508983 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:40.508955    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:40.517814 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:40.517784    2569 generic.go:356] "Generic (PLEG): container finished" podID="a9f441f1-51a9-4b88-a606-debc740db0ea" containerID="ab34f9dc477a1bfdbaff6213855ccbc0a30979df7d0a892606d3125edaad1a63" exitCode=0
Sep 19 04:34:40.517961 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:40.517854    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"
Sep 19 04:34:40.517961 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:40.517879    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq" event={"ID":"a9f441f1-51a9-4b88-a606-debc740db0ea","Type":"ContainerDied","Data":"ab34f9dc477a1bfdbaff6213855ccbc0a30979df7d0a892606d3125edaad1a63"}
Sep 19 04:34:40.517961 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:40.517945    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq" event={"ID":"a9f441f1-51a9-4b88-a606-debc740db0ea","Type":"ContainerDied","Data":"c9e730e585b51564a24e1aec6d85f1c1e411cbe19c2c5fea9736845e687fe25d"}
Sep 19 04:34:40.518113 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:40.517968    2569 scope.go:117] "RemoveContainer" containerID="ab34f9dc477a1bfdbaff6213855ccbc0a30979df7d0a892606d3125edaad1a63"
Sep 19 04:34:40.527354 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:40.527324    2569 scope.go:117] "RemoveContainer" containerID="ab34f9dc477a1bfdbaff6213855ccbc0a30979df7d0a892606d3125edaad1a63"
Sep 19 04:34:40.527624 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:34:40.527604    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab34f9dc477a1bfdbaff6213855ccbc0a30979df7d0a892606d3125edaad1a63\": container with ID starting with ab34f9dc477a1bfdbaff6213855ccbc0a30979df7d0a892606d3125edaad1a63 not found: ID does not exist" containerID="ab34f9dc477a1bfdbaff6213855ccbc0a30979df7d0a892606d3125edaad1a63"
Sep 19 04:34:40.527693 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:40.527631    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab34f9dc477a1bfdbaff6213855ccbc0a30979df7d0a892606d3125edaad1a63"} err="failed to get container status \"ab34f9dc477a1bfdbaff6213855ccbc0a30979df7d0a892606d3125edaad1a63\": rpc error: code = NotFound desc = could not find container \"ab34f9dc477a1bfdbaff6213855ccbc0a30979df7d0a892606d3125edaad1a63\": container with ID starting with ab34f9dc477a1bfdbaff6213855ccbc0a30979df7d0a892606d3125edaad1a63 not found: ID does not exist"
Sep 19 04:34:40.544110 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:40.543995    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"]
Sep 19 04:34:40.550049 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:40.550026    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-e8aaa06f-7d57c657fd-6bblq"]
Sep 19 04:34:40.857674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:40.857645    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:41.023816 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:41.023784    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:41.184647 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:41.184612    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:41.963225 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:41.963195    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:42.539761 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:42.539727    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9f441f1-51a9-4b88-a606-debc740db0ea" path="/var/lib/kubelet/pods/a9f441f1-51a9-4b88-a606-debc740db0ea/volumes"
Sep 19 04:34:42.966436 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:42.966393    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:43.524717 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:43.524676    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:43.664660 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:43.664620    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:44.014425 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:44.014394    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:45.488424 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:45.488387    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"
Sep 19 04:34:46.093737 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:46.093702    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:47.141967 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:47.141930    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:47.262607 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:47.262573    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:47.353306 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:47.353266    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:47.594533 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:47.594421    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:47.702509 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:47.702478    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:47.786227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:47.786147    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:48.116653 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:48.116615    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:48.855374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:48.855345    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:48.867783 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:48.867761    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:48.964359 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:48.964324    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:49.431894 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:49.431856    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:49.544968 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:49.544925    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:49.606066 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:49.606031    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:34:49.652927 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:49.652890    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:49.838343 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:49.838258    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:50.187643 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:50.187582    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:51.143039 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:51.143010    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:51.997553 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:51.997519    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:52.902082 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:52.902047    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:53.867906 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:53.867872    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:54.905317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:54.905259    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:55.598190 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:55.598109    2569 generic.go:356] "Generic (PLEG): container finished" podID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerID="9b21870edff444472be9e85e3b00d897687d828f2fdd81fa59c7fe1a00b9ccfe" exitCode=0
Sep 19 04:34:55.598190 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:55.598145    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" event={"ID":"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98","Type":"ContainerDied","Data":"9b21870edff444472be9e85e3b00d897687d828f2fdd81fa59c7fe1a00b9ccfe"}
Sep 19 04:34:55.598526 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:55.598512    2569 scope.go:117] "RemoveContainer" containerID="9b21870edff444472be9e85e3b00d897687d828f2fdd81fa59c7fe1a00b9ccfe"
Sep 19 04:34:55.599600 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:55.599571    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:55.599687 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:55.599637    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:55.599687 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:55.599667    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:56.605098 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:56.605068    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" event={"ID":"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98","Type":"ContainerStarted","Data":"adca27e2dae765c0d206b2885a5ffcdcb1c973170b062b1347b6dbf2cb4c34a6"}
Sep 19 04:34:56.630412 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:56.630380    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:56.631622 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:56.631600    2569 patch_prober.go:28] interesting pod/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 19 04:34:56.631696 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:56.631654    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 19 04:34:56.805357 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:56.805321    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:57.010581 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:57.010541    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:57.097581 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:57.097546    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:34:57.431919 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:57.431885    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:34:57.630653 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:57.630616    2569 patch_prober.go:28] interesting pod/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 19 04:34:57.631105 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:57.630680    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 19 04:34:58.631005 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:58.630964    2569 patch_prober.go:28] interesting pod/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 19 04:34:58.631841 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:58.631019    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 19 04:34:59.630947 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:59.630916    2569 patch_prober.go:28] interesting pod/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 19 04:34:59.631134 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:34:59.630979    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 19 04:35:00.630855 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:00.630820    2569 patch_prober.go:28] interesting pod/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 19 04:35:00.631041 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:00.630879    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 19 04:35:01.630136 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:01.630099    2569 patch_prober.go:28] interesting pod/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 19 04:35:01.630565 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:01.630163    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 19 04:35:02.630165 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:02.630122    2569 patch_prober.go:28] interesting pod/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 19 04:35:02.630566 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:02.630184    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 19 04:35:03.634901 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:03.634871    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:35:03.636095 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:03.636075    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:35:08.105861 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:08.105830    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:09.502408 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:09.502375    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:10.300075 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:10.300033    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:11.065619 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:11.065578    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:11.792371 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:11.792333    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:12.655364 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:12.655338    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:13.371210 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:13.371170    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:14.386210 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:14.386178    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:15.355345 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:15.355310    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:16.419203 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:16.419147    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:17.164820 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:17.164782    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:18.141294 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:18.141265    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:18.995782 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:18.995736    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:19.707119 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:19.707073    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:24.844695 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:24.844655    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:25.791102 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:25.791069    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:25.883435 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:25.883403    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:25.982710 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:25.982673    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:26.064192 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:26.064117    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:26.192023 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:26.191983    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:26.477602 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:26.477569    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:26.642258 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:26.642224    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:26.989839 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:26.989805    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:27.157977 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:27.157942    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:27.361491 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:27.361398    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:28.065281 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:28.065244    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:29.097299 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:29.097267    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:29.741103 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:29.741066    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:29.832338 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:29.832304    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:30.063177 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:30.063074    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:30.867078 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:30.867039    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:31.708707 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:31.708667    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:31.810287 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:31.810255    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:32.068621 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.068531    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:32.175558 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.175519    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:32.275025 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.274986    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:32.313692 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.313664    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"]
Sep 19 04:35:32.314235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.314216    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9f441f1-51a9-4b88-a606-debc740db0ea" containerName="payload-pre-processing"
Sep 19 04:35:32.314353 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.314237    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9f441f1-51a9-4b88-a606-debc740db0ea" containerName="payload-pre-processing"
Sep 19 04:35:32.314353 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.314336    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9f441f1-51a9-4b88-a606-debc740db0ea" containerName="payload-pre-processing"
Sep 19 04:35:32.317781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.317762    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"
Sep 19 04:35:32.320697 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.320636    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-33718462\""
Sep 19 04:35:32.320851 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.320785    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-33718462-dockercfg-gnff7\""
Sep 19 04:35:32.332433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.332410    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"]
Sep 19 04:35:32.354535 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.354496    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmnpb\" (UniqueName: \"kubernetes.io/projected/bbf538cd-4f35-4e08-8c1b-4be8f0761413-kube-api-access-rmnpb\") pod \"payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn\" (UID: \"bbf538cd-4f35-4e08-8c1b-4be8f0761413\") " pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"
Sep 19 04:35:32.354683 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.354575    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbf538cd-4f35-4e08-8c1b-4be8f0761413-plugins-config-volume\") pod \"payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn\" (UID: \"bbf538cd-4f35-4e08-8c1b-4be8f0761413\") " pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"
Sep 19 04:35:32.455275 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.455242    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmnpb\" (UniqueName: \"kubernetes.io/projected/bbf538cd-4f35-4e08-8c1b-4be8f0761413-kube-api-access-rmnpb\") pod \"payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn\" (UID: \"bbf538cd-4f35-4e08-8c1b-4be8f0761413\") " pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"
Sep 19 04:35:32.455439 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.455290    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbf538cd-4f35-4e08-8c1b-4be8f0761413-plugins-config-volume\") pod \"payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn\" (UID: \"bbf538cd-4f35-4e08-8c1b-4be8f0761413\") " pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"
Sep 19 04:35:32.456006 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.455988    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbf538cd-4f35-4e08-8c1b-4be8f0761413-plugins-config-volume\") pod \"payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn\" (UID: \"bbf538cd-4f35-4e08-8c1b-4be8f0761413\") " pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"
Sep 19 04:35:32.466685 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.466659    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmnpb\" (UniqueName: \"kubernetes.io/projected/bbf538cd-4f35-4e08-8c1b-4be8f0761413-kube-api-access-rmnpb\") pod \"payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn\" (UID: \"bbf538cd-4f35-4e08-8c1b-4be8f0761413\") " pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"
Sep 19 04:35:32.628831 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.628798    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"
Sep 19 04:35:32.703164 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.703133    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:32.904937 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:32.904913    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"]
Sep 19 04:35:32.906672 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:35:32.906646    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf538cd_4f35_4e08_8c1b_4be8f0761413.slice/crio-bde3534d32ed973953a4aafaef63d00a54e880be8dd28d9d9019edd9c2bfb43f WatchSource:0}: Error finding container bde3534d32ed973953a4aafaef63d00a54e880be8dd28d9d9019edd9c2bfb43f: Status 404 returned error can't find the container with id bde3534d32ed973953a4aafaef63d00a54e880be8dd28d9d9019edd9c2bfb43f
Sep 19 04:35:33.438610 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:33.438573    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:33.802694 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:33.802594    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn" event={"ID":"bbf538cd-4f35-4e08-8c1b-4be8f0761413","Type":"ContainerStarted","Data":"f59218c617ccf7615e53e63b2bd04b9cb41b6eee2db39aff2971817b7640c735"}
Sep 19 04:35:33.802694 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:33.802642    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn" event={"ID":"bbf538cd-4f35-4e08-8c1b-4be8f0761413","Type":"ContainerStarted","Data":"bde3534d32ed973953a4aafaef63d00a54e880be8dd28d9d9019edd9c2bfb43f"}
Sep 19 04:35:33.802935 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:33.802696    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"
Sep 19 04:35:33.824829 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:33.824784    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn" podStartSLOduration=1.824739787 podStartE2EDuration="1.824739787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:35:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:35:33.822267229 +0000 UTC m=+1313.800463611" watchObservedRunningTime="2026-09-19 04:35:33.824739787 +0000 UTC m=+1313.802936174"
Sep 19 04:35:34.329345 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:34.329313    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:35.220115 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:35.220083    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:44.810680 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:44.810637    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"
Sep 19 04:35:46.879912 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:46.879874    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:54.105150 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:54.105116    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:54.947425 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:54.947387    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:56.346731 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:56.346696    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:57.357133 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:57.357095    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:58.309733 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:58.309697    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:59.197958 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:59.197927    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:35:59.917490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:35:59.917454    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:01.006283 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:01.006244    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:01.765398 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:01.765308    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:02.541490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.541457    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:02.570132 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.570097    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"]
Sep 19 04:36:02.570403 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.570366    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn" podUID="bbf538cd-4f35-4e08-8c1b-4be8f0761413" containerName="payload-processing" containerID="cri-o://f59218c617ccf7615e53e63b2bd04b9cb41b6eee2db39aff2971817b7640c735" gracePeriod=30
Sep 19 04:36:02.648088 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.648046    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:02.770716 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.770667    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:02.830065 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.830038    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"
Sep 19 04:36:02.865901 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.865661    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:02.956590 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.956564    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbf538cd-4f35-4e08-8c1b-4be8f0761413-plugins-config-volume\") pod \"bbf538cd-4f35-4e08-8c1b-4be8f0761413\" (UID: \"bbf538cd-4f35-4e08-8c1b-4be8f0761413\") "
Sep 19 04:36:02.956820 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.956724    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmnpb\" (UniqueName: \"kubernetes.io/projected/bbf538cd-4f35-4e08-8c1b-4be8f0761413-kube-api-access-rmnpb\") pod \"bbf538cd-4f35-4e08-8c1b-4be8f0761413\" (UID: \"bbf538cd-4f35-4e08-8c1b-4be8f0761413\") "
Sep 19 04:36:02.957039 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.957013    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbf538cd-4f35-4e08-8c1b-4be8f0761413-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bbf538cd-4f35-4e08-8c1b-4be8f0761413" (UID: "bbf538cd-4f35-4e08-8c1b-4be8f0761413"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:36:02.957886 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.957856    2569 generic.go:356] "Generic (PLEG): container finished" podID="bbf538cd-4f35-4e08-8c1b-4be8f0761413" containerID="f59218c617ccf7615e53e63b2bd04b9cb41b6eee2db39aff2971817b7640c735" exitCode=0
Sep 19 04:36:02.957991 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.957901    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"
Sep 19 04:36:02.957991 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.957934    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn" event={"ID":"bbf538cd-4f35-4e08-8c1b-4be8f0761413","Type":"ContainerDied","Data":"f59218c617ccf7615e53e63b2bd04b9cb41b6eee2db39aff2971817b7640c735"}
Sep 19 04:36:02.958105 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.957998    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn" event={"ID":"bbf538cd-4f35-4e08-8c1b-4be8f0761413","Type":"ContainerDied","Data":"bde3534d32ed973953a4aafaef63d00a54e880be8dd28d9d9019edd9c2bfb43f"}
Sep 19 04:36:02.958105 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.958032    2569 scope.go:117] "RemoveContainer" containerID="f59218c617ccf7615e53e63b2bd04b9cb41b6eee2db39aff2971817b7640c735"
Sep 19 04:36:02.959541 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.959520    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbf538cd-4f35-4e08-8c1b-4be8f0761413-kube-api-access-rmnpb" (OuterVolumeSpecName: "kube-api-access-rmnpb") pod "bbf538cd-4f35-4e08-8c1b-4be8f0761413" (UID: "bbf538cd-4f35-4e08-8c1b-4be8f0761413"). InnerVolumeSpecName "kube-api-access-rmnpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:36:02.972884 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.972860    2569 scope.go:117] "RemoveContainer" containerID="f59218c617ccf7615e53e63b2bd04b9cb41b6eee2db39aff2971817b7640c735"
Sep 19 04:36:02.973221 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:36:02.973200    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f59218c617ccf7615e53e63b2bd04b9cb41b6eee2db39aff2971817b7640c735\": container with ID starting with f59218c617ccf7615e53e63b2bd04b9cb41b6eee2db39aff2971817b7640c735 not found: ID does not exist" containerID="f59218c617ccf7615e53e63b2bd04b9cb41b6eee2db39aff2971817b7640c735"
Sep 19 04:36:02.973286 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:02.973234    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f59218c617ccf7615e53e63b2bd04b9cb41b6eee2db39aff2971817b7640c735"} err="failed to get container status \"f59218c617ccf7615e53e63b2bd04b9cb41b6eee2db39aff2971817b7640c735\": rpc error: code = NotFound desc = could not find container \"f59218c617ccf7615e53e63b2bd04b9cb41b6eee2db39aff2971817b7640c735\": container with ID starting with f59218c617ccf7615e53e63b2bd04b9cb41b6eee2db39aff2971817b7640c735 not found: ID does not exist"
Sep 19 04:36:03.062837 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:03.058130    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbf538cd-4f35-4e08-8c1b-4be8f0761413-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:36:03.062837 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:03.058171    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmnpb\" (UniqueName: \"kubernetes.io/projected/bbf538cd-4f35-4e08-8c1b-4be8f0761413-kube-api-access-rmnpb\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:36:03.199473 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:03.199439    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:03.284111 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:03.284074    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"]
Sep 19 04:36:03.298130 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:03.298096    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-33718462-59bbc8f647-gx5fn"]
Sep 19 04:36:04.003778 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:04.003736    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:04.141950 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:04.141914    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:04.519871 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:04.519841    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:04.539515 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:04.539483    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbf538cd-4f35-4e08-8c1b-4be8f0761413" path="/var/lib/kubelet/pods/bbf538cd-4f35-4e08-8c1b-4be8f0761413/volumes"
Sep 19 04:36:04.913980 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:04.913951    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:05.143645 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:05.143609    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:05.285052 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:05.284967    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:05.953246 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:05.953212    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:06.258335 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:06.258247    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:07.252602 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:07.252568    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:08.071346 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:08.071310    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:08.190596 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:08.190562    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:09.225924 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:09.225887    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:10.291110 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:10.291065    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:10.392291 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:10.392259    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:10.726855 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:10.726821    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:10.834196 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:10.834164    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:10.928898 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:10.928867    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:10.950611 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:10.950583    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"]
Sep 19 04:36:10.951100 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:10.951081    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbf538cd-4f35-4e08-8c1b-4be8f0761413" containerName="payload-processing"
Sep 19 04:36:10.951201 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:10.951102    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbf538cd-4f35-4e08-8c1b-4be8f0761413" containerName="payload-processing"
Sep 19 04:36:10.951258 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:10.951210    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbf538cd-4f35-4e08-8c1b-4be8f0761413" containerName="payload-processing"
Sep 19 04:36:10.954173 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:10.954152    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"
Sep 19 04:36:10.957056 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:10.957037    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-2a94cba7\""
Sep 19 04:36:10.957056 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:10.957052    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-2a94cba7-dockercfg-tkrlk\""
Sep 19 04:36:10.966606 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:10.966583    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"]
Sep 19 04:36:11.138496 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:11.138469    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm899\" (UniqueName: \"kubernetes.io/projected/bd1328df-acf7-48d0-abdb-c0b073774986-kube-api-access-zm899\") pod \"payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8\" (UID: \"bd1328df-acf7-48d0-abdb-c0b073774986\") " pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"
Sep 19 04:36:11.138665 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:11.138502    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1328df-acf7-48d0-abdb-c0b073774986-plugins-config-volume\") pod \"payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8\" (UID: \"bd1328df-acf7-48d0-abdb-c0b073774986\") " pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"
Sep 19 04:36:11.239255 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:11.239217    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm899\" (UniqueName: \"kubernetes.io/projected/bd1328df-acf7-48d0-abdb-c0b073774986-kube-api-access-zm899\") pod \"payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8\" (UID: \"bd1328df-acf7-48d0-abdb-c0b073774986\") " pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"
Sep 19 04:36:11.239255 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:11.239253    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1328df-acf7-48d0-abdb-c0b073774986-plugins-config-volume\") pod \"payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8\" (UID: \"bd1328df-acf7-48d0-abdb-c0b073774986\") " pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"
Sep 19 04:36:11.240261 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:11.240234    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1328df-acf7-48d0-abdb-c0b073774986-plugins-config-volume\") pod \"payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8\" (UID: \"bd1328df-acf7-48d0-abdb-c0b073774986\") " pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"
Sep 19 04:36:11.253464 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:11.253430    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm899\" (UniqueName: \"kubernetes.io/projected/bd1328df-acf7-48d0-abdb-c0b073774986-kube-api-access-zm899\") pod \"payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8\" (UID: \"bd1328df-acf7-48d0-abdb-c0b073774986\") " pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"
Sep 19 04:36:11.265160 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:11.265136    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"
Sep 19 04:36:11.335920 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:11.335859    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:11.539416 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:11.539255    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"]
Sep 19 04:36:11.542354 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:36:11.542324    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd1328df_acf7_48d0_abdb_c0b073774986.slice/crio-4532d73f9181b648f45ae961e09acd5b8dacb0cb158738ca422e4a81cbd62acf WatchSource:0}: Error finding container 4532d73f9181b648f45ae961e09acd5b8dacb0cb158738ca422e4a81cbd62acf: Status 404 returned error can't find the container with id 4532d73f9181b648f45ae961e09acd5b8dacb0cb158738ca422e4a81cbd62acf
Sep 19 04:36:12.013849 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:12.013815    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8" event={"ID":"bd1328df-acf7-48d0-abdb-c0b073774986","Type":"ContainerStarted","Data":"a07fdfeb1a80684491a82e53fc579836f555aaecd66bcdddac6e374f9ff6a2af"}
Sep 19 04:36:12.014073 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:12.013865    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8" event={"ID":"bd1328df-acf7-48d0-abdb-c0b073774986","Type":"ContainerStarted","Data":"4532d73f9181b648f45ae961e09acd5b8dacb0cb158738ca422e4a81cbd62acf"}
Sep 19 04:36:12.014073 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:12.013953    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"
Sep 19 04:36:12.036192 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:12.036138    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8" podStartSLOduration=2.036121513 podStartE2EDuration="2.036121513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:36:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:36:12.034160992 +0000 UTC m=+1352.012357383" watchObservedRunningTime="2026-09-19 04:36:12.036121513 +0000 UTC m=+1352.014317934"
Sep 19 04:36:12.111824 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:12.111793    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:13.183399 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:13.183364    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:13.891901 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:13.891866    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:23.029995 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:23.029960    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"
Sep 19 04:36:32.710140 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:32.710107    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:33.597879 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:33.597839    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:34.355562 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:34.355530    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:35.149307 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:35.149278    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:36.116449 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:36.116416    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:37.142987 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:37.142951    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:37.928892 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:37.928865    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:38.871252 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:38.871206    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:39.323113 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:39.323076    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:39.797328 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:39.797300    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:40.646942 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:40.646909    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:41.444575 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:41.444534    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:42.150802 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.150769    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:42.179391 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.179357    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"]
Sep 19 04:36:42.179672 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.179644    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8" podUID="bd1328df-acf7-48d0-abdb-c0b073774986" containerName="payload-processing" containerID="cri-o://a07fdfeb1a80684491a82e53fc579836f555aaecd66bcdddac6e374f9ff6a2af" gracePeriod=30
Sep 19 04:36:42.224227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.224192    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:42.328014 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.327977    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:42.425393 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.425362    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:42.446581 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.446556    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"
Sep 19 04:36:42.535812 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.535772    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:42.552915 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.552889    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm899\" (UniqueName: \"kubernetes.io/projected/bd1328df-acf7-48d0-abdb-c0b073774986-kube-api-access-zm899\") pod \"bd1328df-acf7-48d0-abdb-c0b073774986\" (UID: \"bd1328df-acf7-48d0-abdb-c0b073774986\") "
Sep 19 04:36:42.553059 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.552959    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1328df-acf7-48d0-abdb-c0b073774986-plugins-config-volume\") pod \"bd1328df-acf7-48d0-abdb-c0b073774986\" (UID: \"bd1328df-acf7-48d0-abdb-c0b073774986\") "
Sep 19 04:36:42.553339 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.553316    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd1328df-acf7-48d0-abdb-c0b073774986-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bd1328df-acf7-48d0-abdb-c0b073774986" (UID: "bd1328df-acf7-48d0-abdb-c0b073774986"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:36:42.555149 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.555128    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd1328df-acf7-48d0-abdb-c0b073774986-kube-api-access-zm899" (OuterVolumeSpecName: "kube-api-access-zm899") pod "bd1328df-acf7-48d0-abdb-c0b073774986" (UID: "bd1328df-acf7-48d0-abdb-c0b073774986"). InnerVolumeSpecName "kube-api-access-zm899". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:36:42.626800 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.626730    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:42.654114 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.654082    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd1328df-acf7-48d0-abdb-c0b073774986-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.654114 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:42.654112    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm899\" (UniqueName: \"kubernetes.io/projected/bd1328df-acf7-48d0-abdb-c0b073774986-kube-api-access-zm899\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:36:43.193869 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:43.193837    2569 generic.go:356] "Generic (PLEG): container finished" podID="bd1328df-acf7-48d0-abdb-c0b073774986" containerID="a07fdfeb1a80684491a82e53fc579836f555aaecd66bcdddac6e374f9ff6a2af" exitCode=0
Sep 19 04:36:43.194293 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:43.193887    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"
Sep 19 04:36:43.194293 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:43.193917    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8" event={"ID":"bd1328df-acf7-48d0-abdb-c0b073774986","Type":"ContainerDied","Data":"a07fdfeb1a80684491a82e53fc579836f555aaecd66bcdddac6e374f9ff6a2af"}
Sep 19 04:36:43.194293 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:43.193971    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8" event={"ID":"bd1328df-acf7-48d0-abdb-c0b073774986","Type":"ContainerDied","Data":"4532d73f9181b648f45ae961e09acd5b8dacb0cb158738ca422e4a81cbd62acf"}
Sep 19 04:36:43.194293 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:43.193994    2569 scope.go:117] "RemoveContainer" containerID="a07fdfeb1a80684491a82e53fc579836f555aaecd66bcdddac6e374f9ff6a2af"
Sep 19 04:36:43.203635 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:43.203611    2569 scope.go:117] "RemoveContainer" containerID="a07fdfeb1a80684491a82e53fc579836f555aaecd66bcdddac6e374f9ff6a2af"
Sep 19 04:36:43.203976 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:36:43.203952    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a07fdfeb1a80684491a82e53fc579836f555aaecd66bcdddac6e374f9ff6a2af\": container with ID starting with a07fdfeb1a80684491a82e53fc579836f555aaecd66bcdddac6e374f9ff6a2af not found: ID does not exist" containerID="a07fdfeb1a80684491a82e53fc579836f555aaecd66bcdddac6e374f9ff6a2af"
Sep 19 04:36:43.204056 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:43.203988    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a07fdfeb1a80684491a82e53fc579836f555aaecd66bcdddac6e374f9ff6a2af"} err="failed to get container status \"a07fdfeb1a80684491a82e53fc579836f555aaecd66bcdddac6e374f9ff6a2af\": rpc error: code = NotFound desc = could not find container \"a07fdfeb1a80684491a82e53fc579836f555aaecd66bcdddac6e374f9ff6a2af\": container with ID starting with a07fdfeb1a80684491a82e53fc579836f555aaecd66bcdddac6e374f9ff6a2af not found: ID does not exist"
Sep 19 04:36:43.223211 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:43.223190    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"]
Sep 19 04:36:43.231617 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:43.231595    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2a94cba7-57fd69cd49-67jb8"]
Sep 19 04:36:43.280112 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:43.280081    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:43.385639 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:43.385607    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:43.483523 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:43.483425    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:44.284878 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:44.284846    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:44.539949 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:44.539873    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd1328df-acf7-48d0-abdb-c0b073774986" path="/var/lib/kubelet/pods/bd1328df-acf7-48d0-abdb-c0b073774986/volumes"
Sep 19 04:36:44.940732 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:44.940693    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:45.110255 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:45.110219    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:45.864546 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:45.864513    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:46.723435 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:46.723403    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:47.805528 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:47.805481    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:49.015518 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:49.015477    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:49.831545 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:49.831514    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"]
Sep 19 04:36:49.831734 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:49.831710    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6" podUID="e5a5171e-49d2-4a5e-8538-79cd92fab935" containerName="maas-api" containerID="cri-o://02b0c2dc39a7d29b6a711f77838daed2caaa1ddde07b9383fab43a2b49c5b441" gracePeriod=30
Sep 19 04:36:49.863122 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:49.863094    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:49.912324 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:49.912268    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"]
Sep 19 04:36:49.913070 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:49.912535    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9" podUID="581fb522-75eb-4519-a7f7-b000fa87b5ea" containerName="payload-pre-processing" containerID="cri-o://b87197fbb89c366fd698378b3ca8b476d5c59ac898ab3c2587c3ec81a6dc0c4e" gracePeriod=30
Sep 19 04:36:49.960879 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:49.960847    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:50.057618 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.057575    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:50.160268 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.160225    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:50.171328 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.171308    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:36:50.194410 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.194387    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"
Sep 19 04:36:50.236789 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.235005    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jssb5\" (UniqueName: \"kubernetes.io/projected/581fb522-75eb-4519-a7f7-b000fa87b5ea-kube-api-access-jssb5\") pod \"581fb522-75eb-4519-a7f7-b000fa87b5ea\" (UID: \"581fb522-75eb-4519-a7f7-b000fa87b5ea\") "
Sep 19 04:36:50.236789 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.235063    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/581fb522-75eb-4519-a7f7-b000fa87b5ea-plugins-config-volume\") pod \"581fb522-75eb-4519-a7f7-b000fa87b5ea\" (UID: \"581fb522-75eb-4519-a7f7-b000fa87b5ea\") "
Sep 19 04:36:50.236789 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.235099    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5a5171e-49d2-4a5e-8538-79cd92fab935-openshift-service-ca\") pod \"e5a5171e-49d2-4a5e-8538-79cd92fab935\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") "
Sep 19 04:36:50.236789 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.235138    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-maas-api-tls\") pod \"e5a5171e-49d2-4a5e-8538-79cd92fab935\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") "
Sep 19 04:36:50.236789 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.235195    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8g75\" (UniqueName: \"kubernetes.io/projected/e5a5171e-49d2-4a5e-8538-79cd92fab935-kube-api-access-b8g75\") pod \"e5a5171e-49d2-4a5e-8538-79cd92fab935\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") "
Sep 19 04:36:50.236789 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.235231    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-metrics-certs\") pod \"e5a5171e-49d2-4a5e-8538-79cd92fab935\" (UID: \"e5a5171e-49d2-4a5e-8538-79cd92fab935\") "
Sep 19 04:36:50.236789 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.235741    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5a5171e-49d2-4a5e-8538-79cd92fab935-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e5a5171e-49d2-4a5e-8538-79cd92fab935" (UID: "e5a5171e-49d2-4a5e-8538-79cd92fab935"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:36:50.236789 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.236124    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/581fb522-75eb-4519-a7f7-b000fa87b5ea-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "581fb522-75eb-4519-a7f7-b000fa87b5ea" (UID: "581fb522-75eb-4519-a7f7-b000fa87b5ea"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:36:50.238324 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.238290    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e5a5171e-49d2-4a5e-8538-79cd92fab935" (UID: "e5a5171e-49d2-4a5e-8538-79cd92fab935"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:36:50.238705 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.238671    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/581fb522-75eb-4519-a7f7-b000fa87b5ea-kube-api-access-jssb5" (OuterVolumeSpecName: "kube-api-access-jssb5") pod "581fb522-75eb-4519-a7f7-b000fa87b5ea" (UID: "581fb522-75eb-4519-a7f7-b000fa87b5ea"). InnerVolumeSpecName "kube-api-access-jssb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:36:50.238828 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.238735    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e5a5171e-49d2-4a5e-8538-79cd92fab935" (UID: "e5a5171e-49d2-4a5e-8538-79cd92fab935"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:36:50.238828 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.238743    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5a5171e-49d2-4a5e-8538-79cd92fab935-kube-api-access-b8g75" (OuterVolumeSpecName: "kube-api-access-b8g75") pod "e5a5171e-49d2-4a5e-8538-79cd92fab935" (UID: "e5a5171e-49d2-4a5e-8538-79cd92fab935"). InnerVolumeSpecName "kube-api-access-b8g75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:36:50.243677 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.243650    2569 generic.go:356] "Generic (PLEG): container finished" podID="e5a5171e-49d2-4a5e-8538-79cd92fab935" containerID="02b0c2dc39a7d29b6a711f77838daed2caaa1ddde07b9383fab43a2b49c5b441" exitCode=0
Sep 19 04:36:50.243825 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.243763    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"
Sep 19 04:36:50.243825 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.243785    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6" event={"ID":"e5a5171e-49d2-4a5e-8538-79cd92fab935","Type":"ContainerDied","Data":"02b0c2dc39a7d29b6a711f77838daed2caaa1ddde07b9383fab43a2b49c5b441"}
Sep 19 04:36:50.243954 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.243838    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6" event={"ID":"e5a5171e-49d2-4a5e-8538-79cd92fab935","Type":"ContainerDied","Data":"858cbe7f539803b2fa5e8f6bbc4920893510e2610711ccf1f1bde965bf5edfb0"}
Sep 19 04:36:50.243954 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.243868    2569 scope.go:117] "RemoveContainer" containerID="02b0c2dc39a7d29b6a711f77838daed2caaa1ddde07b9383fab43a2b49c5b441"
Sep 19 04:36:50.245644 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.245617    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"
Sep 19 04:36:50.245733 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.245684    2569 generic.go:356] "Generic (PLEG): container finished" podID="581fb522-75eb-4519-a7f7-b000fa87b5ea" containerID="b87197fbb89c366fd698378b3ca8b476d5c59ac898ab3c2587c3ec81a6dc0c4e" exitCode=0
Sep 19 04:36:50.245733 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.245690    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9" event={"ID":"581fb522-75eb-4519-a7f7-b000fa87b5ea","Type":"ContainerDied","Data":"b87197fbb89c366fd698378b3ca8b476d5c59ac898ab3c2587c3ec81a6dc0c4e"}
Sep 19 04:36:50.245912 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.245764    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9" event={"ID":"581fb522-75eb-4519-a7f7-b000fa87b5ea","Type":"ContainerDied","Data":"e901671b3cf4f135ead5d94d219b139eac970e839fd07cd927d275a079a20f17"}
Sep 19 04:36:50.253698 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.253678    2569 scope.go:117] "RemoveContainer" containerID="02b0c2dc39a7d29b6a711f77838daed2caaa1ddde07b9383fab43a2b49c5b441"
Sep 19 04:36:50.254034 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:36:50.254014    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02b0c2dc39a7d29b6a711f77838daed2caaa1ddde07b9383fab43a2b49c5b441\": container with ID starting with 02b0c2dc39a7d29b6a711f77838daed2caaa1ddde07b9383fab43a2b49c5b441 not found: ID does not exist" containerID="02b0c2dc39a7d29b6a711f77838daed2caaa1ddde07b9383fab43a2b49c5b441"
Sep 19 04:36:50.254134 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.254042    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02b0c2dc39a7d29b6a711f77838daed2caaa1ddde07b9383fab43a2b49c5b441"} err="failed to get container status \"02b0c2dc39a7d29b6a711f77838daed2caaa1ddde07b9383fab43a2b49c5b441\": rpc error: code = NotFound desc = could not find container \"02b0c2dc39a7d29b6a711f77838daed2caaa1ddde07b9383fab43a2b49c5b441\": container with ID starting with 02b0c2dc39a7d29b6a711f77838daed2caaa1ddde07b9383fab43a2b49c5b441 not found: ID does not exist"
Sep 19 04:36:50.254134 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.254064    2569 scope.go:117] "RemoveContainer" containerID="b87197fbb89c366fd698378b3ca8b476d5c59ac898ab3c2587c3ec81a6dc0c4e"
Sep 19 04:36:50.262656 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.262624    2569 scope.go:117] "RemoveContainer" containerID="b87197fbb89c366fd698378b3ca8b476d5c59ac898ab3c2587c3ec81a6dc0c4e"
Sep 19 04:36:50.262995 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:36:50.262978    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b87197fbb89c366fd698378b3ca8b476d5c59ac898ab3c2587c3ec81a6dc0c4e\": container with ID starting with b87197fbb89c366fd698378b3ca8b476d5c59ac898ab3c2587c3ec81a6dc0c4e not found: ID does not exist" containerID="b87197fbb89c366fd698378b3ca8b476d5c59ac898ab3c2587c3ec81a6dc0c4e"
Sep 19 04:36:50.263063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.263001    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b87197fbb89c366fd698378b3ca8b476d5c59ac898ab3c2587c3ec81a6dc0c4e"} err="failed to get container status \"b87197fbb89c366fd698378b3ca8b476d5c59ac898ab3c2587c3ec81a6dc0c4e\": rpc error: code = NotFound desc = could not find container \"b87197fbb89c366fd698378b3ca8b476d5c59ac898ab3c2587c3ec81a6dc0c4e\": container with ID starting with b87197fbb89c366fd698378b3ca8b476d5c59ac898ab3c2587c3ec81a6dc0c4e not found: ID does not exist"
Sep 19 04:36:50.274948 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.274928    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"]
Sep 19 04:36:50.280417 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.280396    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a42681-5564648559-wnfz6"]
Sep 19 04:36:50.292815 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.292788    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"]
Sep 19 04:36:50.299078 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.299059    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-a42681-5f6656b6db-6xmz9"]
Sep 19 04:36:50.336472 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.336441    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8g75\" (UniqueName: \"kubernetes.io/projected/e5a5171e-49d2-4a5e-8538-79cd92fab935-kube-api-access-b8g75\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:36:50.336472 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.336467    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-metrics-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:36:50.336472 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.336478    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jssb5\" (UniqueName: \"kubernetes.io/projected/581fb522-75eb-4519-a7f7-b000fa87b5ea-kube-api-access-jssb5\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:36:50.336684 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.336486    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/581fb522-75eb-4519-a7f7-b000fa87b5ea-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:36:50.336684 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.336494    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5a5171e-49d2-4a5e-8538-79cd92fab935-openshift-service-ca\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:36:50.336684 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.336501    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e5a5171e-49d2-4a5e-8538-79cd92fab935-maas-api-tls\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:36:50.495387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.495358    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:50.539734 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.539707    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="581fb522-75eb-4519-a7f7-b000fa87b5ea" path="/var/lib/kubelet/pods/581fb522-75eb-4519-a7f7-b000fa87b5ea/volumes"
Sep 19 04:36:50.540120 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.540105    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5a5171e-49d2-4a5e-8538-79cd92fab935" path="/var/lib/kubelet/pods/e5a5171e-49d2-4a5e-8538-79cd92fab935/volumes"
Sep 19 04:36:50.590299 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:50.590270    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:51.444422 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:51.444385    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:52.049254 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:52.049210    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:52.145866 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:52.145827    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:52.245137 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:52.245098    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:52.343533 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:52.343438    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:52.548148 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:52.548111    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:52.810798 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:52.810735    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:53.551579 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:53.551550    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:54.384687 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:54.384649    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:55.521667 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:55.521634    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:36:58.186252 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:36:58.186216    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:14.961052 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:14.961017    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:16.048122 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:16.048087    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:16.493203 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:16.493170    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:16.595276 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:16.595240    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:17.109394 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:17.109357    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:18.165338 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:18.165301    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:18.800390 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:18.800343    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:19.127466 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:19.127434    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:19.989739 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:19.989696    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:20.844509 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:20.844468    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:21.130026 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:21.129977    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:25.034132 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:25.034097    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:25.142556 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:25.142507    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:25.251043 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:25.251006    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:26.872539 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:26.872490    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:26.915864 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:26.915830    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"]
Sep 19 04:37:26.916124 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:26.916079    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs" podUID="62527046-f698-49bf-925e-65c89bed12e7" containerName="payload-pre-processing" containerID="cri-o://1d0e548b80dba6a52383ae09dca247e87a75d42619630ada7bd8570f5f71c0db" gracePeriod=30
Sep 19 04:37:26.968658 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:26.968624    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:27.067254 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.067219    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:27.167799 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.167723    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:27.175441 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.175423    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"
Sep 19 04:37:27.205529 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.205501    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s99l5\" (UniqueName: \"kubernetes.io/projected/62527046-f698-49bf-925e-65c89bed12e7-kube-api-access-s99l5\") pod \"62527046-f698-49bf-925e-65c89bed12e7\" (UID: \"62527046-f698-49bf-925e-65c89bed12e7\") "
Sep 19 04:37:27.205692 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.205579    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62527046-f698-49bf-925e-65c89bed12e7-plugins-config-volume\") pod \"62527046-f698-49bf-925e-65c89bed12e7\" (UID: \"62527046-f698-49bf-925e-65c89bed12e7\") "
Sep 19 04:37:27.205995 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.205973    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62527046-f698-49bf-925e-65c89bed12e7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "62527046-f698-49bf-925e-65c89bed12e7" (UID: "62527046-f698-49bf-925e-65c89bed12e7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:37:27.207891 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.207866    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62527046-f698-49bf-925e-65c89bed12e7-kube-api-access-s99l5" (OuterVolumeSpecName: "kube-api-access-s99l5") pod "62527046-f698-49bf-925e-65c89bed12e7" (UID: "62527046-f698-49bf-925e-65c89bed12e7"). InnerVolumeSpecName "kube-api-access-s99l5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:37:27.307025 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.306990    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62527046-f698-49bf-925e-65c89bed12e7-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:37:27.307025 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.307018    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s99l5\" (UniqueName: \"kubernetes.io/projected/62527046-f698-49bf-925e-65c89bed12e7-kube-api-access-s99l5\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:37:27.442493 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.442393    2569 generic.go:356] "Generic (PLEG): container finished" podID="62527046-f698-49bf-925e-65c89bed12e7" containerID="1d0e548b80dba6a52383ae09dca247e87a75d42619630ada7bd8570f5f71c0db" exitCode=0
Sep 19 04:37:27.442493 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.442433    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"
Sep 19 04:37:27.442493 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.442481    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs" event={"ID":"62527046-f698-49bf-925e-65c89bed12e7","Type":"ContainerDied","Data":"1d0e548b80dba6a52383ae09dca247e87a75d42619630ada7bd8570f5f71c0db"}
Sep 19 04:37:27.442765 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.442539    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs" event={"ID":"62527046-f698-49bf-925e-65c89bed12e7","Type":"ContainerDied","Data":"90107d4a7e2bc59718d11b2f04615f267a6d5c81f81eb0231471056fc955ab99"}
Sep 19 04:37:27.442765 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.442561    2569 scope.go:117] "RemoveContainer" containerID="1d0e548b80dba6a52383ae09dca247e87a75d42619630ada7bd8570f5f71c0db"
Sep 19 04:37:27.451990 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.451974    2569 scope.go:117] "RemoveContainer" containerID="1d0e548b80dba6a52383ae09dca247e87a75d42619630ada7bd8570f5f71c0db"
Sep 19 04:37:27.452250 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:37:27.452231    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d0e548b80dba6a52383ae09dca247e87a75d42619630ada7bd8570f5f71c0db\": container with ID starting with 1d0e548b80dba6a52383ae09dca247e87a75d42619630ada7bd8570f5f71c0db not found: ID does not exist" containerID="1d0e548b80dba6a52383ae09dca247e87a75d42619630ada7bd8570f5f71c0db"
Sep 19 04:37:27.452322 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.452263    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d0e548b80dba6a52383ae09dca247e87a75d42619630ada7bd8570f5f71c0db"} err="failed to get container status \"1d0e548b80dba6a52383ae09dca247e87a75d42619630ada7bd8570f5f71c0db\": rpc error: code = NotFound desc = could not find container \"1d0e548b80dba6a52383ae09dca247e87a75d42619630ada7bd8570f5f71c0db\": container with ID starting with 1d0e548b80dba6a52383ae09dca247e87a75d42619630ada7bd8570f5f71c0db not found: ID does not exist"
Sep 19 04:37:27.475039 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.475013    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"]
Sep 19 04:37:27.485345 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.485320    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-d0f416-5fd4989bcd-td8rs"]
Sep 19 04:37:27.485493 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.485473    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:27.655391 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:27.655353    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:28.539757 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:28.539725    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62527046-f698-49bf-925e-65c89bed12e7" path="/var/lib/kubelet/pods/62527046-f698-49bf-925e-65c89bed12e7/volumes"
Sep 19 04:37:28.595220 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:28.595189    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:29.358864 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:29.358827    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:30.102583 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:30.102528    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:31.729594 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:31.729506    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:33.066728 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:33.066694    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:33.561533 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:33.561495    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:33.662604 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:33.662567    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:33.843022 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:33.842933    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:35.000155 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:35.000123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:41.071265 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:41.071227    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:41.402150 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:41.402115    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:41.472875 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:41.472841    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:47.692978 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:47.692941    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:47.798829 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:47.798797    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:47.965937 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:47.965851    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:49.307373 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:49.307336    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:49.407798 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:49.407731    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:49.580500 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:49.580422    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"]
Sep 19 04:37:49.580655 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:49.580615    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerName="istio-proxy" containerID="cri-o://4320fa64217f35dfad2bd70d07c2045468525ed62697054973fcf16c1dfe9c7f" gracePeriod=30
Sep 19 04:37:49.630804 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:49.630741    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:50.036379 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:50.036332    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:50.036626 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:50.036603    2569 patch_prober.go:28] interesting pod/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 04:37:50.036724 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:50.036697    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 04:37:50.380581 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:50.380541    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:50.854623 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:50.854534    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:53.111704 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:53.111669    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:53.980705 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:53.980669    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:54.070196 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.070166    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:54.826697 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.826673    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:37:54.870979 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.870912    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-workload-certs\") pod \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") "
Sep 19 04:37:54.870979 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.870968    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-workload-socket\") pod \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") "
Sep 19 04:37:54.871216 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.871000    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-podinfo\") pod \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") "
Sep 19 04:37:54.871216 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.871048    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mpjc\" (UniqueName: \"kubernetes.io/projected/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-kube-api-access-2mpjc\") pod \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") "
Sep 19 04:37:54.871216 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.871074    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istiod-ca-cert\") pod \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") "
Sep 19 04:37:54.871216 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.871118    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-credential-socket\") pod \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") "
Sep 19 04:37:54.871216 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.871145    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-token\") pod \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") "
Sep 19 04:37:54.871216 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.871174    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" (UID: "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:37:54.871661 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.871181    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-envoy\") pod \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") "
Sep 19 04:37:54.871661 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.871266    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" (UID: "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:37:54.871661 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.871286    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-data\") pod \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\" (UID: \"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa\") "
Sep 19 04:37:54.871661 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.871605    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-workload-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:37:54.871661 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.871625    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-workload-socket\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:37:54.871955 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.871704    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" (UID: "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:37:54.871955 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.871815    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-data" (OuterVolumeSpecName: "istio-data") pod "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" (UID: "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:37:54.871955 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.871890    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" (UID: "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:37:54.873782 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.873700    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" (UID: "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:37:54.873970 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.873947    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" (UID: "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:37:54.874034 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.874020    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-token" (OuterVolumeSpecName: "istio-token") pod "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" (UID: "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:37:54.874216 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.874181    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-kube-api-access-2mpjc" (OuterVolumeSpecName: "kube-api-access-2mpjc") pod "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" (UID: "bae8aafc-bcaf-47b3-9c62-5d81c7b256aa"). InnerVolumeSpecName "kube-api-access-2mpjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:37:54.972103 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.972072    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-podinfo\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:37:54.972103 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.972097    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mpjc\" (UniqueName: \"kubernetes.io/projected/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-kube-api-access-2mpjc\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:37:54.972103 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.972107    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istiod-ca-cert\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:37:54.972103 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.972115    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-credential-socket\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:37:54.972365 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.972123    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-token\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:37:54.972365 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.972132    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-envoy\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:37:54.972365 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.972139    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa-istio-data\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:37:54.985262 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:54.985232    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:55.589917 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:55.589887    2569 generic.go:356] "Generic (PLEG): container finished" podID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerID="4320fa64217f35dfad2bd70d07c2045468525ed62697054973fcf16c1dfe9c7f" exitCode=0
Sep 19 04:37:55.590067 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:55.589937    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"
Sep 19 04:37:55.590067 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:55.589961    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" event={"ID":"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa","Type":"ContainerDied","Data":"4320fa64217f35dfad2bd70d07c2045468525ed62697054973fcf16c1dfe9c7f"}
Sep 19 04:37:55.590067 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:55.590014    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv" event={"ID":"bae8aafc-bcaf-47b3-9c62-5d81c7b256aa","Type":"ContainerDied","Data":"db758df652877e60964b2f3acfa24c3f3f9701f85afb8ddc1b340064db60fc01"}
Sep 19 04:37:55.590067 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:55.590036    2569 scope.go:117] "RemoveContainer" containerID="4320fa64217f35dfad2bd70d07c2045468525ed62697054973fcf16c1dfe9c7f"
Sep 19 04:37:55.599812 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:55.599794    2569 scope.go:117] "RemoveContainer" containerID="ae0bc765808519950e28c2133313cdd34c5a98205c6398332fd8f129a4fc470a"
Sep 19 04:37:55.608184 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:55.608164    2569 scope.go:117] "RemoveContainer" containerID="4320fa64217f35dfad2bd70d07c2045468525ed62697054973fcf16c1dfe9c7f"
Sep 19 04:37:55.608461 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:37:55.608442    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4320fa64217f35dfad2bd70d07c2045468525ed62697054973fcf16c1dfe9c7f\": container with ID starting with 4320fa64217f35dfad2bd70d07c2045468525ed62697054973fcf16c1dfe9c7f not found: ID does not exist" containerID="4320fa64217f35dfad2bd70d07c2045468525ed62697054973fcf16c1dfe9c7f"
Sep 19 04:37:55.608514 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:55.608473    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4320fa64217f35dfad2bd70d07c2045468525ed62697054973fcf16c1dfe9c7f"} err="failed to get container status \"4320fa64217f35dfad2bd70d07c2045468525ed62697054973fcf16c1dfe9c7f\": rpc error: code = NotFound desc = could not find container \"4320fa64217f35dfad2bd70d07c2045468525ed62697054973fcf16c1dfe9c7f\": container with ID starting with 4320fa64217f35dfad2bd70d07c2045468525ed62697054973fcf16c1dfe9c7f not found: ID does not exist"
Sep 19 04:37:55.608514 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:55.608490    2569 scope.go:117] "RemoveContainer" containerID="ae0bc765808519950e28c2133313cdd34c5a98205c6398332fd8f129a4fc470a"
Sep 19 04:37:55.608812 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:37:55.608730    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae0bc765808519950e28c2133313cdd34c5a98205c6398332fd8f129a4fc470a\": container with ID starting with ae0bc765808519950e28c2133313cdd34c5a98205c6398332fd8f129a4fc470a not found: ID does not exist" containerID="ae0bc765808519950e28c2133313cdd34c5a98205c6398332fd8f129a4fc470a"
Sep 19 04:37:55.608812 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:55.608782    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae0bc765808519950e28c2133313cdd34c5a98205c6398332fd8f129a4fc470a"} err="failed to get container status \"ae0bc765808519950e28c2133313cdd34c5a98205c6398332fd8f129a4fc470a\": rpc error: code = NotFound desc = could not find container \"ae0bc765808519950e28c2133313cdd34c5a98205c6398332fd8f129a4fc470a\": container with ID starting with ae0bc765808519950e28c2133313cdd34c5a98205c6398332fd8f129a4fc470a not found: ID does not exist"
Sep 19 04:37:55.619131 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:55.619107    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"]
Sep 19 04:37:55.621007 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:55.620983    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-a42681-openshift-default-5cf46dd978-m6nmv"]
Sep 19 04:37:55.824405 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:55.824376    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:56.539681 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:56.539649    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" path="/var/lib/kubelet/pods/bae8aafc-bcaf-47b3-9c62-5d81c7b256aa/volumes"
Sep 19 04:37:56.572018 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:56.571975    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:56.672074 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:56.672041    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:57.021548 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.021510    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:57.125315 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.125283    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:57.206248 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.206216    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:57.242196 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242162    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"]
Sep 19 04:37:57.242602 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242588    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerName="istio-proxy"
Sep 19 04:37:57.242648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242605    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerName="istio-proxy"
Sep 19 04:37:57.242648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242614    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="581fb522-75eb-4519-a7f7-b000fa87b5ea" containerName="payload-pre-processing"
Sep 19 04:37:57.242648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242621    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="581fb522-75eb-4519-a7f7-b000fa87b5ea" containerName="payload-pre-processing"
Sep 19 04:37:57.242648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242629    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd1328df-acf7-48d0-abdb-c0b073774986" containerName="payload-processing"
Sep 19 04:37:57.242648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242634    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd1328df-acf7-48d0-abdb-c0b073774986" containerName="payload-processing"
Sep 19 04:37:57.242648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242645    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62527046-f698-49bf-925e-65c89bed12e7" containerName="payload-pre-processing"
Sep 19 04:37:57.242648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242650    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="62527046-f698-49bf-925e-65c89bed12e7" containerName="payload-pre-processing"
Sep 19 04:37:57.242889 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242663    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5a5171e-49d2-4a5e-8538-79cd92fab935" containerName="maas-api"
Sep 19 04:37:57.242889 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242668    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5a5171e-49d2-4a5e-8538-79cd92fab935" containerName="maas-api"
Sep 19 04:37:57.242889 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242675    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerName="istio-proxy"
Sep 19 04:37:57.242889 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242680    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerName="istio-proxy"
Sep 19 04:37:57.242889 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242739    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerName="istio-proxy"
Sep 19 04:37:57.242889 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242773    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5a5171e-49d2-4a5e-8538-79cd92fab935" containerName="maas-api"
Sep 19 04:37:57.242889 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242782    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="62527046-f698-49bf-925e-65c89bed12e7" containerName="payload-pre-processing"
Sep 19 04:37:57.242889 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242789    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="581fb522-75eb-4519-a7f7-b000fa87b5ea" containerName="payload-pre-processing"
Sep 19 04:37:57.242889 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.242798    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd1328df-acf7-48d0-abdb-c0b073774986" containerName="payload-processing"
Sep 19 04:37:57.247433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.247412    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"
Sep 19 04:37:57.250004 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.249979    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-a70050-dockercfg-tp6zv\""
Sep 19 04:37:57.250130 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.250059    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-a70050\""
Sep 19 04:37:57.255972 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.255948    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"]
Sep 19 04:37:57.290800 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.290707    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c7c9f69-8225-4892-8485-920db1410ab8-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl\" (UID: \"3c7c9f69-8225-4892-8485-920db1410ab8\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"
Sep 19 04:37:57.290949 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.290809    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfmg4\" (UniqueName: \"kubernetes.io/projected/3c7c9f69-8225-4892-8485-920db1410ab8-kube-api-access-vfmg4\") pod \"payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl\" (UID: \"3c7c9f69-8225-4892-8485-920db1410ab8\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"
Sep 19 04:37:57.391270 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.391238    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c7c9f69-8225-4892-8485-920db1410ab8-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl\" (UID: \"3c7c9f69-8225-4892-8485-920db1410ab8\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"
Sep 19 04:37:57.391456 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.391299    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfmg4\" (UniqueName: \"kubernetes.io/projected/3c7c9f69-8225-4892-8485-920db1410ab8-kube-api-access-vfmg4\") pod \"payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl\" (UID: \"3c7c9f69-8225-4892-8485-920db1410ab8\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"
Sep 19 04:37:57.391921 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.391902    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c7c9f69-8225-4892-8485-920db1410ab8-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl\" (UID: \"3c7c9f69-8225-4892-8485-920db1410ab8\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"
Sep 19 04:37:57.400416 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.400393    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfmg4\" (UniqueName: \"kubernetes.io/projected/3c7c9f69-8225-4892-8485-920db1410ab8-kube-api-access-vfmg4\") pod \"payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl\" (UID: \"3c7c9f69-8225-4892-8485-920db1410ab8\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"
Sep 19 04:37:57.559236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.559148    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"
Sep 19 04:37:57.609092 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.608990    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:57.836903 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:57.836878    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"]
Sep 19 04:37:57.839656 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:37:57.839626    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c7c9f69_8225_4892_8485_920db1410ab8.slice/crio-7832a5d3e092bfeae28d977e41cfeda93dbb48c3ce79b2a0a7fdd940fdab0413 WatchSource:0}: Error finding container 7832a5d3e092bfeae28d977e41cfeda93dbb48c3ce79b2a0a7fdd940fdab0413: Status 404 returned error can't find the container with id 7832a5d3e092bfeae28d977e41cfeda93dbb48c3ce79b2a0a7fdd940fdab0413
Sep 19 04:37:58.409985 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:58.409943    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:58.618330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:58.618286    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl" event={"ID":"3c7c9f69-8225-4892-8485-920db1410ab8","Type":"ContainerStarted","Data":"57cbb1c8fde3590c68a9a67d22e2ca3efb463a9dc02e2afcbab99e4ff41f3cc6"}
Sep 19 04:37:58.618862 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:58.618393    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"
Sep 19 04:37:58.618862 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:58.618416    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl" event={"ID":"3c7c9f69-8225-4892-8485-920db1410ab8","Type":"ContainerStarted","Data":"7832a5d3e092bfeae28d977e41cfeda93dbb48c3ce79b2a0a7fdd940fdab0413"}
Sep 19 04:37:58.641892 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:58.641835    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl" podStartSLOduration=1.641821193 podStartE2EDuration="1.641821193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:37:58.638842753 +0000 UTC m=+1458.617039146" watchObservedRunningTime="2026-09-19 04:37:58.641821193 +0000 UTC m=+1458.620017589"
Sep 19 04:37:59.208784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:59.208726    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:37:59.344220 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:37:59.344181    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:05.285072 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:05.285031    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:05.363879 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:05.363844    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:05.474777 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:05.474674    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:05.578461 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:05.578386    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:06.270766 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:06.270715    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:06.363307 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:06.363259    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:08.135090 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:08.135055    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:09.625801 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:09.625769    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"
Sep 19 04:38:14.951535 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:14.951499    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:15.054940 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:15.054911    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:15.722290 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:15.722259    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:18.880974 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:18.880934    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:18.999257 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:18.999222    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:19.952807 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:19.952770    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:21.053225 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:21.053188    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:21.931449 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:21.931406    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:22.830550 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:22.830501    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:23.011767 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.011722    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:23.112613 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.112535    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:23.283726 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.283690    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:23.629723 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.629691    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"]
Sep 19 04:38:23.630482 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.630467    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bae8aafc-bcaf-47b3-9c62-5d81c7b256aa" containerName="istio-proxy"
Sep 19 04:38:23.634001 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.633985    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.636780 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.636737    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0a4ccac4-openshift-default-dockercfg-82j5c\""
Sep 19 04:38:23.653099 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.653070    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"]
Sep 19 04:38:23.677368 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.677334    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:23.745660 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.745617    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-token\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.745851 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.745685    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-workload-certs\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.745851 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.745731    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d37cbe7a-631c-4066-80ce-54c23e4a243c-istiod-ca-cert\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.745851 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.745775    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-envoy\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.745851 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.745801    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-podinfo\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.746087 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.745895    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-credential-socket\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.746087 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.745941    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-data\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.746087 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.745985    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh46d\" (UniqueName: \"kubernetes.io/projected/d37cbe7a-631c-4066-80ce-54c23e4a243c-kube-api-access-gh46d\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.746087 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.746014    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-workload-socket\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.846865 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.846825    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-podinfo\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.847272 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.846900    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-credential-socket\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.847272 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.846927    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-data\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.847272 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.846955    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh46d\" (UniqueName: \"kubernetes.io/projected/d37cbe7a-631c-4066-80ce-54c23e4a243c-kube-api-access-gh46d\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.847272 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.846971    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-workload-socket\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.847272 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.846992    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-token\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.847272 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.847033    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-workload-certs\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.847272 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.847065    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d37cbe7a-631c-4066-80ce-54c23e4a243c-istiod-ca-cert\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.847272 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.847090    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-envoy\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.847741 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.847372    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-credential-socket\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.847741 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.847443    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-workload-socket\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.847741 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.847615    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-data\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.847993 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.847772    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-workload-certs\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.848105 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.848082    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d37cbe7a-631c-4066-80ce-54c23e4a243c-istiod-ca-cert\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.849592 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.849567    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-podinfo\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.849736 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.849720    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-envoy\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.869529 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.869500    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh46d\" (UniqueName: \"kubernetes.io/projected/d37cbe7a-631c-4066-80ce-54c23e4a243c-kube-api-access-gh46d\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.870132 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.870109    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-token\") pod \"e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") " pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:23.945113 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:23.945028    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:24.210882 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:24.210809    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:24.396663 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:24.396632    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"]
Sep 19 04:38:24.399157 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:38:24.399130    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd37cbe7a_631c_4066_80ce_54c23e4a243c.slice/crio-517abbf4722830d0481264f6dc12faf0eeb45a4c3cd88ee801537cb60d039c0d WatchSource:0}: Error finding container 517abbf4722830d0481264f6dc12faf0eeb45a4c3cd88ee801537cb60d039c0d: Status 404 returned error can't find the container with id 517abbf4722830d0481264f6dc12faf0eeb45a4c3cd88ee801537cb60d039c0d
Sep 19 04:38:24.401351 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:24.401320    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:38:24.401430 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:24.401395    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:38:24.401430 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:24.401424    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:38:24.762038 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:24.761998    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7" event={"ID":"d37cbe7a-631c-4066-80ce-54c23e4a243c","Type":"ContainerStarted","Data":"f2ec95cab4759664873ddc5767e3a20bde9ba1be88974640ad3188a7a15c11ca"}
Sep 19 04:38:24.762228 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:24.762058    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7" event={"ID":"d37cbe7a-631c-4066-80ce-54c23e4a243c","Type":"ContainerStarted","Data":"517abbf4722830d0481264f6dc12faf0eeb45a4c3cd88ee801537cb60d039c0d"}
Sep 19 04:38:24.793329 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:24.793271    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7" podStartSLOduration=1.793255227 podStartE2EDuration="1.793255227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:38:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:38:24.792583178 +0000 UTC m=+1484.770779568" watchObservedRunningTime="2026-09-19 04:38:24.793255227 +0000 UTC m=+1484.771451617"
Sep 19 04:38:24.946063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:24.946030    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:25.951374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:25.951348    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:26.772911 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:26.772880    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:26.773772 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:26.773729    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:30.302460 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:30.302425    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:31.031211 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:31.031174    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:31.350306 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:31.350209    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:31.535269 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:31.535234    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:32.615335 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:32.615305    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:33.649185 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:33.649142    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:34.579405 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:34.579364    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:35.313666 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.313626    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"]
Sep 19 04:38:35.320068 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.320043    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:35.322914 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.322856    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-0a4ccac4-serving-cert\""
Sep 19 04:38:35.335507 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.335471    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"]
Sep 19 04:38:35.376562 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.376524    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:35.458092 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.458046    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-metrics-certs\") pod \"maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:35.458283 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.458131    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1af874a4-0693-4707-9db3-6ac50a4a2ff8-openshift-service-ca\") pod \"maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:35.458283 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.458157    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drjnl\" (UniqueName: \"kubernetes.io/projected/1af874a4-0693-4707-9db3-6ac50a4a2ff8-kube-api-access-drjnl\") pod \"maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:35.458283 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.458260    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-maas-api-tls\") pod \"maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:35.477039 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.477009    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:35.558857 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.558829    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-maas-api-tls\") pod \"maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:35.559055 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.558879    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-metrics-certs\") pod \"maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:35.559055 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.558927    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1af874a4-0693-4707-9db3-6ac50a4a2ff8-openshift-service-ca\") pod \"maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:35.559055 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.558944    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drjnl\" (UniqueName: \"kubernetes.io/projected/1af874a4-0693-4707-9db3-6ac50a4a2ff8-kube-api-access-drjnl\") pod \"maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:35.559055 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:38:35.559002    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-serving-cert: secret "maas-api-e2e-mt-0a4ccac4-serving-cert" not found
Sep 19 04:38:35.559225 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:38:35.559087    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-maas-api-tls podName:1af874a4-0693-4707-9db3-6ac50a4a2ff8 nodeName:}" failed. No retries permitted until 2026-09-19 04:38:36.059064712 +0000 UTC m=+1496.037261085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-maas-api-tls") pod "maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd" (UID: "1af874a4-0693-4707-9db3-6ac50a4a2ff8") : secret "maas-api-e2e-mt-0a4ccac4-serving-cert" not found
Sep 19 04:38:35.559649 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.559621    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1af874a4-0693-4707-9db3-6ac50a4a2ff8-openshift-service-ca\") pod \"maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:35.561465 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.561444    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-metrics-certs\") pod \"maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:35.568355 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.568282    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drjnl\" (UniqueName: \"kubernetes.io/projected/1af874a4-0693-4707-9db3-6ac50a4a2ff8-kube-api-access-drjnl\") pod \"maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:35.770707 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.770674    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:35.992102 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:35.992063    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:36.064319 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:36.064286    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-maas-api-tls\") pod \"maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:36.066965 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:36.066936    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-maas-api-tls\") pod \"maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:36.092083 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:36.092053    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:36.233543 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:36.233504    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:36.514905 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:36.514880    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"]
Sep 19 04:38:36.517206 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:38:36.517178    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af874a4_0693_4707_9db3_6ac50a4a2ff8.slice/crio-7c9d909c51587dd436b123b81b96ce259fab2db164551e37e8d95b60caed3d38 WatchSource:0}: Error finding container 7c9d909c51587dd436b123b81b96ce259fab2db164551e37e8d95b60caed3d38: Status 404 returned error can't find the container with id 7c9d909c51587dd436b123b81b96ce259fab2db164551e37e8d95b60caed3d38
Sep 19 04:38:36.518541 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:36.518514    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 04:38:36.825693 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:36.825610    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd" event={"ID":"1af874a4-0693-4707-9db3-6ac50a4a2ff8","Type":"ContainerStarted","Data":"7c9d909c51587dd436b123b81b96ce259fab2db164551e37e8d95b60caed3d38"}
Sep 19 04:38:37.832564 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:37.832524    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd" event={"ID":"1af874a4-0693-4707-9db3-6ac50a4a2ff8","Type":"ContainerStarted","Data":"1982559b054f88f7d7c7ee9084e53cd63f2897f387eae628d158da460a6cad60"}
Sep 19 04:38:37.833078 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:37.832625    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:37.864232 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:37.864180    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd" podStartSLOduration=2.501342035 podStartE2EDuration="2.864163533s" totalImagesPullingTime="362.821498ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:38:37.863266732 +0000 UTC m=+1497.841463123" watchObservedRunningTime="2026-09-19 04:38:37.864163533 +0000 UTC m=+1497.842359923"
Sep 19 04:38:43.844294 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:43.844259    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:38:57.815929 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:57.815886    2569 patch_prober.go:28] interesting pod/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 19 04:38:57.817197 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:57.815991    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7" podUID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 19 04:38:57.942325 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:57.942291    2569 generic.go:356] "Generic (PLEG): container finished" podID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerID="f2ec95cab4759664873ddc5767e3a20bde9ba1be88974640ad3188a7a15c11ca" exitCode=0
Sep 19 04:38:57.942487 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:57.942368    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7" event={"ID":"d37cbe7a-631c-4066-80ce-54c23e4a243c","Type":"ContainerDied","Data":"f2ec95cab4759664873ddc5767e3a20bde9ba1be88974640ad3188a7a15c11ca"}
Sep 19 04:38:57.942827 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:57.942813    2569 scope.go:117] "RemoveContainer" containerID="f2ec95cab4759664873ddc5767e3a20bde9ba1be88974640ad3188a7a15c11ca"
Sep 19 04:38:57.944002 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:57.943975    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:38:57.944063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:57.944046    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:38:57.944099 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:57.944080    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:38:58.407911 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:58.407874    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:58.634491 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:58.634457    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:58.949718 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:58.949686    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7" event={"ID":"d37cbe7a-631c-4066-80ce-54c23e4a243c","Type":"ContainerStarted","Data":"c9642e234886bc5cf29fd64a9b7af0dbc2627dde69870a24c25a22c67ae05d99"}
Sep 19 04:38:59.635432 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:59.635399    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:38:59.945694 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:59.945618    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:38:59.945901 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:59.945879    2569 patch_prober.go:28] interesting pod/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 19 04:38:59.945949 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:38:59.945928    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7" podUID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 19 04:39:00.754496 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:00.754463    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:00.945844 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:00.945808    2569 patch_prober.go:28] interesting pod/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 19 04:39:00.946013 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:00.945865    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7" podUID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 19 04:39:01.211692 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:01.211632    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:01.649502 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:01.649465    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:01.946151 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:01.946058    2569 patch_prober.go:28] interesting pod/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 19 04:39:01.946151 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:01.946119    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7" podUID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 19 04:39:01.969800 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:01.969774    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:02.115663 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:02.115628    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:02.428597 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:02.428566    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:02.946294 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:02.946260    2569 patch_prober.go:28] interesting pod/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 19 04:39:02.946820 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:02.946323    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7" podUID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 19 04:39:03.001550 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:03.001501    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:03.945810 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:03.945773    2569 patch_prober.go:28] interesting pod/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Sep 19 04:39:03.945987 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:03.945836    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7" podUID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Sep 19 04:39:04.949963 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:04.949930    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:39:04.950338 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:04.950268    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:39:04.951044 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:04.951024    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:39:08.328059 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:08.328025    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:08.431331 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:08.431291    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:09.052200 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:09.052167    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:09.915892 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:09.915858    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:10.811997 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:10.811956    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:11.814272 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:11.814226    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:12.599078 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:12.599041    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:13.552332 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:13.552299    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:14.501651 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:14.501615    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:15.172446 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:15.172409    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:15.276377 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:15.276347    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:15.432739 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:15.432657    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:18.922468 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:18.922435    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:19.793571 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:19.793539    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"]
Sep 19 04:39:19.793837 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:19.793811    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd" podUID="1af874a4-0693-4707-9db3-6ac50a4a2ff8" containerName="maas-api" containerID="cri-o://1982559b054f88f7d7c7ee9084e53cd63f2897f387eae628d158da460a6cad60" gracePeriod=30
Sep 19 04:39:19.842424 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:19.842393    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:19.978348 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:19.978316    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:20.051785 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.051737    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:39:20.063075 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.063037    2569 generic.go:356] "Generic (PLEG): container finished" podID="1af874a4-0693-4707-9db3-6ac50a4a2ff8" containerID="1982559b054f88f7d7c7ee9084e53cd63f2897f387eae628d158da460a6cad60" exitCode=0
Sep 19 04:39:20.063227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.063083    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"
Sep 19 04:39:20.063227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.063087    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd" event={"ID":"1af874a4-0693-4707-9db3-6ac50a4a2ff8","Type":"ContainerDied","Data":"1982559b054f88f7d7c7ee9084e53cd63f2897f387eae628d158da460a6cad60"}
Sep 19 04:39:20.063227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.063141    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd" event={"ID":"1af874a4-0693-4707-9db3-6ac50a4a2ff8","Type":"ContainerDied","Data":"7c9d909c51587dd436b123b81b96ce259fab2db164551e37e8d95b60caed3d38"}
Sep 19 04:39:20.063227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.063187    2569 scope.go:117] "RemoveContainer" containerID="1982559b054f88f7d7c7ee9084e53cd63f2897f387eae628d158da460a6cad60"
Sep 19 04:39:20.071686 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.071670    2569 scope.go:117] "RemoveContainer" containerID="1982559b054f88f7d7c7ee9084e53cd63f2897f387eae628d158da460a6cad60"
Sep 19 04:39:20.071999 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:39:20.071975    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1982559b054f88f7d7c7ee9084e53cd63f2897f387eae628d158da460a6cad60\": container with ID starting with 1982559b054f88f7d7c7ee9084e53cd63f2897f387eae628d158da460a6cad60 not found: ID does not exist" containerID="1982559b054f88f7d7c7ee9084e53cd63f2897f387eae628d158da460a6cad60"
Sep 19 04:39:20.072044 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.072012    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1982559b054f88f7d7c7ee9084e53cd63f2897f387eae628d158da460a6cad60"} err="failed to get container status \"1982559b054f88f7d7c7ee9084e53cd63f2897f387eae628d158da460a6cad60\": rpc error: code = NotFound desc = could not find container \"1982559b054f88f7d7c7ee9084e53cd63f2897f387eae628d158da460a6cad60\": container with ID starting with 1982559b054f88f7d7c7ee9084e53cd63f2897f387eae628d158da460a6cad60 not found: ID does not exist"
Sep 19 04:39:20.086239 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.086213    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:20.108986 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.108961    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1af874a4-0693-4707-9db3-6ac50a4a2ff8-openshift-service-ca\") pod \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") "
Sep 19 04:39:20.109122 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.109072    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-maas-api-tls\") pod \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") "
Sep 19 04:39:20.109122 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.109104    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drjnl\" (UniqueName: \"kubernetes.io/projected/1af874a4-0693-4707-9db3-6ac50a4a2ff8-kube-api-access-drjnl\") pod \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") "
Sep 19 04:39:20.109231 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.109147    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-metrics-certs\") pod \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\" (UID: \"1af874a4-0693-4707-9db3-6ac50a4a2ff8\") "
Sep 19 04:39:20.109376 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.109351    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1af874a4-0693-4707-9db3-6ac50a4a2ff8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1af874a4-0693-4707-9db3-6ac50a4a2ff8" (UID: "1af874a4-0693-4707-9db3-6ac50a4a2ff8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:39:20.109466 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.109450    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1af874a4-0693-4707-9db3-6ac50a4a2ff8-openshift-service-ca\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:39:20.111294 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.111265    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1af874a4-0693-4707-9db3-6ac50a4a2ff8" (UID: "1af874a4-0693-4707-9db3-6ac50a4a2ff8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:39:20.111395 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.111291    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1af874a4-0693-4707-9db3-6ac50a4a2ff8-kube-api-access-drjnl" (OuterVolumeSpecName: "kube-api-access-drjnl") pod "1af874a4-0693-4707-9db3-6ac50a4a2ff8" (UID: "1af874a4-0693-4707-9db3-6ac50a4a2ff8"). InnerVolumeSpecName "kube-api-access-drjnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:39:20.111395 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.111334    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1af874a4-0693-4707-9db3-6ac50a4a2ff8" (UID: "1af874a4-0693-4707-9db3-6ac50a4a2ff8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:39:20.183210 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.183123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:20.210799 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.210764    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-maas-api-tls\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:39:20.211017 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.211002    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drjnl\" (UniqueName: \"kubernetes.io/projected/1af874a4-0693-4707-9db3-6ac50a4a2ff8-kube-api-access-drjnl\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:39:20.211115 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.211100    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1af874a4-0693-4707-9db3-6ac50a4a2ff8-metrics-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:39:20.267175 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.267138    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:20.390434 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.390398    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"]
Sep 19 04:39:20.395246 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.395220    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-0a4ccac4-6c57458646-p2nwd"]
Sep 19 04:39:20.546369 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.546253    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1af874a4-0693-4707-9db3-6ac50a4a2ff8" path="/var/lib/kubelet/pods/1af874a4-0693-4707-9db3-6ac50a4a2ff8/volumes"
Sep 19 04:39:20.644548 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.644509    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:20.747665 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:20.747626    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:21.738615 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:21.738562    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:22.898657 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:22.898618    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:23.913632 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:23.913600    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:24.690433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:24.690395    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:27.246486 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:27.246456    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:27.346198 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:27.346166    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:27.519285 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:27.519191    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"]
Sep 19 04:39:27.519456 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:27.519413    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7" podUID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerName="istio-proxy" containerID="cri-o://c9642e234886bc5cf29fd64a9b7af0dbc2627dde69870a24c25a22c67ae05d99" gracePeriod=30
Sep 19 04:39:27.535049 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:27.535019    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:27.889499 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:27.889450    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:27.979716 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:27.979679    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:28.131811 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:28.131779    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:30.043887 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.043857    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"]
Sep 19 04:39:30.044355 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.044283    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1af874a4-0693-4707-9db3-6ac50a4a2ff8" containerName="maas-api"
Sep 19 04:39:30.044355 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.044294    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1af874a4-0693-4707-9db3-6ac50a4a2ff8" containerName="maas-api"
Sep 19 04:39:30.044461 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.044364    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1af874a4-0693-4707-9db3-6ac50a4a2ff8" containerName="maas-api"
Sep 19 04:39:30.048598 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.048578    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.052359 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.052335    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6b1935\"/\"test-model-6b1935-kserve-self-signed-certs\""
Sep 19 04:39:30.052514 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.052335    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-6b1935\"/\"default-dockercfg-dcnb9\""
Sep 19 04:39:30.052514 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.052339    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6b1935\"/\"kube-root-ca.crt\""
Sep 19 04:39:30.052514 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.052344    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-6b1935\"/\"openshift-service-ca.crt\""
Sep 19 04:39:30.060320 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.060297    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"]
Sep 19 04:39:30.079836 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.079798    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:30.106541 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.106498    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/127b03a7-24b0-411c-83f4-977820825c33-tls-certs\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.106662 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.106555    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bhvw\" (UniqueName: \"kubernetes.io/projected/127b03a7-24b0-411c-83f4-977820825c33-kube-api-access-6bhvw\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.106662 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.106611    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-tmp-dir\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.106739 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.106676    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-home\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.106739 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.106695    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-dshm\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.106739 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.106721    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-model-cache\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.207630 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.207594    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/127b03a7-24b0-411c-83f4-977820825c33-tls-certs\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.207856 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.207637    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bhvw\" (UniqueName: \"kubernetes.io/projected/127b03a7-24b0-411c-83f4-977820825c33-kube-api-access-6bhvw\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.207856 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.207691    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-tmp-dir\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.207856 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.207743    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-home\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.207856 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.207794    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-dshm\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.207856 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.207833    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-model-cache\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.208187 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.208165    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-home\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.208246 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.208193    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-tmp-dir\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.208246 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.208208    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-model-cache\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.210216 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.210180    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-dshm\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.210339 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.210323    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/127b03a7-24b0-411c-83f4-977820825c33-tls-certs\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.216349 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.216328    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bhvw\" (UniqueName: \"kubernetes.io/projected/127b03a7-24b0-411c-83f4-977820825c33-kube-api-access-6bhvw\") pod \"test-model-6b1935-kserve-5dc646dc74-2ctpr\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") " pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.358805 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.358698    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:30.635675 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:30.635644    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"]
Sep 19 04:39:30.637021 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:39:30.636995    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod127b03a7_24b0_411c_83f4_977820825c33.slice/crio-00a97ac17300ac1e45e2bdae95e8f731803c7337f3ee81c3c7d4910e53b89e36 WatchSource:0}: Error finding container 00a97ac17300ac1e45e2bdae95e8f731803c7337f3ee81c3c7d4910e53b89e36: Status 404 returned error can't find the container with id 00a97ac17300ac1e45e2bdae95e8f731803c7337f3ee81c3c7d4910e53b89e36
Sep 19 04:39:31.122491 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:31.122402    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr" event={"ID":"127b03a7-24b0-411c-83f4-977820825c33","Type":"ContainerStarted","Data":"1a5ac32158476cd4cdc05c7ab9908defd5535c77780c3c9e013f5fdc533bdd24"}
Sep 19 04:39:31.122491 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:31.122451    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr" event={"ID":"127b03a7-24b0-411c-83f4-977820825c33","Type":"ContainerStarted","Data":"00a97ac17300ac1e45e2bdae95e8f731803c7337f3ee81c3c7d4910e53b89e36"}
Sep 19 04:39:31.151714 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:31.151670    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr" podStartSLOduration=1.151655673 podStartE2EDuration="1.151655673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:39:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:39:31.14838901 +0000 UTC m=+1551.126585399" watchObservedRunningTime="2026-09-19 04:39:31.151655673 +0000 UTC m=+1551.129852063"
Sep 19 04:39:31.359425 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:31.359392    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:32.778782 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.778729    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:39:32.832561 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.832483    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-token\") pod \"d37cbe7a-631c-4066-80ce-54c23e4a243c\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") "
Sep 19 04:39:32.832561 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.832521    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d37cbe7a-631c-4066-80ce-54c23e4a243c-istiod-ca-cert\") pod \"d37cbe7a-631c-4066-80ce-54c23e4a243c\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") "
Sep 19 04:39:32.832561 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.832559    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-workload-certs\") pod \"d37cbe7a-631c-4066-80ce-54c23e4a243c\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") "
Sep 19 04:39:32.832855 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.832588    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh46d\" (UniqueName: \"kubernetes.io/projected/d37cbe7a-631c-4066-80ce-54c23e4a243c-kube-api-access-gh46d\") pod \"d37cbe7a-631c-4066-80ce-54c23e4a243c\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") "
Sep 19 04:39:32.832855 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.832622    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-data\") pod \"d37cbe7a-631c-4066-80ce-54c23e4a243c\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") "
Sep 19 04:39:32.832855 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.832663    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-credential-socket\") pod \"d37cbe7a-631c-4066-80ce-54c23e4a243c\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") "
Sep 19 04:39:32.832855 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.832688    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-envoy\") pod \"d37cbe7a-631c-4066-80ce-54c23e4a243c\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") "
Sep 19 04:39:32.832855 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.832740    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-workload-socket\") pod \"d37cbe7a-631c-4066-80ce-54c23e4a243c\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") "
Sep 19 04:39:32.832855 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.832798    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-podinfo\") pod \"d37cbe7a-631c-4066-80ce-54c23e4a243c\" (UID: \"d37cbe7a-631c-4066-80ce-54c23e4a243c\") "
Sep 19 04:39:32.833168 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.832936    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d37cbe7a-631c-4066-80ce-54c23e4a243c" (UID: "d37cbe7a-631c-4066-80ce-54c23e4a243c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:39:32.833168 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.833003    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d37cbe7a-631c-4066-80ce-54c23e4a243c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d37cbe7a-631c-4066-80ce-54c23e4a243c" (UID: "d37cbe7a-631c-4066-80ce-54c23e4a243c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:39:32.833279 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.833210    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-workload-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:39:32.833279 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.833229    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d37cbe7a-631c-4066-80ce-54c23e4a243c-istiod-ca-cert\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:39:32.833279 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.833252    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d37cbe7a-631c-4066-80ce-54c23e4a243c" (UID: "d37cbe7a-631c-4066-80ce-54c23e4a243c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:39:32.833422 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.833296    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d37cbe7a-631c-4066-80ce-54c23e4a243c" (UID: "d37cbe7a-631c-4066-80ce-54c23e4a243c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:39:32.833505 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.833482    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-data" (OuterVolumeSpecName: "istio-data") pod "d37cbe7a-631c-4066-80ce-54c23e4a243c" (UID: "d37cbe7a-631c-4066-80ce-54c23e4a243c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:39:32.835250 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.835221    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d37cbe7a-631c-4066-80ce-54c23e4a243c" (UID: "d37cbe7a-631c-4066-80ce-54c23e4a243c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:39:32.835517 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.835497    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-token" (OuterVolumeSpecName: "istio-token") pod "d37cbe7a-631c-4066-80ce-54c23e4a243c" (UID: "d37cbe7a-631c-4066-80ce-54c23e4a243c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:39:32.835608 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.835526    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d37cbe7a-631c-4066-80ce-54c23e4a243c" (UID: "d37cbe7a-631c-4066-80ce-54c23e4a243c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:39:32.835608 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.835562    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37cbe7a-631c-4066-80ce-54c23e4a243c-kube-api-access-gh46d" (OuterVolumeSpecName: "kube-api-access-gh46d") pod "d37cbe7a-631c-4066-80ce-54c23e4a243c" (UID: "d37cbe7a-631c-4066-80ce-54c23e4a243c"). InnerVolumeSpecName "kube-api-access-gh46d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:39:32.934566 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.934534    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-token\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:39:32.934566 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.934562    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh46d\" (UniqueName: \"kubernetes.io/projected/d37cbe7a-631c-4066-80ce-54c23e4a243c-kube-api-access-gh46d\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:39:32.934566 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.934575    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-data\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:39:32.934841 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.934583    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-credential-socket\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:39:32.934841 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.934591    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-envoy\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:39:32.934841 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.934598    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d37cbe7a-631c-4066-80ce-54c23e4a243c-workload-socket\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:39:32.934841 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:32.934606    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d37cbe7a-631c-4066-80ce-54c23e4a243c-istio-podinfo\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:39:33.134596 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:33.134556    2569 generic.go:356] "Generic (PLEG): container finished" podID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerID="c9642e234886bc5cf29fd64a9b7af0dbc2627dde69870a24c25a22c67ae05d99" exitCode=0
Sep 19 04:39:33.134784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:33.134609    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"
Sep 19 04:39:33.134784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:33.134647    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7" event={"ID":"d37cbe7a-631c-4066-80ce-54c23e4a243c","Type":"ContainerDied","Data":"c9642e234886bc5cf29fd64a9b7af0dbc2627dde69870a24c25a22c67ae05d99"}
Sep 19 04:39:33.134784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:33.134706    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7" event={"ID":"d37cbe7a-631c-4066-80ce-54c23e4a243c","Type":"ContainerDied","Data":"517abbf4722830d0481264f6dc12faf0eeb45a4c3cd88ee801537cb60d039c0d"}
Sep 19 04:39:33.134784 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:33.134731    2569 scope.go:117] "RemoveContainer" containerID="c9642e234886bc5cf29fd64a9b7af0dbc2627dde69870a24c25a22c67ae05d99"
Sep 19 04:39:33.145468 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:33.145451    2569 scope.go:117] "RemoveContainer" containerID="f2ec95cab4759664873ddc5767e3a20bde9ba1be88974640ad3188a7a15c11ca"
Sep 19 04:39:33.154536 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:33.154508    2569 scope.go:117] "RemoveContainer" containerID="c9642e234886bc5cf29fd64a9b7af0dbc2627dde69870a24c25a22c67ae05d99"
Sep 19 04:39:33.154812 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:39:33.154793    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9642e234886bc5cf29fd64a9b7af0dbc2627dde69870a24c25a22c67ae05d99\": container with ID starting with c9642e234886bc5cf29fd64a9b7af0dbc2627dde69870a24c25a22c67ae05d99 not found: ID does not exist" containerID="c9642e234886bc5cf29fd64a9b7af0dbc2627dde69870a24c25a22c67ae05d99"
Sep 19 04:39:33.154907 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:33.154824    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9642e234886bc5cf29fd64a9b7af0dbc2627dde69870a24c25a22c67ae05d99"} err="failed to get container status \"c9642e234886bc5cf29fd64a9b7af0dbc2627dde69870a24c25a22c67ae05d99\": rpc error: code = NotFound desc = could not find container \"c9642e234886bc5cf29fd64a9b7af0dbc2627dde69870a24c25a22c67ae05d99\": container with ID starting with c9642e234886bc5cf29fd64a9b7af0dbc2627dde69870a24c25a22c67ae05d99 not found: ID does not exist"
Sep 19 04:39:33.154907 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:33.154846    2569 scope.go:117] "RemoveContainer" containerID="f2ec95cab4759664873ddc5767e3a20bde9ba1be88974640ad3188a7a15c11ca"
Sep 19 04:39:33.155109 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:39:33.155089    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2ec95cab4759664873ddc5767e3a20bde9ba1be88974640ad3188a7a15c11ca\": container with ID starting with f2ec95cab4759664873ddc5767e3a20bde9ba1be88974640ad3188a7a15c11ca not found: ID does not exist" containerID="f2ec95cab4759664873ddc5767e3a20bde9ba1be88974640ad3188a7a15c11ca"
Sep 19 04:39:33.155161 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:33.155116    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2ec95cab4759664873ddc5767e3a20bde9ba1be88974640ad3188a7a15c11ca"} err="failed to get container status \"f2ec95cab4759664873ddc5767e3a20bde9ba1be88974640ad3188a7a15c11ca\": rpc error: code = NotFound desc = could not find container \"f2ec95cab4759664873ddc5767e3a20bde9ba1be88974640ad3188a7a15c11ca\": container with ID starting with f2ec95cab4759664873ddc5767e3a20bde9ba1be88974640ad3188a7a15c11ca not found: ID does not exist"
Sep 19 04:39:33.160597 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:33.160575    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"]
Sep 19 04:39:33.167995 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:33.167976    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0a4ccac4-openshift-default-64d6f769b4-vrks7"]
Sep 19 04:39:34.483566 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:34.483533    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:34.539272 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:34.539239    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d37cbe7a-631c-4066-80ce-54c23e4a243c" path="/var/lib/kubelet/pods/d37cbe7a-631c-4066-80ce-54c23e4a243c/volumes"
Sep 19 04:39:34.608765 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:34.608717    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:34.786321 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:34.786229    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:34.939472 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:34.939440    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:36.412929 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:36.412892    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:40.307919 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.307887    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"]
Sep 19 04:39:40.308317 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.308305    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerName="istio-proxy"
Sep 19 04:39:40.308356 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.308319    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerName="istio-proxy"
Sep 19 04:39:40.308356 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.308329    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerName="istio-proxy"
Sep 19 04:39:40.308356 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.308334    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerName="istio-proxy"
Sep 19 04:39:40.308471 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.308398    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerName="istio-proxy"
Sep 19 04:39:40.308471 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.308408    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d37cbe7a-631c-4066-80ce-54c23e4a243c" containerName="istio-proxy"
Sep 19 04:39:40.311403 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.311387    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.317333 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.317309    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-a70050\"/\"default-dockercfg-6x7lk\""
Sep 19 04:39:40.317765 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.317729    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-a70050\"/\"openshift-service-ca.crt\""
Sep 19 04:39:40.318407 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.318232    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-a70050\"/\"kube-root-ca.crt\""
Sep 19 04:39:40.321991 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.321969    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-a70050\"/\"explicit-model-a70050-kserve-self-signed-certs\""
Sep 19 04:39:40.358805 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.358743    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"]
Sep 19 04:39:40.358932 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.358826    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:40.368281 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.368254    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:40.372576 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.372554    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:40.406361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.406326    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-model-cache\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.406361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.406360    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-tmp-dir\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.406521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.406385    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-dshm\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.406521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.406435    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-home\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.406521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.406462    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chq58\" (UniqueName: \"kubernetes.io/projected/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-kube-api-access-chq58\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.406521 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.406488    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-tls-certs\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.508112 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.508076    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-model-cache\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.508288 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.508121    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-tmp-dir\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.508288 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.508156    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-dshm\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.508288 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.508195    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-home\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.508288 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.508237    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chq58\" (UniqueName: \"kubernetes.io/projected/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-kube-api-access-chq58\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.508288 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.508280    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-tls-certs\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.508573 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.508509    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-model-cache\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.508624 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.508568    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-home\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.508931 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.508909    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-tmp-dir\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.511165 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.511135    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-dshm\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.511997 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.511980    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-a70050\"/\"explicit-model-a70050-kserve-self-signed-certs\""
Sep 19 04:39:40.518948 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.518894    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-a70050\"/\"kube-root-ca.crt\""
Sep 19 04:39:40.521976 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.521956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-tls-certs\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.529866 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.529850    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-a70050\"/\"openshift-service-ca.crt\""
Sep 19 04:39:40.546948 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.546919    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chq58\" (UniqueName: \"kubernetes.io/projected/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-kube-api-access-chq58\") pod \"explicit-model-a70050-kserve-7586c4559b-rlhhq\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") " pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.623720 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.623699    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-a70050\"/\"default-dockercfg-6x7lk\""
Sep 19 04:39:40.631255 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.631235    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:40.909799 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:40.909774    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"]
Sep 19 04:39:40.912041 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:39:40.912015    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60f07bc3_d5e5_4d7a_8071_09e8efa70f09.slice/crio-b5d6e15716a08f127179a118a4d62c8c36ffd52b55876dcb5f0a5f5b5d7efb92 WatchSource:0}: Error finding container b5d6e15716a08f127179a118a4d62c8c36ffd52b55876dcb5f0a5f5b5d7efb92: Status 404 returned error can't find the container with id b5d6e15716a08f127179a118a4d62c8c36ffd52b55876dcb5f0a5f5b5d7efb92
Sep 19 04:39:41.181870 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:41.181782    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq" event={"ID":"60f07bc3-d5e5-4d7a-8071-09e8efa70f09","Type":"ContainerStarted","Data":"d8d304ddb638b2e09effb8bf504e1239e41ad73cd8dfef23232fd29d918d3b57"}
Sep 19 04:39:41.181870 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:41.181829    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq" event={"ID":"60f07bc3-d5e5-4d7a-8071-09e8efa70f09","Type":"ContainerStarted","Data":"b5d6e15716a08f127179a118a4d62c8c36ffd52b55876dcb5f0a5f5b5d7efb92"}
Sep 19 04:39:41.193255 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:41.193231    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:39:41.281871 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:41.281821    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq" podStartSLOduration=1.281805278 podStartE2EDuration="1.281805278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:39:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:39:41.230128657 +0000 UTC m=+1561.208325047" watchObservedRunningTime="2026-09-19 04:39:41.281805278 +0000 UTC m=+1561.260001667"
Sep 19 04:39:41.632335 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:41.632311    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:42.380421 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:42.380391    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:42.489015 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:42.488978    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:43.458841 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:43.458809    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:43.841929 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:43.841845    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:44.226595 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:44.226562    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:46.205708 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:46.205672    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:46.839796 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:46.839728    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:47.020772 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:47.020718    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:47.459084 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:47.459043    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:48.478519 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:48.478485    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:49.484937 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:49.484907    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:50.608913 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:50.608871    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:50.632082 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:50.632050    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:50.644499 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:50.644473    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:51.244502 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:51.244474    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:39:51.477080 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:51.477046    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:51.558209 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:51.558117    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:51.657874 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:51.657835    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:52.240658 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.240623    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:52.325445 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.325411    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:39:52.376607 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.376573    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"]
Sep 19 04:39:52.380447 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.380429    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"
Sep 19 04:39:52.384016 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.383997    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-c1a7b6-dockercfg-snxs6\""
Sep 19 04:39:52.384307 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.384293    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-c1a7b6\""
Sep 19 04:39:52.394401 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.394378    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"]
Sep 19 04:39:52.533291 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.533207    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd1c6206-c249-4e44-8c2f-4039e46820b1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst\" (UID: \"cd1c6206-c249-4e44-8c2f-4039e46820b1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"
Sep 19 04:39:52.533291 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.533276    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flfgd\" (UniqueName: \"kubernetes.io/projected/cd1c6206-c249-4e44-8c2f-4039e46820b1-kube-api-access-flfgd\") pod \"payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst\" (UID: \"cd1c6206-c249-4e44-8c2f-4039e46820b1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"
Sep 19 04:39:52.634647 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.634614    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd1c6206-c249-4e44-8c2f-4039e46820b1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst\" (UID: \"cd1c6206-c249-4e44-8c2f-4039e46820b1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"
Sep 19 04:39:52.634889 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.634702    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flfgd\" (UniqueName: \"kubernetes.io/projected/cd1c6206-c249-4e44-8c2f-4039e46820b1-kube-api-access-flfgd\") pod \"payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst\" (UID: \"cd1c6206-c249-4e44-8c2f-4039e46820b1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"
Sep 19 04:39:52.635329 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.635310    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd1c6206-c249-4e44-8c2f-4039e46820b1-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst\" (UID: \"cd1c6206-c249-4e44-8c2f-4039e46820b1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"
Sep 19 04:39:52.644458 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.644427    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flfgd\" (UniqueName: \"kubernetes.io/projected/cd1c6206-c249-4e44-8c2f-4039e46820b1-kube-api-access-flfgd\") pod \"payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst\" (UID: \"cd1c6206-c249-4e44-8c2f-4039e46820b1\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"
Sep 19 04:39:52.692461 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.692424    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"
Sep 19 04:39:52.966942 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:52.966918    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"]
Sep 19 04:39:52.968738 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:39:52.968703    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd1c6206_c249_4e44_8c2f_4039e46820b1.slice/crio-b798ca91c528045136c1dcb18a02fa4affb1ce30d82fe0c2c5f89668f80f649e WatchSource:0}: Error finding container b798ca91c528045136c1dcb18a02fa4affb1ce30d82fe0c2c5f89668f80f649e: Status 404 returned error can't find the container with id b798ca91c528045136c1dcb18a02fa4affb1ce30d82fe0c2c5f89668f80f649e
Sep 19 04:39:53.248312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:53.248219    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst" event={"ID":"cd1c6206-c249-4e44-8c2f-4039e46820b1","Type":"ContainerStarted","Data":"39c5bcaad79dc11708fb57c5cbd7a27ce1971e138713702cc9381c06bc51bb90"}
Sep 19 04:39:53.248312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:53.248285    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst" event={"ID":"cd1c6206-c249-4e44-8c2f-4039e46820b1","Type":"ContainerStarted","Data":"b798ca91c528045136c1dcb18a02fa4affb1ce30d82fe0c2c5f89668f80f649e"}
Sep 19 04:39:53.248312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:53.248315    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"
Sep 19 04:39:53.271097 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:53.271045    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst" podStartSLOduration=1.2710292029999999 podStartE2EDuration="1.271029203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:39:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:39:53.268147906 +0000 UTC m=+1573.246344297" watchObservedRunningTime="2026-09-19 04:39:53.271029203 +0000 UTC m=+1573.249225593"
Sep 19 04:39:56.199360 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:39:56.199327    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:04.256160 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:04.256131    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"
Sep 19 04:40:05.895850 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:05.895816    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"]
Sep 19 04:40:05.928403 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:05.928369    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:06.193901 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:06.193788    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:07.323108 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:07.323070    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:08.294643 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:08.294596    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:09.236456 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:09.236418    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:10.386361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:10.386330    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:11.412551 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:11.412514    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:12.960380 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:12.960348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:13.946680 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:13.946645    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:15.228936 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:15.228906    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:16.179900 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:16.179864    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:16.949036 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:16.948995    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:17.191510 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:17.191470    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:17.414963 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:17.414927    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:17.786989 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:17.786904    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:18.103151 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:18.103051    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:18.387363 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:18.387331    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:19.292222 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:19.292191    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:19.375631 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:19.375596    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"]
Sep 19 04:40:19.375945 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:19.375903    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl" podUID="3c7c9f69-8225-4892-8485-920db1410ab8" containerName="payload-pre-processing" containerID="cri-o://57cbb1c8fde3590c68a9a67d22e2ca3efb463a9dc02e2afcbab99e4ff41f3cc6" gracePeriod=30
Sep 19 04:40:19.418261 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:19.418231    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:19.519135 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:19.519094    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:19.628780 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:19.628735    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:19.633213 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:19.633191    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"
Sep 19 04:40:19.707989 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:19.707954    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c7c9f69-8225-4892-8485-920db1410ab8-plugins-config-volume\") pod \"3c7c9f69-8225-4892-8485-920db1410ab8\" (UID: \"3c7c9f69-8225-4892-8485-920db1410ab8\") "
Sep 19 04:40:19.708181 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:19.708115    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfmg4\" (UniqueName: \"kubernetes.io/projected/3c7c9f69-8225-4892-8485-920db1410ab8-kube-api-access-vfmg4\") pod \"3c7c9f69-8225-4892-8485-920db1410ab8\" (UID: \"3c7c9f69-8225-4892-8485-920db1410ab8\") "
Sep 19 04:40:19.708415 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:19.708386    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c7c9f69-8225-4892-8485-920db1410ab8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3c7c9f69-8225-4892-8485-920db1410ab8" (UID: "3c7c9f69-8225-4892-8485-920db1410ab8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:40:19.710307 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:19.710281    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c7c9f69-8225-4892-8485-920db1410ab8-kube-api-access-vfmg4" (OuterVolumeSpecName: "kube-api-access-vfmg4") pod "3c7c9f69-8225-4892-8485-920db1410ab8" (UID: "3c7c9f69-8225-4892-8485-920db1410ab8"). InnerVolumeSpecName "kube-api-access-vfmg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:40:19.809963 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:19.809933    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3c7c9f69-8225-4892-8485-920db1410ab8-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:40:19.809963 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:19.809958    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfmg4\" (UniqueName: \"kubernetes.io/projected/3c7c9f69-8225-4892-8485-920db1410ab8-kube-api-access-vfmg4\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:40:20.026765 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:20.026717    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:20.162013 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:20.161963    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:20.389097 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:20.389067    2569 generic.go:356] "Generic (PLEG): container finished" podID="3c7c9f69-8225-4892-8485-920db1410ab8" containerID="57cbb1c8fde3590c68a9a67d22e2ca3efb463a9dc02e2afcbab99e4ff41f3cc6" exitCode=0
Sep 19 04:40:20.389541 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:20.389110    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"
Sep 19 04:40:20.389541 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:20.389108    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl" event={"ID":"3c7c9f69-8225-4892-8485-920db1410ab8","Type":"ContainerDied","Data":"57cbb1c8fde3590c68a9a67d22e2ca3efb463a9dc02e2afcbab99e4ff41f3cc6"}
Sep 19 04:40:20.389541 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:20.389188    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl" event={"ID":"3c7c9f69-8225-4892-8485-920db1410ab8","Type":"ContainerDied","Data":"7832a5d3e092bfeae28d977e41cfeda93dbb48c3ce79b2a0a7fdd940fdab0413"}
Sep 19 04:40:20.389541 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:20.389220    2569 scope.go:117] "RemoveContainer" containerID="57cbb1c8fde3590c68a9a67d22e2ca3efb463a9dc02e2afcbab99e4ff41f3cc6"
Sep 19 04:40:20.401740 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:20.401698    2569 scope.go:117] "RemoveContainer" containerID="57cbb1c8fde3590c68a9a67d22e2ca3efb463a9dc02e2afcbab99e4ff41f3cc6"
Sep 19 04:40:20.402104 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:40:20.402078    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57cbb1c8fde3590c68a9a67d22e2ca3efb463a9dc02e2afcbab99e4ff41f3cc6\": container with ID starting with 57cbb1c8fde3590c68a9a67d22e2ca3efb463a9dc02e2afcbab99e4ff41f3cc6 not found: ID does not exist" containerID="57cbb1c8fde3590c68a9a67d22e2ca3efb463a9dc02e2afcbab99e4ff41f3cc6"
Sep 19 04:40:20.402211 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:20.402113    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57cbb1c8fde3590c68a9a67d22e2ca3efb463a9dc02e2afcbab99e4ff41f3cc6"} err="failed to get container status \"57cbb1c8fde3590c68a9a67d22e2ca3efb463a9dc02e2afcbab99e4ff41f3cc6\": rpc error: code = NotFound desc = could not find container \"57cbb1c8fde3590c68a9a67d22e2ca3efb463a9dc02e2afcbab99e4ff41f3cc6\": container with ID starting with 57cbb1c8fde3590c68a9a67d22e2ca3efb463a9dc02e2afcbab99e4ff41f3cc6 not found: ID does not exist"
Sep 19 04:40:20.423164 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:20.423134    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"]
Sep 19 04:40:20.432857 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:20.432832    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl"]
Sep 19 04:40:20.539359 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:20.539326    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c7c9f69-8225-4892-8485-920db1410ab8" path="/var/lib/kubelet/pods/3c7c9f69-8225-4892-8485-920db1410ab8/volumes"
Sep 19 04:40:20.625196 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:20.625161    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-explicit-a70050-85bcf7d4c4-xzchl" podUID="3c7c9f69-8225-4892-8485-920db1410ab8" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.48:9004: i/o timeout"
Sep 19 04:40:20.917396 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:20.917363    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq" podUID="60f07bc3-d5e5-4d7a-8071-09e8efa70f09" containerName="main" containerID="cri-o://d8d304ddb638b2e09effb8bf504e1239e41ad73cd8dfef23232fd29d918d3b57" gracePeriod=45
Sep 19 04:40:21.179733 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.179670    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:40:21.205100 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.205067    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:21.323513 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.323482    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-tmp-dir\") pod \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") "
Sep 19 04:40:21.323703 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.323532    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-tls-certs\") pod \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") "
Sep 19 04:40:21.323703 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.323587    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-model-cache\") pod \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") "
Sep 19 04:40:21.323703 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.323607    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-home\") pod \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") "
Sep 19 04:40:21.323703 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.323638    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-dshm\") pod \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") "
Sep 19 04:40:21.323703 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.323659    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chq58\" (UniqueName: \"kubernetes.io/projected/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-kube-api-access-chq58\") pod \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\" (UID: \"60f07bc3-d5e5-4d7a-8071-09e8efa70f09\") "
Sep 19 04:40:21.324024 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.323738    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "60f07bc3-d5e5-4d7a-8071-09e8efa70f09" (UID: "60f07bc3-d5e5-4d7a-8071-09e8efa70f09"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:40:21.324090 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.324037    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-home" (OuterVolumeSpecName: "home") pod "60f07bc3-d5e5-4d7a-8071-09e8efa70f09" (UID: "60f07bc3-d5e5-4d7a-8071-09e8efa70f09"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:40:21.324090 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.324043    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-model-cache" (OuterVolumeSpecName: "model-cache") pod "60f07bc3-d5e5-4d7a-8071-09e8efa70f09" (UID: "60f07bc3-d5e5-4d7a-8071-09e8efa70f09"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:40:21.324090 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.324062    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-tmp-dir\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:40:21.326093 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.326063    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "60f07bc3-d5e5-4d7a-8071-09e8efa70f09" (UID: "60f07bc3-d5e5-4d7a-8071-09e8efa70f09"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:40:21.326198 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.326118    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-dshm" (OuterVolumeSpecName: "dshm") pod "60f07bc3-d5e5-4d7a-8071-09e8efa70f09" (UID: "60f07bc3-d5e5-4d7a-8071-09e8efa70f09"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:40:21.326198 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.326132    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-kube-api-access-chq58" (OuterVolumeSpecName: "kube-api-access-chq58") pod "60f07bc3-d5e5-4d7a-8071-09e8efa70f09" (UID: "60f07bc3-d5e5-4d7a-8071-09e8efa70f09"). InnerVolumeSpecName "kube-api-access-chq58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:40:21.388717 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.388690    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:21.396822 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.396793    2569 generic.go:356] "Generic (PLEG): container finished" podID="60f07bc3-d5e5-4d7a-8071-09e8efa70f09" containerID="d8d304ddb638b2e09effb8bf504e1239e41ad73cd8dfef23232fd29d918d3b57" exitCode=0
Sep 19 04:40:21.397194 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.396835    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"
Sep 19 04:40:21.397194 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.396856    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq" event={"ID":"60f07bc3-d5e5-4d7a-8071-09e8efa70f09","Type":"ContainerDied","Data":"d8d304ddb638b2e09effb8bf504e1239e41ad73cd8dfef23232fd29d918d3b57"}
Sep 19 04:40:21.397194 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.396886    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq" event={"ID":"60f07bc3-d5e5-4d7a-8071-09e8efa70f09","Type":"ContainerDied","Data":"b5d6e15716a08f127179a118a4d62c8c36ffd52b55876dcb5f0a5f5b5d7efb92"}
Sep 19 04:40:21.397194 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.396903    2569 scope.go:117] "RemoveContainer" containerID="d8d304ddb638b2e09effb8bf504e1239e41ad73cd8dfef23232fd29d918d3b57"
Sep 19 04:40:21.406546 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.406518    2569 scope.go:117] "RemoveContainer" containerID="d8d304ddb638b2e09effb8bf504e1239e41ad73cd8dfef23232fd29d918d3b57"
Sep 19 04:40:21.406827 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:40:21.406808    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8d304ddb638b2e09effb8bf504e1239e41ad73cd8dfef23232fd29d918d3b57\": container with ID starting with d8d304ddb638b2e09effb8bf504e1239e41ad73cd8dfef23232fd29d918d3b57 not found: ID does not exist" containerID="d8d304ddb638b2e09effb8bf504e1239e41ad73cd8dfef23232fd29d918d3b57"
Sep 19 04:40:21.406882 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.406837    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d304ddb638b2e09effb8bf504e1239e41ad73cd8dfef23232fd29d918d3b57"} err="failed to get container status \"d8d304ddb638b2e09effb8bf504e1239e41ad73cd8dfef23232fd29d918d3b57\": rpc error: code = NotFound desc = could not find container \"d8d304ddb638b2e09effb8bf504e1239e41ad73cd8dfef23232fd29d918d3b57\": container with ID starting with d8d304ddb638b2e09effb8bf504e1239e41ad73cd8dfef23232fd29d918d3b57 not found: ID does not exist"
Sep 19 04:40:21.424216 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.424190    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"]
Sep 19 04:40:21.424693 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.424671    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-tls-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:40:21.424780 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.424697    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-model-cache\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:40:21.424780 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.424705    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-home\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:40:21.424780 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.424712    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-dshm\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:40:21.424780 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.424720    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chq58\" (UniqueName: \"kubernetes.io/projected/60f07bc3-d5e5-4d7a-8071-09e8efa70f09-kube-api-access-chq58\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:40:21.428044 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.428019    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-a70050/explicit-model-a70050-kserve-7586c4559b-rlhhq"]
Sep 19 04:40:21.744445 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:21.744408    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:22.539043 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:22.539010    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60f07bc3-d5e5-4d7a-8071-09e8efa70f09" path="/var/lib/kubelet/pods/60f07bc3-d5e5-4d7a-8071-09e8efa70f09/volumes"
Sep 19 04:40:22.652381 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:22.652348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:23.876619 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:23.876592    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:25.157069 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:25.157032    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:26.107500 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.107463    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:26.201773 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.201712    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:26.387430 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.387402    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:26.713503 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.713424    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:26.811895 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.811863    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:26.823299 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.823274    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"]
Sep 19 04:40:26.823658 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.823646    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60f07bc3-d5e5-4d7a-8071-09e8efa70f09" containerName="main"
Sep 19 04:40:26.823713 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.823660    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="60f07bc3-d5e5-4d7a-8071-09e8efa70f09" containerName="main"
Sep 19 04:40:26.823713 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.823687    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c7c9f69-8225-4892-8485-920db1410ab8" containerName="payload-pre-processing"
Sep 19 04:40:26.823713 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.823692    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c7c9f69-8225-4892-8485-920db1410ab8" containerName="payload-pre-processing"
Sep 19 04:40:26.823845 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.823772    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="60f07bc3-d5e5-4d7a-8071-09e8efa70f09" containerName="main"
Sep 19 04:40:26.823845 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.823781    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c7c9f69-8225-4892-8485-920db1410ab8" containerName="payload-pre-processing"
Sep 19 04:40:26.828130 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.828110    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"
Sep 19 04:40:26.833423 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.833398    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-eac6c5\""
Sep 19 04:40:26.842834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.842811    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"]
Sep 19 04:40:26.860309 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.860285    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"]
Sep 19 04:40:26.863858 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.863842    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"
Sep 19 04:40:26.866518 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.866503    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-eac6c5-dockercfg-gcgnc\""
Sep 19 04:40:26.878364 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.878340    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"]
Sep 19 04:40:26.982231 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.982144    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n\" (UID: \"2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"
Sep 19 04:40:26.982231 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.982220    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88109ad6-7267-4412-b1d9-8ecc03c47698-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl\" (UID: \"88109ad6-7267-4412-b1d9-8ecc03c47698\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"
Sep 19 04:40:26.982417 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.982259    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw6qg\" (UniqueName: \"kubernetes.io/projected/88109ad6-7267-4412-b1d9-8ecc03c47698-kube-api-access-jw6qg\") pod \"payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl\" (UID: \"88109ad6-7267-4412-b1d9-8ecc03c47698\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"
Sep 19 04:40:26.982417 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:26.982285    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnhkg\" (UniqueName: \"kubernetes.io/projected/2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51-kube-api-access-hnhkg\") pod \"payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n\" (UID: \"2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"
Sep 19 04:40:27.083570 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.083529    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw6qg\" (UniqueName: \"kubernetes.io/projected/88109ad6-7267-4412-b1d9-8ecc03c47698-kube-api-access-jw6qg\") pod \"payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl\" (UID: \"88109ad6-7267-4412-b1d9-8ecc03c47698\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"
Sep 19 04:40:27.083815 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.083580    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnhkg\" (UniqueName: \"kubernetes.io/projected/2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51-kube-api-access-hnhkg\") pod \"payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n\" (UID: \"2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"
Sep 19 04:40:27.083815 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.083669    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n\" (UID: \"2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"
Sep 19 04:40:27.083815 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.083737    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88109ad6-7267-4412-b1d9-8ecc03c47698-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl\" (UID: \"88109ad6-7267-4412-b1d9-8ecc03c47698\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"
Sep 19 04:40:27.084438 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.084420    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n\" (UID: \"2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"
Sep 19 04:40:27.084481 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.084440    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88109ad6-7267-4412-b1d9-8ecc03c47698-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl\" (UID: \"88109ad6-7267-4412-b1d9-8ecc03c47698\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"
Sep 19 04:40:27.095232 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.095210    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnhkg\" (UniqueName: \"kubernetes.io/projected/2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51-kube-api-access-hnhkg\") pod \"payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n\" (UID: \"2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"
Sep 19 04:40:27.095340 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.095313    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw6qg\" (UniqueName: \"kubernetes.io/projected/88109ad6-7267-4412-b1d9-8ecc03c47698-kube-api-access-jw6qg\") pod \"payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl\" (UID: \"88109ad6-7267-4412-b1d9-8ecc03c47698\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"
Sep 19 04:40:27.138345 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.138313    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"
Sep 19 04:40:27.164057 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.164021    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:27.174341 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.174311    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"
Sep 19 04:40:27.421606 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.421583    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"]
Sep 19 04:40:27.424450 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:40:27.424426    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88109ad6_7267_4412_b1d9_8ecc03c47698.slice/crio-dd93ca0da83913a269d6acd6ed6e2b9126ad0d243fdba67515781baab4f59fc5 WatchSource:0}: Error finding container dd93ca0da83913a269d6acd6ed6e2b9126ad0d243fdba67515781baab4f59fc5: Status 404 returned error can't find the container with id dd93ca0da83913a269d6acd6ed6e2b9126ad0d243fdba67515781baab4f59fc5
Sep 19 04:40:27.461221 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.461199    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"]
Sep 19 04:40:27.463378 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:40:27.463353    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2265c6c7_2d93_40c6_a60e_f8fa5ae5ea51.slice/crio-be7fb297ac9978bef882d4662b76dfdcf3918b8ef43f7aaa01060e658b4dc90d WatchSource:0}: Error finding container be7fb297ac9978bef882d4662b76dfdcf3918b8ef43f7aaa01060e658b4dc90d: Status 404 returned error can't find the container with id be7fb297ac9978bef882d4662b76dfdcf3918b8ef43f7aaa01060e658b4dc90d
Sep 19 04:40:27.876608 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.876516    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:27.976490 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:27.976448    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:28.076053 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:28.076024    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:28.167805 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:28.167774    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:28.437905 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:28.437798    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl" event={"ID":"88109ad6-7267-4412-b1d9-8ecc03c47698","Type":"ContainerStarted","Data":"cbf430fa9d70b18035f3ae0fbc869f50c8a3fec97ff8a90b60168bf3099c0e9b"}
Sep 19 04:40:28.438328 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:28.437972    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"
Sep 19 04:40:28.438328 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:28.438017    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl" event={"ID":"88109ad6-7267-4412-b1d9-8ecc03c47698","Type":"ContainerStarted","Data":"dd93ca0da83913a269d6acd6ed6e2b9126ad0d243fdba67515781baab4f59fc5"}
Sep 19 04:40:28.439423 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:28.439403    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n" event={"ID":"2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51","Type":"ContainerStarted","Data":"0eee6c1cc108b20f015c25950b08d680a225d1417fb92a0c23a1041e00a08431"}
Sep 19 04:40:28.439528 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:28.439438    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n" event={"ID":"2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51","Type":"ContainerStarted","Data":"be7fb297ac9978bef882d4662b76dfdcf3918b8ef43f7aaa01060e658b4dc90d"}
Sep 19 04:40:28.439570 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:28.439540    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"
Sep 19 04:40:28.460817 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:28.460742    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl" podStartSLOduration=2.460726974 podStartE2EDuration="2.460726974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:40:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:40:28.459690636 +0000 UTC m=+1608.437887030" watchObservedRunningTime="2026-09-19 04:40:28.460726974 +0000 UTC m=+1608.438923364"
Sep 19 04:40:28.482344 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:28.482282    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n" podStartSLOduration=2.482263801 podStartE2EDuration="2.482263801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:40:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:40:28.482174454 +0000 UTC m=+1608.460370845" watchObservedRunningTime="2026-09-19 04:40:28.482263801 +0000 UTC m=+1608.460460196"
Sep 19 04:40:28.613156 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:28.613122    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:28.983552 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:28.983512    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:29.082543 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:29.082492    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:30.370301 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:30.370266    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:30.519770 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:30.519710    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:30.611247 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:30.611213    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:39.453651 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:39.453576    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"
Sep 19 04:40:39.454182 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:39.453658    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"
Sep 19 04:40:48.676700 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:48.676653    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:49.607549 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:49.607513    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:50.164489 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:50.164455    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:51.157448 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:51.157407    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:51.260260 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:51.260212    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:51.952659 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:51.952629    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-10376-3b8814"]
Sep 19 04:40:51.957356 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:51.957338    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-3b8814"
Sep 19 04:40:51.960581 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:51.960565    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6vmt9\""
Sep 19 04:40:51.979733 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:51.979710    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-10376-3b8814"]
Sep 19 04:40:52.042187 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:52.042158    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbzsc\" (UniqueName: \"kubernetes.io/projected/e1beeab2-9d48-47dd-bef0-4fe90be53287-kube-api-access-pbzsc\") pod \"test-curl-10376-3b8814\" (UID: \"e1beeab2-9d48-47dd-bef0-4fe90be53287\") " pod="opendatahub/test-curl-10376-3b8814"
Sep 19 04:40:52.143243 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:52.143203    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbzsc\" (UniqueName: \"kubernetes.io/projected/e1beeab2-9d48-47dd-bef0-4fe90be53287-kube-api-access-pbzsc\") pod \"test-curl-10376-3b8814\" (UID: \"e1beeab2-9d48-47dd-bef0-4fe90be53287\") " pod="opendatahub/test-curl-10376-3b8814"
Sep 19 04:40:52.158975 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:52.158949    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbzsc\" (UniqueName: \"kubernetes.io/projected/e1beeab2-9d48-47dd-bef0-4fe90be53287-kube-api-access-pbzsc\") pod \"test-curl-10376-3b8814\" (UID: \"e1beeab2-9d48-47dd-bef0-4fe90be53287\") " pod="opendatahub/test-curl-10376-3b8814"
Sep 19 04:40:52.266733 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:52.266647    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-3b8814"
Sep 19 04:40:52.461556 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:52.461528    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:52.558730 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:52.558709    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-10376-3b8814"]
Sep 19 04:40:52.561153 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:40:52.561130    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1beeab2_9d48_47dd_bef0_4fe90be53287.slice/crio-7684e1c5fad01d292a7685742dd782868e08b2c11d7adfa014945e9716ec2899 WatchSource:0}: Error finding container 7684e1c5fad01d292a7685742dd782868e08b2c11d7adfa014945e9716ec2899: Status 404 returned error can't find the container with id 7684e1c5fad01d292a7685742dd782868e08b2c11d7adfa014945e9716ec2899
Sep 19 04:40:52.574177 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:52.574150    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-10376-3b8814" event={"ID":"e1beeab2-9d48-47dd-bef0-4fe90be53287","Type":"ContainerStarted","Data":"7684e1c5fad01d292a7685742dd782868e08b2c11d7adfa014945e9716ec2899"}
Sep 19 04:40:53.581550 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:53.581514    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-10376-3b8814" event={"ID":"e1beeab2-9d48-47dd-bef0-4fe90be53287","Type":"ContainerStarted","Data":"8299c44a590ce008734d7aa9615cf41865f343ee266074b8dd0b69bf2b0f69a5"}
Sep 19 04:40:53.605085 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:53.605034    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-10376-3b8814" podStartSLOduration=2.6050154880000003 podStartE2EDuration="2.605015488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:40:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:40:53.604058942 +0000 UTC m=+1633.582255331" watchObservedRunningTime="2026-09-19 04:40:53.605015488 +0000 UTC m=+1633.583211877"
Sep 19 04:40:53.718563 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:53.718512    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:54.199984 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:54.199950    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-10376-3b8814"]
Sep 19 04:40:54.204821 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:54.204737    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-10376-3b8814"]
Sep 19 04:40:54.353535 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:54.353460    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-10376-90b9e5"]
Sep 19 04:40:54.353914 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:54.353901    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1beeab2-9d48-47dd-bef0-4fe90be53287" containerName="test-curl-10376-3b8814"
Sep 19 04:40:54.353957 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:54.353916    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1beeab2-9d48-47dd-bef0-4fe90be53287" containerName="test-curl-10376-3b8814"
Sep 19 04:40:54.353996 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:54.353992    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1beeab2-9d48-47dd-bef0-4fe90be53287" containerName="test-curl-10376-3b8814"
Sep 19 04:40:54.357288 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:54.357273    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-90b9e5"
Sep 19 04:40:54.371374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:54.371348    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-10376-90b9e5"]
Sep 19 04:40:54.467979 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:54.467939    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp6k4\" (UniqueName: \"kubernetes.io/projected/8f1fa993-ea93-46e1-a299-91e2e3f36e0c-kube-api-access-cp6k4\") pod \"test-curl-10376-90b9e5\" (UID: \"8f1fa993-ea93-46e1-a299-91e2e3f36e0c\") " pod="opendatahub/test-curl-10376-90b9e5"
Sep 19 04:40:54.568782 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:54.568715    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6k4\" (UniqueName: \"kubernetes.io/projected/8f1fa993-ea93-46e1-a299-91e2e3f36e0c-kube-api-access-cp6k4\") pod \"test-curl-10376-90b9e5\" (UID: \"8f1fa993-ea93-46e1-a299-91e2e3f36e0c\") " pod="opendatahub/test-curl-10376-90b9e5"
Sep 19 04:40:54.587683 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:40:54.587653    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-10376-3b8814" container="test-curl-10376-3b8814"
Sep 19 04:40:54.599835 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:54.599808    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp6k4\" (UniqueName: \"kubernetes.io/projected/8f1fa993-ea93-46e1-a299-91e2e3f36e0c-kube-api-access-cp6k4\") pod \"test-curl-10376-90b9e5\" (UID: \"8f1fa993-ea93-46e1-a299-91e2e3f36e0c\") " pod="opendatahub/test-curl-10376-90b9e5"
Sep 19 04:40:54.666140 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:54.666105    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-90b9e5"
Sep 19 04:40:54.705526 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:54.705493    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:40:54.950485 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:54.950461    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-10376-90b9e5"]
Sep 19 04:40:54.952550 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:40:54.952516    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f1fa993_ea93_46e1_a299_91e2e3f36e0c.slice/crio-480db750b08a1c282686eae6e46a7a0204c48324c40dd4baa8186af0acefe842 WatchSource:0}: Error finding container 480db750b08a1c282686eae6e46a7a0204c48324c40dd4baa8186af0acefe842: Status 404 returned error can't find the container with id 480db750b08a1c282686eae6e46a7a0204c48324c40dd4baa8186af0acefe842
Sep 19 04:40:55.594447 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:55.594400    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-10376-90b9e5" event={"ID":"8f1fa993-ea93-46e1-a299-91e2e3f36e0c","Type":"ContainerStarted","Data":"5ed99dbfce983c2d139fb3cd30dc804156fda76fd27e54b176a0157b54d5650f"}
Sep 19 04:40:55.594930 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:55.594455    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-10376-90b9e5" event={"ID":"8f1fa993-ea93-46e1-a299-91e2e3f36e0c","Type":"ContainerStarted","Data":"480db750b08a1c282686eae6e46a7a0204c48324c40dd4baa8186af0acefe842"}
Sep 19 04:40:55.594930 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:55.594515    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-10376-3b8814" podUID="e1beeab2-9d48-47dd-bef0-4fe90be53287" containerName="test-curl-10376-3b8814" containerID="cri-o://8299c44a590ce008734d7aa9615cf41865f343ee266074b8dd0b69bf2b0f69a5" gracePeriod=2
Sep 19 04:40:55.632406 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:55.632306    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-10376-90b9e5" podStartSLOduration=1.632290486 podStartE2EDuration="1.632290486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:40:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:40:55.628123125 +0000 UTC m=+1635.606319515" watchObservedRunningTime="2026-09-19 04:40:55.632290486 +0000 UTC m=+1635.610486875"
Sep 19 04:40:56.331773 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:56.331721    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-10376-90b9e5"]
Sep 19 04:40:56.335158 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:56.335130    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-10376-90b9e5"]
Sep 19 04:40:56.461692 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:56.461659    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-10376-ea48f6"]
Sep 19 04:40:56.462116 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:56.462103    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f1fa993-ea93-46e1-a299-91e2e3f36e0c" containerName="test-curl-10376-90b9e5"
Sep 19 04:40:56.462160 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:56.462119    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f1fa993-ea93-46e1-a299-91e2e3f36e0c" containerName="test-curl-10376-90b9e5"
Sep 19 04:40:56.462201 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:56.462195    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f1fa993-ea93-46e1-a299-91e2e3f36e0c" containerName="test-curl-10376-90b9e5"
Sep 19 04:40:56.465470 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:56.465453    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-ea48f6"
Sep 19 04:40:56.491938 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:56.491906    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-10376-ea48f6"]
Sep 19 04:40:56.591656 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:56.591611    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5nq2\" (UniqueName: \"kubernetes.io/projected/c0b8ff30-8970-4a57-be13-10ea4e90a338-kube-api-access-c5nq2\") pod \"test-curl-10376-ea48f6\" (UID: \"c0b8ff30-8970-4a57-be13-10ea4e90a338\") " pod="opendatahub/test-curl-10376-ea48f6"
Sep 19 04:40:56.600142 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:40:56.600103    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-10376-90b9e5" container="test-curl-10376-90b9e5"
Sep 19 04:40:56.693075 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:56.693039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5nq2\" (UniqueName: \"kubernetes.io/projected/c0b8ff30-8970-4a57-be13-10ea4e90a338-kube-api-access-c5nq2\") pod \"test-curl-10376-ea48f6\" (UID: \"c0b8ff30-8970-4a57-be13-10ea4e90a338\") " pod="opendatahub/test-curl-10376-ea48f6"
Sep 19 04:40:56.702410 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:56.702379    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5nq2\" (UniqueName: \"kubernetes.io/projected/c0b8ff30-8970-4a57-be13-10ea4e90a338-kube-api-access-c5nq2\") pod \"test-curl-10376-ea48f6\" (UID: \"c0b8ff30-8970-4a57-be13-10ea4e90a338\") " pod="opendatahub/test-curl-10376-ea48f6"
Sep 19 04:40:56.775158 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:56.775078    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-ea48f6"
Sep 19 04:40:57.049541 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:57.049509    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-10376-ea48f6"]
Sep 19 04:40:57.050786 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:40:57.050736    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0b8ff30_8970_4a57_be13_10ea4e90a338.slice/crio-4347a0893b6caeb8c81d9b32abb6640ed723667d14d58d92224a9245edea9cef WatchSource:0}: Error finding container 4347a0893b6caeb8c81d9b32abb6640ed723667d14d58d92224a9245edea9cef: Status 404 returned error can't find the container with id 4347a0893b6caeb8c81d9b32abb6640ed723667d14d58d92224a9245edea9cef
Sep 19 04:40:57.607368 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:57.607341    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-10376-ea48f6" event={"ID":"c0b8ff30-8970-4a57-be13-10ea4e90a338","Type":"ContainerStarted","Data":"da16553142336182d55b61e71096fa2e44655f50b102adf3d33f7be2f57172c1"}
Sep 19 04:40:57.607702 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:57.607380    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-10376-ea48f6" event={"ID":"c0b8ff30-8970-4a57-be13-10ea4e90a338","Type":"ContainerStarted","Data":"4347a0893b6caeb8c81d9b32abb6640ed723667d14d58d92224a9245edea9cef"}
Sep 19 04:40:57.607702 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:57.607396    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-10376-90b9e5" podUID="8f1fa993-ea93-46e1-a299-91e2e3f36e0c" containerName="test-curl-10376-90b9e5" containerID="cri-o://5ed99dbfce983c2d139fb3cd30dc804156fda76fd27e54b176a0157b54d5650f" gracePeriod=2
Sep 19 04:40:57.625018 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:57.624974    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-10376-ea48f6" podStartSLOduration=1.624958834 podStartE2EDuration="1.624958834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:40:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:40:57.623142795 +0000 UTC m=+1637.601339187" watchObservedRunningTime="2026-09-19 04:40:57.624958834 +0000 UTC m=+1637.603155225"
Sep 19 04:40:57.780965 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:57.780941    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-3b8814"
Sep 19 04:40:57.903326 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:57.903295    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbzsc\" (UniqueName: \"kubernetes.io/projected/e1beeab2-9d48-47dd-bef0-4fe90be53287-kube-api-access-pbzsc\") pod \"e1beeab2-9d48-47dd-bef0-4fe90be53287\" (UID: \"e1beeab2-9d48-47dd-bef0-4fe90be53287\") "
Sep 19 04:40:57.905672 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:57.905638    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1beeab2-9d48-47dd-bef0-4fe90be53287-kube-api-access-pbzsc" (OuterVolumeSpecName: "kube-api-access-pbzsc") pod "e1beeab2-9d48-47dd-bef0-4fe90be53287" (UID: "e1beeab2-9d48-47dd-bef0-4fe90be53287"). InnerVolumeSpecName "kube-api-access-pbzsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:40:58.004300 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.004258    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbzsc\" (UniqueName: \"kubernetes.io/projected/e1beeab2-9d48-47dd-bef0-4fe90be53287-kube-api-access-pbzsc\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:40:58.249516 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.249398    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-10376-ea48f6"]
Sep 19 04:40:58.251714 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.251687    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-10376-ea48f6"]
Sep 19 04:40:58.373592 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.373559    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-10376-5fa938"]
Sep 19 04:40:58.374020 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.374006    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0b8ff30-8970-4a57-be13-10ea4e90a338" containerName="test-curl-10376-ea48f6"
Sep 19 04:40:58.374063 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.374022    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0b8ff30-8970-4a57-be13-10ea4e90a338" containerName="test-curl-10376-ea48f6"
Sep 19 04:40:58.374101 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.374084    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0b8ff30-8970-4a57-be13-10ea4e90a338" containerName="test-curl-10376-ea48f6"
Sep 19 04:40:58.377055 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.377039    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-5fa938"
Sep 19 04:40:58.392734 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.392707    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-10376-5fa938"]
Sep 19 04:40:58.509100 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.509013    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrxtj\" (UniqueName: \"kubernetes.io/projected/7fe4ba46-9c68-4fd4-959e-7e789a0f47b4-kube-api-access-hrxtj\") pod \"test-curl-10376-5fa938\" (UID: \"7fe4ba46-9c68-4fd4-959e-7e789a0f47b4\") " pod="opendatahub/test-curl-10376-5fa938"
Sep 19 04:40:58.540056 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.540021    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1beeab2-9d48-47dd-bef0-4fe90be53287" path="/var/lib/kubelet/pods/e1beeab2-9d48-47dd-bef0-4fe90be53287/volumes"
Sep 19 04:40:58.610007 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.609970    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrxtj\" (UniqueName: \"kubernetes.io/projected/7fe4ba46-9c68-4fd4-959e-7e789a0f47b4-kube-api-access-hrxtj\") pod \"test-curl-10376-5fa938\" (UID: \"7fe4ba46-9c68-4fd4-959e-7e789a0f47b4\") " pod="opendatahub/test-curl-10376-5fa938"
Sep 19 04:40:58.614011 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.613985    2569 generic.go:356] "Generic (PLEG): container finished" podID="e1beeab2-9d48-47dd-bef0-4fe90be53287" containerID="8299c44a590ce008734d7aa9615cf41865f343ee266074b8dd0b69bf2b0f69a5" exitCode=137
Sep 19 04:40:58.614152 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.614026    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-3b8814"
Sep 19 04:40:58.614152 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.614093    2569 scope.go:117] "RemoveContainer" containerID="8299c44a590ce008734d7aa9615cf41865f343ee266074b8dd0b69bf2b0f69a5"
Sep 19 04:40:58.614273 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:40:58.614259    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-10376-ea48f6" container="test-curl-10376-ea48f6"
Sep 19 04:40:58.622906 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.622886    2569 scope.go:117] "RemoveContainer" containerID="8299c44a590ce008734d7aa9615cf41865f343ee266074b8dd0b69bf2b0f69a5"
Sep 19 04:40:58.623226 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:40:58.623206    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8299c44a590ce008734d7aa9615cf41865f343ee266074b8dd0b69bf2b0f69a5\": container with ID starting with 8299c44a590ce008734d7aa9615cf41865f343ee266074b8dd0b69bf2b0f69a5 not found: ID does not exist" containerID="8299c44a590ce008734d7aa9615cf41865f343ee266074b8dd0b69bf2b0f69a5"
Sep 19 04:40:58.623293 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.623235    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8299c44a590ce008734d7aa9615cf41865f343ee266074b8dd0b69bf2b0f69a5"} err="failed to get container status \"8299c44a590ce008734d7aa9615cf41865f343ee266074b8dd0b69bf2b0f69a5\": rpc error: code = NotFound desc = could not find container \"8299c44a590ce008734d7aa9615cf41865f343ee266074b8dd0b69bf2b0f69a5\": container with ID starting with 8299c44a590ce008734d7aa9615cf41865f343ee266074b8dd0b69bf2b0f69a5 not found: ID does not exist"
Sep 19 04:40:58.624089 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.624072    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrxtj\" (UniqueName: \"kubernetes.io/projected/7fe4ba46-9c68-4fd4-959e-7e789a0f47b4-kube-api-access-hrxtj\") pod \"test-curl-10376-5fa938\" (UID: \"7fe4ba46-9c68-4fd4-959e-7e789a0f47b4\") " pod="opendatahub/test-curl-10376-5fa938"
Sep 19 04:40:58.685983 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.685953    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-5fa938"
Sep 19 04:40:58.960315 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:58.960293    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-10376-5fa938"]
Sep 19 04:40:58.962138 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:40:58.962098    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7fe4ba46_9c68_4fd4_959e_7e789a0f47b4.slice/crio-66c183a9e29963e0ff668ebdd2f5df0216e0bf763c96b156dfb42db716797351 WatchSource:0}: Error finding container 66c183a9e29963e0ff668ebdd2f5df0216e0bf763c96b156dfb42db716797351: Status 404 returned error can't find the container with id 66c183a9e29963e0ff668ebdd2f5df0216e0bf763c96b156dfb42db716797351
Sep 19 04:40:59.622821 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:59.622791    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-10376-5fa938" event={"ID":"7fe4ba46-9c68-4fd4-959e-7e789a0f47b4","Type":"ContainerStarted","Data":"f0de79182c16bc32a60e2a46541413517cc63765fe304f9cfab9e739d70445a6"}
Sep 19 04:40:59.623168 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:59.622840    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-10376-5fa938" event={"ID":"7fe4ba46-9c68-4fd4-959e-7e789a0f47b4","Type":"ContainerStarted","Data":"66c183a9e29963e0ff668ebdd2f5df0216e0bf763c96b156dfb42db716797351"}
Sep 19 04:40:59.623168 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:59.623035    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-10376-ea48f6" podUID="c0b8ff30-8970-4a57-be13-10ea4e90a338" containerName="test-curl-10376-ea48f6" containerID="cri-o://da16553142336182d55b61e71096fa2e44655f50b102adf3d33f7be2f57172c1" gracePeriod=2
Sep 19 04:40:59.640498 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:59.640453    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-10376-5fa938" podStartSLOduration=1.640438944 podStartE2EDuration="1.640438944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:40:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:40:59.639516732 +0000 UTC m=+1639.617713117" watchObservedRunningTime="2026-09-19 04:40:59.640438944 +0000 UTC m=+1639.618635334"
Sep 19 04:40:59.802001 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:59.801978    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-90b9e5"
Sep 19 04:40:59.922586 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:59.922550    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cp6k4\" (UniqueName: \"kubernetes.io/projected/8f1fa993-ea93-46e1-a299-91e2e3f36e0c-kube-api-access-cp6k4\") pod \"8f1fa993-ea93-46e1-a299-91e2e3f36e0c\" (UID: \"8f1fa993-ea93-46e1-a299-91e2e3f36e0c\") "
Sep 19 04:40:59.924788 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:40:59.924763    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f1fa993-ea93-46e1-a299-91e2e3f36e0c-kube-api-access-cp6k4" (OuterVolumeSpecName: "kube-api-access-cp6k4") pod "8f1fa993-ea93-46e1-a299-91e2e3f36e0c" (UID: "8f1fa993-ea93-46e1-a299-91e2e3f36e0c"). InnerVolumeSpecName "kube-api-access-cp6k4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:41:00.023422 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:00.023384    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cp6k4\" (UniqueName: \"kubernetes.io/projected/8f1fa993-ea93-46e1-a299-91e2e3f36e0c-kube-api-access-cp6k4\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:41:00.257620 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:00.257538    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-10376-5fa938"]
Sep 19 04:41:00.266246 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:00.266210    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-10376-5fa938"]
Sep 19 04:41:00.540476 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:00.540398    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f1fa993-ea93-46e1-a299-91e2e3f36e0c" path="/var/lib/kubelet/pods/8f1fa993-ea93-46e1-a299-91e2e3f36e0c/volumes"
Sep 19 04:41:00.630807 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:00.630737    2569 generic.go:356] "Generic (PLEG): container finished" podID="8f1fa993-ea93-46e1-a299-91e2e3f36e0c" containerID="5ed99dbfce983c2d139fb3cd30dc804156fda76fd27e54b176a0157b54d5650f" exitCode=137
Sep 19 04:41:00.630807 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:00.630802    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-90b9e5"
Sep 19 04:41:00.631353 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:00.630802    2569 scope.go:117] "RemoveContainer" containerID="5ed99dbfce983c2d139fb3cd30dc804156fda76fd27e54b176a0157b54d5650f"
Sep 19 04:41:00.631353 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:41:00.631007    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-10376-5fa938" container="test-curl-10376-5fa938"
Sep 19 04:41:00.639360 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:00.639344    2569 scope.go:117] "RemoveContainer" containerID="5ed99dbfce983c2d139fb3cd30dc804156fda76fd27e54b176a0157b54d5650f"
Sep 19 04:41:00.639624 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:41:00.639606    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ed99dbfce983c2d139fb3cd30dc804156fda76fd27e54b176a0157b54d5650f\": container with ID starting with 5ed99dbfce983c2d139fb3cd30dc804156fda76fd27e54b176a0157b54d5650f not found: ID does not exist" containerID="5ed99dbfce983c2d139fb3cd30dc804156fda76fd27e54b176a0157b54d5650f"
Sep 19 04:41:00.639724 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:00.639632    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ed99dbfce983c2d139fb3cd30dc804156fda76fd27e54b176a0157b54d5650f"} err="failed to get container status \"5ed99dbfce983c2d139fb3cd30dc804156fda76fd27e54b176a0157b54d5650f\": rpc error: code = NotFound desc = could not find container \"5ed99dbfce983c2d139fb3cd30dc804156fda76fd27e54b176a0157b54d5650f\": container with ID starting with 5ed99dbfce983c2d139fb3cd30dc804156fda76fd27e54b176a0157b54d5650f not found: ID does not exist"
Sep 19 04:41:00.909686 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:00.909640    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:01.257977 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:01.257884    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:01.379097 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:01.379060    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:01.637421 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:01.637380    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-10376-5fa938" podUID="7fe4ba46-9c68-4fd4-959e-7e789a0f47b4" containerName="test-curl-10376-5fa938" containerID="cri-o://f0de79182c16bc32a60e2a46541413517cc63765fe304f9cfab9e739d70445a6" gracePeriod=2
Sep 19 04:41:01.802210 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:01.802185    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-ea48f6"
Sep 19 04:41:01.942569 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:01.942537    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5nq2\" (UniqueName: \"kubernetes.io/projected/c0b8ff30-8970-4a57-be13-10ea4e90a338-kube-api-access-c5nq2\") pod \"c0b8ff30-8970-4a57-be13-10ea4e90a338\" (UID: \"c0b8ff30-8970-4a57-be13-10ea4e90a338\") "
Sep 19 04:41:01.944729 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:01.944696    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0b8ff30-8970-4a57-be13-10ea4e90a338-kube-api-access-c5nq2" (OuterVolumeSpecName: "kube-api-access-c5nq2") pod "c0b8ff30-8970-4a57-be13-10ea4e90a338" (UID: "c0b8ff30-8970-4a57-be13-10ea4e90a338"). InnerVolumeSpecName "kube-api-access-c5nq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:41:02.043251 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:02.043218    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5nq2\" (UniqueName: \"kubernetes.io/projected/c0b8ff30-8970-4a57-be13-10ea4e90a338-kube-api-access-c5nq2\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:41:02.544297 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:02.544260    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0b8ff30-8970-4a57-be13-10ea4e90a338" path="/var/lib/kubelet/pods/c0b8ff30-8970-4a57-be13-10ea4e90a338/volumes"
Sep 19 04:41:02.644383 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:02.644345    2569 generic.go:356] "Generic (PLEG): container finished" podID="c0b8ff30-8970-4a57-be13-10ea4e90a338" containerID="da16553142336182d55b61e71096fa2e44655f50b102adf3d33f7be2f57172c1" exitCode=137
Sep 19 04:41:02.644786 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:02.644398    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-ea48f6"
Sep 19 04:41:02.644786 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:02.644434    2569 scope.go:117] "RemoveContainer" containerID="da16553142336182d55b61e71096fa2e44655f50b102adf3d33f7be2f57172c1"
Sep 19 04:41:02.652944 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:02.652929    2569 scope.go:117] "RemoveContainer" containerID="da16553142336182d55b61e71096fa2e44655f50b102adf3d33f7be2f57172c1"
Sep 19 04:41:02.653227 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:41:02.653208    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da16553142336182d55b61e71096fa2e44655f50b102adf3d33f7be2f57172c1\": container with ID starting with da16553142336182d55b61e71096fa2e44655f50b102adf3d33f7be2f57172c1 not found: ID does not exist" containerID="da16553142336182d55b61e71096fa2e44655f50b102adf3d33f7be2f57172c1"
Sep 19 04:41:02.653274 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:02.653234    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da16553142336182d55b61e71096fa2e44655f50b102adf3d33f7be2f57172c1"} err="failed to get container status \"da16553142336182d55b61e71096fa2e44655f50b102adf3d33f7be2f57172c1\": rpc error: code = NotFound desc = could not find container \"da16553142336182d55b61e71096fa2e44655f50b102adf3d33f7be2f57172c1\": container with ID starting with da16553142336182d55b61e71096fa2e44655f50b102adf3d33f7be2f57172c1 not found: ID does not exist"
Sep 19 04:41:03.743659 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:03.743587    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:03.814459 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:03.814435    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-5fa938"
Sep 19 04:41:03.858124 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:03.858096    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrxtj\" (UniqueName: \"kubernetes.io/projected/7fe4ba46-9c68-4fd4-959e-7e789a0f47b4-kube-api-access-hrxtj\") pod \"7fe4ba46-9c68-4fd4-959e-7e789a0f47b4\" (UID: \"7fe4ba46-9c68-4fd4-959e-7e789a0f47b4\") "
Sep 19 04:41:03.860220 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:03.860187    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fe4ba46-9c68-4fd4-959e-7e789a0f47b4-kube-api-access-hrxtj" (OuterVolumeSpecName: "kube-api-access-hrxtj") pod "7fe4ba46-9c68-4fd4-959e-7e789a0f47b4" (UID: "7fe4ba46-9c68-4fd4-959e-7e789a0f47b4"). InnerVolumeSpecName "kube-api-access-hrxtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:41:03.959431 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:03.959350    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrxtj\" (UniqueName: \"kubernetes.io/projected/7fe4ba46-9c68-4fd4-959e-7e789a0f47b4-kube-api-access-hrxtj\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:41:04.321743 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:04.321669    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:04.431383 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:04.431345    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:04.539174 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:04.539137    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fe4ba46-9c68-4fd4-959e-7e789a0f47b4" path="/var/lib/kubelet/pods/7fe4ba46-9c68-4fd4-959e-7e789a0f47b4/volumes"
Sep 19 04:41:04.657236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:04.657202    2569 generic.go:356] "Generic (PLEG): container finished" podID="7fe4ba46-9c68-4fd4-959e-7e789a0f47b4" containerID="f0de79182c16bc32a60e2a46541413517cc63765fe304f9cfab9e739d70445a6" exitCode=137
Sep 19 04:41:04.657417 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:04.657242    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10376-5fa938"
Sep 19 04:41:04.657417 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:04.657300    2569 scope.go:117] "RemoveContainer" containerID="f0de79182c16bc32a60e2a46541413517cc63765fe304f9cfab9e739d70445a6"
Sep 19 04:41:04.665710 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:04.665693    2569 scope.go:117] "RemoveContainer" containerID="f0de79182c16bc32a60e2a46541413517cc63765fe304f9cfab9e739d70445a6"
Sep 19 04:41:04.665970 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:41:04.665951    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0de79182c16bc32a60e2a46541413517cc63765fe304f9cfab9e739d70445a6\": container with ID starting with f0de79182c16bc32a60e2a46541413517cc63765fe304f9cfab9e739d70445a6 not found: ID does not exist" containerID="f0de79182c16bc32a60e2a46541413517cc63765fe304f9cfab9e739d70445a6"
Sep 19 04:41:04.666038 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:04.665977    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0de79182c16bc32a60e2a46541413517cc63765fe304f9cfab9e739d70445a6"} err="failed to get container status \"f0de79182c16bc32a60e2a46541413517cc63765fe304f9cfab9e739d70445a6\": rpc error: code = NotFound desc = could not find container \"f0de79182c16bc32a60e2a46541413517cc63765fe304f9cfab9e739d70445a6\": container with ID starting with f0de79182c16bc32a60e2a46541413517cc63765fe304f9cfab9e739d70445a6 not found: ID does not exist"
Sep 19 04:41:04.809374 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:04.809341    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:06.465493 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:06.465450    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:07.328387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:07.328348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:08.294612 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:08.294578    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:09.022802 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:09.022770    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:09.974415 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:09.974381    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:10.082667 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:10.082631    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:10.487042 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:10.486993    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:10.690524 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:10.690489    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:10.852123 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:10.852024    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:10.958591 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:10.958559    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"]
Sep 19 04:41:10.959127 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:10.959106    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fe4ba46-9c68-4fd4-959e-7e789a0f47b4" containerName="test-curl-10376-5fa938"
Sep 19 04:41:10.959189 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:10.959133    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fe4ba46-9c68-4fd4-959e-7e789a0f47b4" containerName="test-curl-10376-5fa938"
Sep 19 04:41:10.959296 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:10.959283    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fe4ba46-9c68-4fd4-959e-7e789a0f47b4" containerName="test-curl-10376-5fa938"
Sep 19 04:41:10.962643 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:10.962626    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"
Sep 19 04:41:10.971073 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:10.971054    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a0ed681d\""
Sep 19 04:41:10.971293 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:10.971280    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a0ed681d-dockercfg-zl276\""
Sep 19 04:41:11.003545 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.003523    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"]
Sep 19 04:41:11.025211 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.025178    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e4d9fa8-f743-49de-b0d8-5b5d50129282-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf\" (UID: \"0e4d9fa8-f743-49de-b0d8-5b5d50129282\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"
Sep 19 04:41:11.025341 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.025214    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbtlm\" (UniqueName: \"kubernetes.io/projected/0e4d9fa8-f743-49de-b0d8-5b5d50129282-kube-api-access-sbtlm\") pod \"payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf\" (UID: \"0e4d9fa8-f743-49de-b0d8-5b5d50129282\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"
Sep 19 04:41:11.053653 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.053624    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"]
Sep 19 04:41:11.057319 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.057303    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"
Sep 19 04:41:11.087112 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.087087    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"]
Sep 19 04:41:11.125788 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.125694    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b1da557-280f-4b7b-817f-e2c6db580529-plugins-config-volume\") pod \"payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm\" (UID: \"7b1da557-280f-4b7b-817f-e2c6db580529\") " pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"
Sep 19 04:41:11.125788 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.125779    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e4d9fa8-f743-49de-b0d8-5b5d50129282-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf\" (UID: \"0e4d9fa8-f743-49de-b0d8-5b5d50129282\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"
Sep 19 04:41:11.126024 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.125803    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbtlm\" (UniqueName: \"kubernetes.io/projected/0e4d9fa8-f743-49de-b0d8-5b5d50129282-kube-api-access-sbtlm\") pod \"payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf\" (UID: \"0e4d9fa8-f743-49de-b0d8-5b5d50129282\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"
Sep 19 04:41:11.126024 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.125853    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfczw\" (UniqueName: \"kubernetes.io/projected/7b1da557-280f-4b7b-817f-e2c6db580529-kube-api-access-tfczw\") pod \"payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm\" (UID: \"7b1da557-280f-4b7b-817f-e2c6db580529\") " pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"
Sep 19 04:41:11.126517 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.126490    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e4d9fa8-f743-49de-b0d8-5b5d50129282-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf\" (UID: \"0e4d9fa8-f743-49de-b0d8-5b5d50129282\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"
Sep 19 04:41:11.144710 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.144680    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbtlm\" (UniqueName: \"kubernetes.io/projected/0e4d9fa8-f743-49de-b0d8-5b5d50129282-kube-api-access-sbtlm\") pod \"payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf\" (UID: \"0e4d9fa8-f743-49de-b0d8-5b5d50129282\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"
Sep 19 04:41:11.226616 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.226579    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfczw\" (UniqueName: \"kubernetes.io/projected/7b1da557-280f-4b7b-817f-e2c6db580529-kube-api-access-tfczw\") pod \"payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm\" (UID: \"7b1da557-280f-4b7b-817f-e2c6db580529\") " pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"
Sep 19 04:41:11.226843 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.226672    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b1da557-280f-4b7b-817f-e2c6db580529-plugins-config-volume\") pod \"payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm\" (UID: \"7b1da557-280f-4b7b-817f-e2c6db580529\") " pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"
Sep 19 04:41:11.227427 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.227399    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b1da557-280f-4b7b-817f-e2c6db580529-plugins-config-volume\") pod \"payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm\" (UID: \"7b1da557-280f-4b7b-817f-e2c6db580529\") " pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"
Sep 19 04:41:11.239935 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.239911    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfczw\" (UniqueName: \"kubernetes.io/projected/7b1da557-280f-4b7b-817f-e2c6db580529-kube-api-access-tfczw\") pod \"payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm\" (UID: \"7b1da557-280f-4b7b-817f-e2c6db580529\") " pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"
Sep 19 04:41:11.272786 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.272739    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"
Sep 19 04:41:11.366850 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.366817    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"
Sep 19 04:41:11.553570 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.553547    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"]
Sep 19 04:41:11.557672 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:41:11.557638    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4d9fa8_f743_49de_b0d8_5b5d50129282.slice/crio-4599dbdca7ced855bf8ec296f1516e646851c19c6c631b93c3d47df8ae42709a WatchSource:0}: Error finding container 4599dbdca7ced855bf8ec296f1516e646851c19c6c631b93c3d47df8ae42709a: Status 404 returned error can't find the container with id 4599dbdca7ced855bf8ec296f1516e646851c19c6c631b93c3d47df8ae42709a
Sep 19 04:41:11.655507 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.655427    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"]
Sep 19 04:41:11.700739 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.700709    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm" event={"ID":"7b1da557-280f-4b7b-817f-e2c6db580529","Type":"ContainerStarted","Data":"3510ea4b17fdf91ffe38487f8196843883bbfc6932ea1379d7fc70a68e3a1e82"}
Sep 19 04:41:11.702868 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.702840    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf" event={"ID":"0e4d9fa8-f743-49de-b0d8-5b5d50129282","Type":"ContainerStarted","Data":"b740835510c23fa1eb7cae2b4f5b08f6a95e81b7c14579b0ea9cb69d56e8fcc6"}
Sep 19 04:41:11.703018 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.702886    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf" event={"ID":"0e4d9fa8-f743-49de-b0d8-5b5d50129282","Type":"ContainerStarted","Data":"4599dbdca7ced855bf8ec296f1516e646851c19c6c631b93c3d47df8ae42709a"}
Sep 19 04:41:11.703119 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.703080    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"
Sep 19 04:41:11.738419 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:11.738367    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf" podStartSLOduration=1.7383497490000002 podStartE2EDuration="1.738349749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:41:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:41:11.73702713 +0000 UTC m=+1651.715223520" watchObservedRunningTime="2026-09-19 04:41:11.738349749 +0000 UTC m=+1651.716546139"
Sep 19 04:41:12.711649 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:12.711613    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm" event={"ID":"7b1da557-280f-4b7b-817f-e2c6db580529","Type":"ContainerStarted","Data":"c19d65fc0732a866a656f174b18dd18ff6bb7d83261c527d5f2580a30f9ad878"}
Sep 19 04:41:12.712108 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:12.711842    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"
Sep 19 04:41:22.713940 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:22.713909    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"
Sep 19 04:41:22.737870 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:22.737822    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm" podStartSLOduration=12.737804155 podStartE2EDuration="12.737804155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:41:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:41:12.745576147 +0000 UTC m=+1652.723772537" watchObservedRunningTime="2026-09-19 04:41:22.737804155 +0000 UTC m=+1662.716000546"
Sep 19 04:41:23.077934 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:23.077835    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:23.719956 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:23.719921    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"
Sep 19 04:41:32.802047 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:32.801996    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:33.589465 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:33.589436    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:34.356164 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:34.356125    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:34.601963 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:34.601929    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:35.428336 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:35.428304    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:36.217659 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:36.217630    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:37.312950 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:37.312917    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:38.221564 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:38.221531    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:42.209577 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:42.209541    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:42.310437 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:42.310404    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:41:46.699259 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:41:46.699219    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:00.659640 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:00.659598    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:01.487076 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:01.487036    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:02.583149 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:02.583117    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:03.743598 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:03.743562    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:04.623233 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:04.623203    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:05.717315 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:05.717277    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:06.322035 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:06.322004    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:06.585211 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:06.585117    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:07.443587 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:07.443554    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:09.278151 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:09.278111    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:10.092999 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:10.092963    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"]
Sep 19 04:42:10.101418 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:10.101386    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:11.190035 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.189985    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:11.212459 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.212427    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"]
Sep 19 04:42:11.212681 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.212630    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg" podUID="2f3b4d07-6600-4a15-83e2-0b4dc0edc901" containerName="payload-processing" containerID="cri-o://4ce485b39680112990b9a4208697e5d1da0865e9d91eb140415646b80a8bee98" gracePeriod=30
Sep 19 04:42:11.289918 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.289862    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:11.408154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.408122    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:11.490883 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.490847    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"
Sep 19 04:42:11.505848 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.505815    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:11.633589 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.633560    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6lc7\" (UniqueName: \"kubernetes.io/projected/2f3b4d07-6600-4a15-83e2-0b4dc0edc901-kube-api-access-q6lc7\") pod \"2f3b4d07-6600-4a15-83e2-0b4dc0edc901\" (UID: \"2f3b4d07-6600-4a15-83e2-0b4dc0edc901\") "
Sep 19 04:42:11.633801 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.633608    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f3b4d07-6600-4a15-83e2-0b4dc0edc901-plugins-config-volume\") pod \"2f3b4d07-6600-4a15-83e2-0b4dc0edc901\" (UID: \"2f3b4d07-6600-4a15-83e2-0b4dc0edc901\") "
Sep 19 04:42:11.634044 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.634024    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f3b4d07-6600-4a15-83e2-0b4dc0edc901-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2f3b4d07-6600-4a15-83e2-0b4dc0edc901" (UID: "2f3b4d07-6600-4a15-83e2-0b4dc0edc901"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:42:11.636088 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.636052    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f3b4d07-6600-4a15-83e2-0b4dc0edc901-kube-api-access-q6lc7" (OuterVolumeSpecName: "kube-api-access-q6lc7") pod "2f3b4d07-6600-4a15-83e2-0b4dc0edc901" (UID: "2f3b4d07-6600-4a15-83e2-0b4dc0edc901"). InnerVolumeSpecName "kube-api-access-q6lc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:42:11.734704 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.734631    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6lc7\" (UniqueName: \"kubernetes.io/projected/2f3b4d07-6600-4a15-83e2-0b4dc0edc901-kube-api-access-q6lc7\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:11.734704 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.734657    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2f3b4d07-6600-4a15-83e2-0b4dc0edc901-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:11.800469 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.800430    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:11.907471 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:11.907440    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:12.032257 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:12.032160    2569 generic.go:356] "Generic (PLEG): container finished" podID="2f3b4d07-6600-4a15-83e2-0b4dc0edc901" containerID="4ce485b39680112990b9a4208697e5d1da0865e9d91eb140415646b80a8bee98" exitCode=0
Sep 19 04:42:12.032257 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:12.032208    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"
Sep 19 04:42:12.032496 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:12.032251    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg" event={"ID":"2f3b4d07-6600-4a15-83e2-0b4dc0edc901","Type":"ContainerDied","Data":"4ce485b39680112990b9a4208697e5d1da0865e9d91eb140415646b80a8bee98"}
Sep 19 04:42:12.032496 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:12.032313    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg" event={"ID":"2f3b4d07-6600-4a15-83e2-0b4dc0edc901","Type":"ContainerDied","Data":"bc0033d9822e8311dc001aceae5cc2d41cfc8fae76b6f04d3719c49b5f4bcce2"}
Sep 19 04:42:12.032496 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:12.032343    2569 scope.go:117] "RemoveContainer" containerID="4ce485b39680112990b9a4208697e5d1da0865e9d91eb140415646b80a8bee98"
Sep 19 04:42:12.041909 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:12.041891    2569 scope.go:117] "RemoveContainer" containerID="4ce485b39680112990b9a4208697e5d1da0865e9d91eb140415646b80a8bee98"
Sep 19 04:42:12.042208 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:42:12.042189    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ce485b39680112990b9a4208697e5d1da0865e9d91eb140415646b80a8bee98\": container with ID starting with 4ce485b39680112990b9a4208697e5d1da0865e9d91eb140415646b80a8bee98 not found: ID does not exist" containerID="4ce485b39680112990b9a4208697e5d1da0865e9d91eb140415646b80a8bee98"
Sep 19 04:42:12.042253 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:12.042215    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ce485b39680112990b9a4208697e5d1da0865e9d91eb140415646b80a8bee98"} err="failed to get container status \"4ce485b39680112990b9a4208697e5d1da0865e9d91eb140415646b80a8bee98\": rpc error: code = NotFound desc = could not find container \"4ce485b39680112990b9a4208697e5d1da0865e9d91eb140415646b80a8bee98\": container with ID starting with 4ce485b39680112990b9a4208697e5d1da0865e9d91eb140415646b80a8bee98 not found: ID does not exist"
Sep 19 04:42:12.062053 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:12.062030    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"]
Sep 19 04:42:12.066337 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:12.066316    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-bcbdad-6bb78ccccc-v84fg"]
Sep 19 04:42:12.540354 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:12.540323    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f3b4d07-6600-4a15-83e2-0b4dc0edc901" path="/var/lib/kubelet/pods/2f3b4d07-6600-4a15-83e2-0b4dc0edc901/volumes"
Sep 19 04:42:13.012483 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:13.012453    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:14.066460 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:14.066417    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:15.091303 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:15.091270    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:15.864762 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:15.864710    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:16.872190 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:16.872149    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:17.636875 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.636842    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"]
Sep 19 04:42:17.637281 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.637268    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f3b4d07-6600-4a15-83e2-0b4dc0edc901" containerName="payload-processing"
Sep 19 04:42:17.637335 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.637282    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f3b4d07-6600-4a15-83e2-0b4dc0edc901" containerName="payload-processing"
Sep 19 04:42:17.637371 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.637355    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f3b4d07-6600-4a15-83e2-0b4dc0edc901" containerName="payload-processing"
Sep 19 04:42:17.641929 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.641910    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.645607 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.645582    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a0ed681d\"/\"default-dockercfg-n4f55\""
Sep 19 04:42:17.645776 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.645582    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a0ed681d\"/\"openshift-service-ca.crt\""
Sep 19 04:42:17.645776 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.645595    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a0ed681d\"/\"kube-root-ca.crt\""
Sep 19 04:42:17.645776 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.645636    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a0ed681d\"/\"e2e-lifecycle-model-a0ed681d-kserve-self-signed-certs\""
Sep 19 04:42:17.651247 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.650849    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"]
Sep 19 04:42:17.686618 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.686588    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-home\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.686817 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.686627    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-tmp-dir\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.686817 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.686670    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af286b5f-d1b2-4e79-8927-89804e046546-tls-certs\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.686817 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.686699    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-model-cache\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.686817 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.686742    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpr2x\" (UniqueName: \"kubernetes.io/projected/af286b5f-d1b2-4e79-8927-89804e046546-kube-api-access-cpr2x\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.686817 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.686799    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-dshm\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.788024 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.787995    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-home\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.788191 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.788040    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-tmp-dir\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.788191 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.788081    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af286b5f-d1b2-4e79-8927-89804e046546-tls-certs\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.788191 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.788127    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-model-cache\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.788191 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.788182    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpr2x\" (UniqueName: \"kubernetes.io/projected/af286b5f-d1b2-4e79-8927-89804e046546-kube-api-access-cpr2x\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.788362 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.788207    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-dshm\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.788466 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.788442    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-tmp-dir\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.788532 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.788485    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-home\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.788532 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.788515    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-model-cache\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.790343 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.790323    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-dshm\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.790593 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.790577    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af286b5f-d1b2-4e79-8927-89804e046546-tls-certs\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.797024 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.796999    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpr2x\" (UniqueName: \"kubernetes.io/projected/af286b5f-d1b2-4e79-8927-89804e046546-kube-api-access-cpr2x\") pod \"e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") " pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:17.938232 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.938115    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:17.955004 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:17.954985    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:18.230430 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:18.230406    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"]
Sep 19 04:42:18.233396 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:42:18.233370    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf286b5f_d1b2_4e79_8927_89804e046546.slice/crio-750eef7bfbf25729614edf80a495d996e806c5096e2c7eb5998ad8045a6806cd WatchSource:0}: Error finding container 750eef7bfbf25729614edf80a495d996e806c5096e2c7eb5998ad8045a6806cd: Status 404 returned error can't find the container with id 750eef7bfbf25729614edf80a495d996e806c5096e2c7eb5998ad8045a6806cd
Sep 19 04:42:18.566554 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:18.566450    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:18.670543 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:18.670498    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:18.920360 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:18.920326    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:19.072991 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:19.072958    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht" event={"ID":"af286b5f-d1b2-4e79-8927-89804e046546","Type":"ContainerStarted","Data":"05995fcbcfb565fee1adc3e09d0ba2e46aa559c9af239668b52683ea82c7fa36"}
Sep 19 04:42:19.073443 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:19.073003    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht" event={"ID":"af286b5f-d1b2-4e79-8927-89804e046546","Type":"ContainerStarted","Data":"750eef7bfbf25729614edf80a495d996e806c5096e2c7eb5998ad8045a6806cd"}
Sep 19 04:42:19.100221 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:19.100177    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht" podStartSLOduration=2.1001602 podStartE2EDuration="2.1001602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:42:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:42:19.098506727 +0000 UTC m=+1719.076703118" watchObservedRunningTime="2026-09-19 04:42:19.1001602 +0000 UTC m=+1719.078356590"
Sep 19 04:42:19.415304 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:19.415255    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:19.955853 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:19.955826    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:20.509687 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:20.509655    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:21.589284 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:21.589247    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:22.391565 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:22.391518    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:23.426411 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:23.426370    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:24.602451 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:24.602414    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:25.112921 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.112884    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr" podUID="127b03a7-24b0-411c-83f4-977820825c33" containerName="main" containerID="cri-o://1a5ac32158476cd4cdc05c7ab9908defd5535c77780c3c9e013f5fdc533bdd24" gracePeriod=45
Sep 19 04:42:25.182618 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.182572    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr" podUID="127b03a7-24b0-411c-83f4-977820825c33" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": dial tcp 10.133.0.51:8000: connect: connection refused"
Sep 19 04:42:25.370686 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.370630    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:42:25.385368 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.385340    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:25.450297 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.450267    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-tmp-dir\") pod \"127b03a7-24b0-411c-83f4-977820825c33\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") "
Sep 19 04:42:25.450474 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.450313    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-model-cache\") pod \"127b03a7-24b0-411c-83f4-977820825c33\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") "
Sep 19 04:42:25.450474 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.450335    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/127b03a7-24b0-411c-83f4-977820825c33-tls-certs\") pod \"127b03a7-24b0-411c-83f4-977820825c33\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") "
Sep 19 04:42:25.450474 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.450355    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-home\") pod \"127b03a7-24b0-411c-83f4-977820825c33\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") "
Sep 19 04:42:25.450474 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.450429    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-dshm\") pod \"127b03a7-24b0-411c-83f4-977820825c33\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") "
Sep 19 04:42:25.450708 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.450502    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bhvw\" (UniqueName: \"kubernetes.io/projected/127b03a7-24b0-411c-83f4-977820825c33-kube-api-access-6bhvw\") pod \"127b03a7-24b0-411c-83f4-977820825c33\" (UID: \"127b03a7-24b0-411c-83f4-977820825c33\") "
Sep 19 04:42:25.450708 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.450603    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "127b03a7-24b0-411c-83f4-977820825c33" (UID: "127b03a7-24b0-411c-83f4-977820825c33"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:25.450708 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.450587    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-model-cache" (OuterVolumeSpecName: "model-cache") pod "127b03a7-24b0-411c-83f4-977820825c33" (UID: "127b03a7-24b0-411c-83f4-977820825c33"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:25.450708 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.450660    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-home" (OuterVolumeSpecName: "home") pod "127b03a7-24b0-411c-83f4-977820825c33" (UID: "127b03a7-24b0-411c-83f4-977820825c33"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:25.450975 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.450954    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-tmp-dir\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:25.450975 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.450975    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-model-cache\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:25.451178 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.450988    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-home\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:25.452850 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.452816    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-dshm" (OuterVolumeSpecName: "dshm") pod "127b03a7-24b0-411c-83f4-977820825c33" (UID: "127b03a7-24b0-411c-83f4-977820825c33"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:25.452942 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.452879    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/127b03a7-24b0-411c-83f4-977820825c33-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "127b03a7-24b0-411c-83f4-977820825c33" (UID: "127b03a7-24b0-411c-83f4-977820825c33"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:42:25.452942 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.452899    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/127b03a7-24b0-411c-83f4-977820825c33-kube-api-access-6bhvw" (OuterVolumeSpecName: "kube-api-access-6bhvw") pod "127b03a7-24b0-411c-83f4-977820825c33" (UID: "127b03a7-24b0-411c-83f4-977820825c33"). InnerVolumeSpecName "kube-api-access-6bhvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:42:25.552487 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.552447    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/127b03a7-24b0-411c-83f4-977820825c33-tls-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:25.552487 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.552487    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/127b03a7-24b0-411c-83f4-977820825c33-dshm\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:25.552708 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:25.552504    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bhvw\" (UniqueName: \"kubernetes.io/projected/127b03a7-24b0-411c-83f4-977820825c33-kube-api-access-6bhvw\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:26.116505 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:26.116470    2569 generic.go:356] "Generic (PLEG): container finished" podID="127b03a7-24b0-411c-83f4-977820825c33" containerID="1a5ac32158476cd4cdc05c7ab9908defd5535c77780c3c9e013f5fdc533bdd24" exitCode=0
Sep 19 04:42:26.116970 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:26.116526    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"
Sep 19 04:42:26.116970 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:26.116558    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr" event={"ID":"127b03a7-24b0-411c-83f4-977820825c33","Type":"ContainerDied","Data":"1a5ac32158476cd4cdc05c7ab9908defd5535c77780c3c9e013f5fdc533bdd24"}
Sep 19 04:42:26.116970 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:26.116604    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr" event={"ID":"127b03a7-24b0-411c-83f4-977820825c33","Type":"ContainerDied","Data":"00a97ac17300ac1e45e2bdae95e8f731803c7337f3ee81c3c7d4910e53b89e36"}
Sep 19 04:42:26.116970 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:26.116620    2569 scope.go:117] "RemoveContainer" containerID="1a5ac32158476cd4cdc05c7ab9908defd5535c77780c3c9e013f5fdc533bdd24"
Sep 19 04:42:26.125925 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:26.125909    2569 scope.go:117] "RemoveContainer" containerID="1a5ac32158476cd4cdc05c7ab9908defd5535c77780c3c9e013f5fdc533bdd24"
Sep 19 04:42:26.126178 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:42:26.126161    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a5ac32158476cd4cdc05c7ab9908defd5535c77780c3c9e013f5fdc533bdd24\": container with ID starting with 1a5ac32158476cd4cdc05c7ab9908defd5535c77780c3c9e013f5fdc533bdd24 not found: ID does not exist" containerID="1a5ac32158476cd4cdc05c7ab9908defd5535c77780c3c9e013f5fdc533bdd24"
Sep 19 04:42:26.126234 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:26.126184    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a5ac32158476cd4cdc05c7ab9908defd5535c77780c3c9e013f5fdc533bdd24"} err="failed to get container status \"1a5ac32158476cd4cdc05c7ab9908defd5535c77780c3c9e013f5fdc533bdd24\": rpc error: code = NotFound desc = could not find container \"1a5ac32158476cd4cdc05c7ab9908defd5535c77780c3c9e013f5fdc533bdd24\": container with ID starting with 1a5ac32158476cd4cdc05c7ab9908defd5535c77780c3c9e013f5fdc533bdd24 not found: ID does not exist"
Sep 19 04:42:26.147456 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:26.147420    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"]
Sep 19 04:42:26.153983 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:26.153958    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-6b1935/test-model-6b1935-kserve-5dc646dc74-2ctpr"]
Sep 19 04:42:26.539375 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:26.539343    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="127b03a7-24b0-411c-83f4-977820825c33" path="/var/lib/kubelet/pods/127b03a7-24b0-411c-83f4-977820825c33/volumes"
Sep 19 04:42:27.784634 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:27.784603    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:27.856181 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:27.856139    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:27.955660 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:27.955626    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:27.968057 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:27.968032    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:28.139660 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:28.139627    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:42:29.840383 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:29.840339    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:29.887222 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:29.887192    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"]
Sep 19 04:42:29.887445 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:29.887418    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w" podUID="2b6a525f-ae12-4d27-8520-c801fa2bd975" containerName="payload-pre-processing" containerID="cri-o://2a744ad1dd9c432f8018fbc109004ebce30572c2ee39c6dcbcf2fa401a201263" gracePeriod=30
Sep 19 04:42:29.943612 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:29.943566    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:30.049362 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.049323    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:30.141212 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.141181    2569 generic.go:356] "Generic (PLEG): container finished" podID="2b6a525f-ae12-4d27-8520-c801fa2bd975" containerID="2a744ad1dd9c432f8018fbc109004ebce30572c2ee39c6dcbcf2fa401a201263" exitCode=0
Sep 19 04:42:30.141368 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.141224    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w" event={"ID":"2b6a525f-ae12-4d27-8520-c801fa2bd975","Type":"ContainerDied","Data":"2a744ad1dd9c432f8018fbc109004ebce30572c2ee39c6dcbcf2fa401a201263"}
Sep 19 04:42:30.141368 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.141272    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w" event={"ID":"2b6a525f-ae12-4d27-8520-c801fa2bd975","Type":"ContainerDied","Data":"a5ce58579925ca0ca633637ecb96450f17e525029d03b2cd1cd0122fb6784e94"}
Sep 19 04:42:30.141368 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.141294    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a5ce58579925ca0ca633637ecb96450f17e525029d03b2cd1cd0122fb6784e94"
Sep 19 04:42:30.149839 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.149816    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"
Sep 19 04:42:30.151416 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.151392    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:30.198885 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.198854    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d7xm\" (UniqueName: \"kubernetes.io/projected/2b6a525f-ae12-4d27-8520-c801fa2bd975-kube-api-access-7d7xm\") pod \"2b6a525f-ae12-4d27-8520-c801fa2bd975\" (UID: \"2b6a525f-ae12-4d27-8520-c801fa2bd975\") "
Sep 19 04:42:30.199056 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.198977    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b6a525f-ae12-4d27-8520-c801fa2bd975-plugins-config-volume\") pod \"2b6a525f-ae12-4d27-8520-c801fa2bd975\" (UID: \"2b6a525f-ae12-4d27-8520-c801fa2bd975\") "
Sep 19 04:42:30.199416 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.199390    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6a525f-ae12-4d27-8520-c801fa2bd975-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2b6a525f-ae12-4d27-8520-c801fa2bd975" (UID: "2b6a525f-ae12-4d27-8520-c801fa2bd975"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:42:30.201107 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.201079    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b6a525f-ae12-4d27-8520-c801fa2bd975-kube-api-access-7d7xm" (OuterVolumeSpecName: "kube-api-access-7d7xm") pod "2b6a525f-ae12-4d27-8520-c801fa2bd975" (UID: "2b6a525f-ae12-4d27-8520-c801fa2bd975"). InnerVolumeSpecName "kube-api-access-7d7xm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:42:30.224244 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.224219    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:30.300702 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.300675    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d7xm\" (UniqueName: \"kubernetes.io/projected/2b6a525f-ae12-4d27-8520-c801fa2bd975-kube-api-access-7d7xm\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:30.300702 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.300698    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b6a525f-ae12-4d27-8520-c801fa2bd975-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:30.523933 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.523882    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:30.629466 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:30.629434    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:31.147605 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:31.147571    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"
Sep 19 04:42:31.169404 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:31.169363    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"]
Sep 19 04:42:31.172802 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:31.172776    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-6b1935-978f5f4d6-2c76w"]
Sep 19 04:42:31.492164 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:31.492077    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:32.271304 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:32.271255    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:32.540603 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:32.540525    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b6a525f-ae12-4d27-8520-c801fa2bd975" path="/var/lib/kubelet/pods/2b6a525f-ae12-4d27-8520-c801fa2bd975/volumes"
Sep 19 04:42:33.331588 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:33.331555    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:34.098238 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:34.098201    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:38.511579 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:38.511549    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:38.636349 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:38.636318    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:38.797969 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:38.797881    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"]
Sep 19 04:42:38.798135 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:38.798086    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerName="istio-proxy" containerID="cri-o://adca27e2dae765c0d206b2885a5ffcdcb1c973170b062b1347b6dbf2cb4c34a6" gracePeriod=30
Sep 19 04:42:38.907106 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:38.907069    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:39.063937 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:39.063835    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:39.408909 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:39.408867    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:39.755816 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:39.755706    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:39.927494 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:39.927456    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:40.166403 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:40.166367    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:40.273901 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:40.273870    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:40.602623 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:40.602529    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:40.688029 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:40.687998    2569 scope.go:117] "RemoveContainer" containerID="2a744ad1dd9c432f8018fbc109004ebce30572c2ee39c6dcbcf2fa401a201263"
Sep 19 04:42:42.810628 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:42.810596    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:42.941236 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:42.941204    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:43.078664 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:43.078576    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:44.058174 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.058154    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:42:44.092957 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.092866    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:44.159141 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159112    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-envoy\") pod \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") "
Sep 19 04:42:44.159312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159153    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istiod-ca-cert\") pod \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") "
Sep 19 04:42:44.159312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159186    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-workload-socket\") pod \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") "
Sep 19 04:42:44.159312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159202    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-workload-certs\") pod \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") "
Sep 19 04:42:44.159312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159236    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-data\") pod \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") "
Sep 19 04:42:44.159312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159266    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-token\") pod \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") "
Sep 19 04:42:44.159312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159305    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-credential-socket\") pod \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") "
Sep 19 04:42:44.159613 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159345    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-podinfo\") pod \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") "
Sep 19 04:42:44.159613 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159368    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2whw2\" (UniqueName: \"kubernetes.io/projected/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-kube-api-access-2whw2\") pod \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\" (UID: \"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98\") "
Sep 19 04:42:44.159613 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159539    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" (UID: "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:44.159613 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159564    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" (UID: "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:42:44.159613 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159565    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-data" (OuterVolumeSpecName: "istio-data") pod "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" (UID: "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:44.159613 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159577    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" (UID: "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:44.159904 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159732    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istiod-ca-cert\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:44.159904 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159768    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-workload-socket\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:44.159904 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159784    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-workload-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:44.159904 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159787    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" (UID: "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:44.159904 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.159798    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-data\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:44.161674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.161644    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" (UID: "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:44.161674 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.161649    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" (UID: "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:42:44.161890 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.161707    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-token" (OuterVolumeSpecName: "istio-token") pod "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" (UID: "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:42:44.161969 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.161954    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-kube-api-access-2whw2" (OuterVolumeSpecName: "kube-api-access-2whw2") pod "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" (UID: "f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98"). InnerVolumeSpecName "kube-api-access-2whw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:42:44.217652 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.217618    2569 generic.go:356] "Generic (PLEG): container finished" podID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerID="adca27e2dae765c0d206b2885a5ffcdcb1c973170b062b1347b6dbf2cb4c34a6" exitCode=0
Sep 19 04:42:44.217837 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.217660    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" event={"ID":"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98","Type":"ContainerDied","Data":"adca27e2dae765c0d206b2885a5ffcdcb1c973170b062b1347b6dbf2cb4c34a6"}
Sep 19 04:42:44.217837 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.217713    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7" event={"ID":"f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98","Type":"ContainerDied","Data":"4e74e91c7a436724b58cd70584bb08c5cdaf064b60d17f36e4d40c0cd0f16449"}
Sep 19 04:42:44.217837 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.217736    2569 scope.go:117] "RemoveContainer" containerID="adca27e2dae765c0d206b2885a5ffcdcb1c973170b062b1347b6dbf2cb4c34a6"
Sep 19 04:42:44.217837 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.217667    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"
Sep 19 04:42:44.227517 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.227490    2569 scope.go:117] "RemoveContainer" containerID="9b21870edff444472be9e85e3b00d897687d828f2fdd81fa59c7fe1a00b9ccfe"
Sep 19 04:42:44.235772 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.235728    2569 scope.go:117] "RemoveContainer" containerID="adca27e2dae765c0d206b2885a5ffcdcb1c973170b062b1347b6dbf2cb4c34a6"
Sep 19 04:42:44.236023 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:42:44.236006    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adca27e2dae765c0d206b2885a5ffcdcb1c973170b062b1347b6dbf2cb4c34a6\": container with ID starting with adca27e2dae765c0d206b2885a5ffcdcb1c973170b062b1347b6dbf2cb4c34a6 not found: ID does not exist" containerID="adca27e2dae765c0d206b2885a5ffcdcb1c973170b062b1347b6dbf2cb4c34a6"
Sep 19 04:42:44.236075 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.236032    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adca27e2dae765c0d206b2885a5ffcdcb1c973170b062b1347b6dbf2cb4c34a6"} err="failed to get container status \"adca27e2dae765c0d206b2885a5ffcdcb1c973170b062b1347b6dbf2cb4c34a6\": rpc error: code = NotFound desc = could not find container \"adca27e2dae765c0d206b2885a5ffcdcb1c973170b062b1347b6dbf2cb4c34a6\": container with ID starting with adca27e2dae765c0d206b2885a5ffcdcb1c973170b062b1347b6dbf2cb4c34a6 not found: ID does not exist"
Sep 19 04:42:44.236075 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.236046    2569 scope.go:117] "RemoveContainer" containerID="9b21870edff444472be9e85e3b00d897687d828f2fdd81fa59c7fe1a00b9ccfe"
Sep 19 04:42:44.236273 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:42:44.236257    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b21870edff444472be9e85e3b00d897687d828f2fdd81fa59c7fe1a00b9ccfe\": container with ID starting with 9b21870edff444472be9e85e3b00d897687d828f2fdd81fa59c7fe1a00b9ccfe not found: ID does not exist" containerID="9b21870edff444472be9e85e3b00d897687d828f2fdd81fa59c7fe1a00b9ccfe"
Sep 19 04:42:44.236318 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.236276    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b21870edff444472be9e85e3b00d897687d828f2fdd81fa59c7fe1a00b9ccfe"} err="failed to get container status \"9b21870edff444472be9e85e3b00d897687d828f2fdd81fa59c7fe1a00b9ccfe\": rpc error: code = NotFound desc = could not find container \"9b21870edff444472be9e85e3b00d897687d828f2fdd81fa59c7fe1a00b9ccfe\": container with ID starting with 9b21870edff444472be9e85e3b00d897687d828f2fdd81fa59c7fe1a00b9ccfe not found: ID does not exist"
Sep 19 04:42:44.243590 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.243568    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"]
Sep 19 04:42:44.254800 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.250159    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-6b1935-openshift-default-869c8c5c5b-ztnk7"]
Sep 19 04:42:44.260669 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.260641    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-envoy\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:44.260805 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.260675    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-token\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:44.260805 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.260695    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-credential-socket\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:44.260805 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.260709    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-istio-podinfo\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:44.260805 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.260726    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2whw2\" (UniqueName: \"kubernetes.io/projected/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98-kube-api-access-2whw2\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:42:44.539908 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.539875    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" path="/var/lib/kubelet/pods/f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98/volumes"
Sep 19 04:42:44.999460 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:44.999424    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:45.280671 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:45.280574    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:45.407227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:45.407190    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:45.925453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:45.925414    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:47.301727 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:47.301687    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:47.438814 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:47.438776    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:47.578079 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:47.577987    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:47.949625 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:47.949594    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:48.060460 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.060422    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:42:48.210861 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.210785    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"]
Sep 19 04:42:48.211183 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.211171    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerName="istio-proxy"
Sep 19 04:42:48.211231 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.211185    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerName="istio-proxy"
Sep 19 04:42:48.211231 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.211197    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerName="istio-proxy"
Sep 19 04:42:48.211231 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.211203    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerName="istio-proxy"
Sep 19 04:42:48.211231 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.211220    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="127b03a7-24b0-411c-83f4-977820825c33" containerName="main"
Sep 19 04:42:48.211231 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.211225    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="127b03a7-24b0-411c-83f4-977820825c33" containerName="main"
Sep 19 04:42:48.211383 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.211235    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6a525f-ae12-4d27-8520-c801fa2bd975" containerName="payload-pre-processing"
Sep 19 04:42:48.211383 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.211240    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6a525f-ae12-4d27-8520-c801fa2bd975" containerName="payload-pre-processing"
Sep 19 04:42:48.211383 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.211297    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerName="istio-proxy"
Sep 19 04:42:48.211383 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.211305    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="127b03a7-24b0-411c-83f4-977820825c33" containerName="main"
Sep 19 04:42:48.211383 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.211313    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b6a525f-ae12-4d27-8520-c801fa2bd975" containerName="payload-pre-processing"
Sep 19 04:42:48.216468 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.216450    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"
Sep 19 04:42:48.219219 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.219197    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-561bb1-dockercfg-vslz2\""
Sep 19 04:42:48.219789 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.219743    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-561bb1\""
Sep 19 04:42:48.237487 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.237463    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"]
Sep 19 04:42:48.400341 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.400309    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99330ae9-a490-431c-ac75-cd65ad6828e8-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4\" (UID: \"99330ae9-a490-431c-ac75-cd65ad6828e8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"
Sep 19 04:42:48.400712 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.400354    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmlbd\" (UniqueName: \"kubernetes.io/projected/99330ae9-a490-431c-ac75-cd65ad6828e8-kube-api-access-rmlbd\") pod \"payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4\" (UID: \"99330ae9-a490-431c-ac75-cd65ad6828e8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"
Sep 19 04:42:48.501714 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.501616    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99330ae9-a490-431c-ac75-cd65ad6828e8-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4\" (UID: \"99330ae9-a490-431c-ac75-cd65ad6828e8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"
Sep 19 04:42:48.501714 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.501677    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmlbd\" (UniqueName: \"kubernetes.io/projected/99330ae9-a490-431c-ac75-cd65ad6828e8-kube-api-access-rmlbd\") pod \"payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4\" (UID: \"99330ae9-a490-431c-ac75-cd65ad6828e8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"
Sep 19 04:42:48.502328 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.502309    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99330ae9-a490-431c-ac75-cd65ad6828e8-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4\" (UID: \"99330ae9-a490-431c-ac75-cd65ad6828e8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"
Sep 19 04:42:48.511171 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.511147    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmlbd\" (UniqueName: \"kubernetes.io/projected/99330ae9-a490-431c-ac75-cd65ad6828e8-kube-api-access-rmlbd\") pod \"payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4\" (UID: \"99330ae9-a490-431c-ac75-cd65ad6828e8\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"
Sep 19 04:42:48.527657 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.527632    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"
Sep 19 04:42:48.816239 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:48.816211    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"]
Sep 19 04:42:48.818904 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:42:48.818863    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99330ae9_a490_431c_ac75_cd65ad6828e8.slice/crio-94a5d010dd9fe2c83e96a5e30f682e396e4b62ab911dddb516a1317a0edc2737 WatchSource:0}: Error finding container 94a5d010dd9fe2c83e96a5e30f682e396e4b62ab911dddb516a1317a0edc2737: Status 404 returned error can't find the container with id 94a5d010dd9fe2c83e96a5e30f682e396e4b62ab911dddb516a1317a0edc2737
Sep 19 04:42:49.252637 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:49.252601    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4" event={"ID":"99330ae9-a490-431c-ac75-cd65ad6828e8","Type":"ContainerStarted","Data":"19004507de1245a7b4c215b26046e4a6fd3ab037dba4cdbfe85c34db173e6be5"}
Sep 19 04:42:49.252829 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:49.252662    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4" event={"ID":"99330ae9-a490-431c-ac75-cd65ad6828e8","Type":"ContainerStarted","Data":"94a5d010dd9fe2c83e96a5e30f682e396e4b62ab911dddb516a1317a0edc2737"}
Sep 19 04:42:49.252829 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:49.252773    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"
Sep 19 04:42:49.282030 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:42:49.281982    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4" podStartSLOduration=1.281966683 podStartE2EDuration="1.281966683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:42:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:42:49.280549825 +0000 UTC m=+1749.258746228" watchObservedRunningTime="2026-09-19 04:42:49.281966683 +0000 UTC m=+1749.260163073"
Sep 19 04:43:00.260167 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:00.260132    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"
Sep 19 04:43:09.803734 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:09.803688    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:10.806203 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:10.806166    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:11.669433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:11.669386    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:12.458867 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:12.458828    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:12.906055 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:12.906006    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:13.225118 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:13.225015    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:13.534517 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:13.534430    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:13.676614 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:13.676578    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:13.892889 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:13.892854    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:14.714068 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:14.714030    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:16.399960 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:16.399914    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:17.099107 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:17.099070    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:17.338609 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:17.338575    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:18.112170 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:18.112128    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:19.201497 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:19.201459    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:20.319235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:20.319197    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:21.299029 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:21.298997    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:22.317605 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:22.317573    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:23.255909 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.255875    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"]
Sep 19 04:43:23.256385 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.256371    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f08bffa0-d9fc-4fb6-8127-fd4d1b7bab98" containerName="istio-proxy"
Sep 19 04:43:23.259761 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.259728    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:23.262916 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.262897    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-8bbcca-serving-cert\""
Sep 19 04:43:23.289962 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.289931    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"]
Sep 19 04:43:23.325564 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.325526    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:23.325990 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.325530    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:23.325990 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.325663    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffpqn\" (UniqueName: \"kubernetes.io/projected/c5fb2454-bff1-41f6-ae19-115d815cc71a-kube-api-access-ffpqn\") pod \"maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:23.325990 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.325712    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:23.325990 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.325829    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5fb2454-bff1-41f6-ae19-115d815cc71a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:23.427571 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.427522    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:23.427811 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.427607    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffpqn\" (UniqueName: \"kubernetes.io/projected/c5fb2454-bff1-41f6-ae19-115d815cc71a-kube-api-access-ffpqn\") pod \"maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:23.427811 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.427666    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:23.427811 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.427713    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5fb2454-bff1-41f6-ae19-115d815cc71a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:23.427993 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:43:23.427885    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-serving-cert: secret "maas-api-e2e-shared-b-w3-8bbcca-serving-cert" not found
Sep 19 04:43:23.427993 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:43:23.427967    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-maas-api-tls podName:c5fb2454-bff1-41f6-ae19-115d815cc71a nodeName:}" failed. No retries permitted until 2026-09-19 04:43:23.927944752 +0000 UTC m=+1783.906141136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-maas-api-tls") pod "maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9" (UID: "c5fb2454-bff1-41f6-ae19-115d815cc71a") : secret "maas-api-e2e-shared-b-w3-8bbcca-serving-cert" not found
Sep 19 04:43:23.428471 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.428449    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5fb2454-bff1-41f6-ae19-115d815cc71a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:23.430173 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.430155    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:23.447694 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.447662    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffpqn\" (UniqueName: \"kubernetes.io/projected/c5fb2454-bff1-41f6-ae19-115d815cc71a-kube-api-access-ffpqn\") pod \"maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:23.503318 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.503282    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:23.717775 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.717720    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:23.933590 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.933558    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:23.936242 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.936218    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:23.995655 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:23.995570    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:24.170504 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:24.170469    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:24.171991 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:24.171962    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:24.452812 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:24.452790    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"]
Sep 19 04:43:24.454397 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:43:24.454368    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5fb2454_bff1_41f6_ae19_115d815cc71a.slice/crio-0a95c40f47baf00108a38941a7c98a9ec99f0673940656c2bcd38143ecfb63c3 WatchSource:0}: Error finding container 0a95c40f47baf00108a38941a7c98a9ec99f0673940656c2bcd38143ecfb63c3: Status 404 returned error can't find the container with id 0a95c40f47baf00108a38941a7c98a9ec99f0673940656c2bcd38143ecfb63c3
Sep 19 04:43:24.591811 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:24.591770    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:25.448860 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:25.448822    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9" event={"ID":"c5fb2454-bff1-41f6-ae19-115d815cc71a","Type":"ContainerStarted","Data":"d3c88ca2e3ac716bb09e4dbf0bb814937dccda0a458347ecd4a62436f021a63b"}
Sep 19 04:43:25.449066 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:25.448876    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:25.449066 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:25.448903    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9" event={"ID":"c5fb2454-bff1-41f6-ae19-115d815cc71a","Type":"ContainerStarted","Data":"0a95c40f47baf00108a38941a7c98a9ec99f0673940656c2bcd38143ecfb63c3"}
Sep 19 04:43:25.494388 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:25.494320    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9" podStartSLOduration=2.04979307 podStartE2EDuration="2.494298594s" totalImagesPullingTime="444.505524ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:43:25.491479269 +0000 UTC m=+1785.469675658" watchObservedRunningTime="2026-09-19 04:43:25.494298594 +0000 UTC m=+1785.472494986"
Sep 19 04:43:26.777358 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:26.777320    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:27.908387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:27.908343    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:28.692506 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:28.692466    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:29.661729 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:29.661697    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:30.518445 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:30.518411    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:31.315402 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:31.315363    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:31.460798 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:31.460772    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:43:32.483259 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:32.483226    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:33.382488 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:33.382445    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:34.168944 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:34.168908    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:34.892691 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:34.892652    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:35.896361 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:35.896326    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:36.993523 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:36.993452    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:37.182909 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:37.182874    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:38.365586 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:38.365549    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:39.547276 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:39.547238    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:44.517286 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:44.517247    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:45.424312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.424278    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:45.459235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.459177    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"]
Sep 19 04:43:45.459477 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.459453    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf" podUID="0e4d9fa8-f743-49de-b0d8-5b5d50129282" containerName="payload-pre-processing" containerID="cri-o://b740835510c23fa1eb7cae2b4f5b08f6a95e81b7c14579b0ea9cb69d56e8fcc6" gracePeriod=30
Sep 19 04:43:45.462713 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.462685    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"]
Sep 19 04:43:45.463123 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.463086    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm" podUID="7b1da557-280f-4b7b-817f-e2c6db580529" containerName="payload-processing" containerID="cri-o://c19d65fc0732a866a656f174b18dd18ff6bb7d83261c527d5f2580a30f9ad878" gracePeriod=30
Sep 19 04:43:45.524597 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.524548    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:45.602526 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.602491    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:45.748672 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.748640    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:45.752151 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.752131    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"
Sep 19 04:43:45.755564 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.755546    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"
Sep 19 04:43:45.828396 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.828363    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfczw\" (UniqueName: \"kubernetes.io/projected/7b1da557-280f-4b7b-817f-e2c6db580529-kube-api-access-tfczw\") pod \"7b1da557-280f-4b7b-817f-e2c6db580529\" (UID: \"7b1da557-280f-4b7b-817f-e2c6db580529\") "
Sep 19 04:43:45.828565 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.828423    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b1da557-280f-4b7b-817f-e2c6db580529-plugins-config-volume\") pod \"7b1da557-280f-4b7b-817f-e2c6db580529\" (UID: \"7b1da557-280f-4b7b-817f-e2c6db580529\") "
Sep 19 04:43:45.828565 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.828494    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbtlm\" (UniqueName: \"kubernetes.io/projected/0e4d9fa8-f743-49de-b0d8-5b5d50129282-kube-api-access-sbtlm\") pod \"0e4d9fa8-f743-49de-b0d8-5b5d50129282\" (UID: \"0e4d9fa8-f743-49de-b0d8-5b5d50129282\") "
Sep 19 04:43:45.828639 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.828581    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e4d9fa8-f743-49de-b0d8-5b5d50129282-plugins-config-volume\") pod \"0e4d9fa8-f743-49de-b0d8-5b5d50129282\" (UID: \"0e4d9fa8-f743-49de-b0d8-5b5d50129282\") "
Sep 19 04:43:45.828979 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.828953    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b1da557-280f-4b7b-817f-e2c6db580529-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b1da557-280f-4b7b-817f-e2c6db580529" (UID: "7b1da557-280f-4b7b-817f-e2c6db580529"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:43:45.828979 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.828966    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e4d9fa8-f743-49de-b0d8-5b5d50129282-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0e4d9fa8-f743-49de-b0d8-5b5d50129282" (UID: "0e4d9fa8-f743-49de-b0d8-5b5d50129282"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:43:45.830827 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.830795    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b1da557-280f-4b7b-817f-e2c6db580529-kube-api-access-tfczw" (OuterVolumeSpecName: "kube-api-access-tfczw") pod "7b1da557-280f-4b7b-817f-e2c6db580529" (UID: "7b1da557-280f-4b7b-817f-e2c6db580529"). InnerVolumeSpecName "kube-api-access-tfczw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:43:45.830889 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.830841    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e4d9fa8-f743-49de-b0d8-5b5d50129282-kube-api-access-sbtlm" (OuterVolumeSpecName: "kube-api-access-sbtlm") pod "0e4d9fa8-f743-49de-b0d8-5b5d50129282" (UID: "0e4d9fa8-f743-49de-b0d8-5b5d50129282"). InnerVolumeSpecName "kube-api-access-sbtlm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:43:45.930154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.930121    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbtlm\" (UniqueName: \"kubernetes.io/projected/0e4d9fa8-f743-49de-b0d8-5b5d50129282-kube-api-access-sbtlm\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:43:45.930154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.930148    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0e4d9fa8-f743-49de-b0d8-5b5d50129282-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:43:45.930154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.930157    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfczw\" (UniqueName: \"kubernetes.io/projected/7b1da557-280f-4b7b-817f-e2c6db580529-kube-api-access-tfczw\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:43:45.930376 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:45.930166    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b1da557-280f-4b7b-817f-e2c6db580529-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:43:46.117241 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.117154    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:46.565804 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.565769    2569 generic.go:356] "Generic (PLEG): container finished" podID="0e4d9fa8-f743-49de-b0d8-5b5d50129282" containerID="b740835510c23fa1eb7cae2b4f5b08f6a95e81b7c14579b0ea9cb69d56e8fcc6" exitCode=0
Sep 19 04:43:46.566167 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.565834    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"
Sep 19 04:43:46.566167 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.565860    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf" event={"ID":"0e4d9fa8-f743-49de-b0d8-5b5d50129282","Type":"ContainerDied","Data":"b740835510c23fa1eb7cae2b4f5b08f6a95e81b7c14579b0ea9cb69d56e8fcc6"}
Sep 19 04:43:46.566167 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.565924    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf" event={"ID":"0e4d9fa8-f743-49de-b0d8-5b5d50129282","Type":"ContainerDied","Data":"4599dbdca7ced855bf8ec296f1516e646851c19c6c631b93c3d47df8ae42709a"}
Sep 19 04:43:46.566167 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.565953    2569 scope.go:117] "RemoveContainer" containerID="b740835510c23fa1eb7cae2b4f5b08f6a95e81b7c14579b0ea9cb69d56e8fcc6"
Sep 19 04:43:46.567547 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.567524    2569 generic.go:356] "Generic (PLEG): container finished" podID="7b1da557-280f-4b7b-817f-e2c6db580529" containerID="c19d65fc0732a866a656f174b18dd18ff6bb7d83261c527d5f2580a30f9ad878" exitCode=0
Sep 19 04:43:46.567661 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.567571    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm" event={"ID":"7b1da557-280f-4b7b-817f-e2c6db580529","Type":"ContainerDied","Data":"c19d65fc0732a866a656f174b18dd18ff6bb7d83261c527d5f2580a30f9ad878"}
Sep 19 04:43:46.567661 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.567584    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"
Sep 19 04:43:46.567661 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.567611    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm" event={"ID":"7b1da557-280f-4b7b-817f-e2c6db580529","Type":"ContainerDied","Data":"3510ea4b17fdf91ffe38487f8196843883bbfc6932ea1379d7fc70a68e3a1e82"}
Sep 19 04:43:46.575537 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.575519    2569 scope.go:117] "RemoveContainer" containerID="b740835510c23fa1eb7cae2b4f5b08f6a95e81b7c14579b0ea9cb69d56e8fcc6"
Sep 19 04:43:46.575983 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:43:46.575962    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b740835510c23fa1eb7cae2b4f5b08f6a95e81b7c14579b0ea9cb69d56e8fcc6\": container with ID starting with b740835510c23fa1eb7cae2b4f5b08f6a95e81b7c14579b0ea9cb69d56e8fcc6 not found: ID does not exist" containerID="b740835510c23fa1eb7cae2b4f5b08f6a95e81b7c14579b0ea9cb69d56e8fcc6"
Sep 19 04:43:46.576066 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.575989    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b740835510c23fa1eb7cae2b4f5b08f6a95e81b7c14579b0ea9cb69d56e8fcc6"} err="failed to get container status \"b740835510c23fa1eb7cae2b4f5b08f6a95e81b7c14579b0ea9cb69d56e8fcc6\": rpc error: code = NotFound desc = could not find container \"b740835510c23fa1eb7cae2b4f5b08f6a95e81b7c14579b0ea9cb69d56e8fcc6\": container with ID starting with b740835510c23fa1eb7cae2b4f5b08f6a95e81b7c14579b0ea9cb69d56e8fcc6 not found: ID does not exist"
Sep 19 04:43:46.576066 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.576005    2569 scope.go:117] "RemoveContainer" containerID="c19d65fc0732a866a656f174b18dd18ff6bb7d83261c527d5f2580a30f9ad878"
Sep 19 04:43:46.585819 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.585794    2569 scope.go:117] "RemoveContainer" containerID="c19d65fc0732a866a656f174b18dd18ff6bb7d83261c527d5f2580a30f9ad878"
Sep 19 04:43:46.586107 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:43:46.586089    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c19d65fc0732a866a656f174b18dd18ff6bb7d83261c527d5f2580a30f9ad878\": container with ID starting with c19d65fc0732a866a656f174b18dd18ff6bb7d83261c527d5f2580a30f9ad878 not found: ID does not exist" containerID="c19d65fc0732a866a656f174b18dd18ff6bb7d83261c527d5f2580a30f9ad878"
Sep 19 04:43:46.586180 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.586113    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c19d65fc0732a866a656f174b18dd18ff6bb7d83261c527d5f2580a30f9ad878"} err="failed to get container status \"c19d65fc0732a866a656f174b18dd18ff6bb7d83261c527d5f2580a30f9ad878\": rpc error: code = NotFound desc = could not find container \"c19d65fc0732a866a656f174b18dd18ff6bb7d83261c527d5f2580a30f9ad878\": container with ID starting with c19d65fc0732a866a656f174b18dd18ff6bb7d83261c527d5f2580a30f9ad878 not found: ID does not exist"
Sep 19 04:43:46.602123 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.602099    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"]
Sep 19 04:43:46.610973 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.610951    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a0ed681d-565f9c64b9-srzmm"]
Sep 19 04:43:46.628976 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.628953    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"]
Sep 19 04:43:46.635818 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:46.635784    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a0ed681d-649879fc7d-6s9qf"]
Sep 19 04:43:47.233878 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:47.233837    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:48.015739 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:48.015697    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:48.540249 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:48.540218    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e4d9fa8-f743-49de-b0d8-5b5d50129282" path="/var/lib/kubelet/pods/0e4d9fa8-f743-49de-b0d8-5b5d50129282/volumes"
Sep 19 04:43:48.540607 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:48.540594    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b1da557-280f-4b7b-817f-e2c6db580529" path="/var/lib/kubelet/pods/7b1da557-280f-4b7b-817f-e2c6db580529/volumes"
Sep 19 04:43:48.793056 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:48.792956    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:48.954475 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:48.954438    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:49.741620 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:49.741586    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:50.530132 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:50.530078    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:51.140702 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:51.140667    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:43:54.025855 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:54.025817    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"]
Sep 19 04:43:54.128892 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:43:54.128857    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:44:09.045865 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.045800    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht" podUID="af286b5f-d1b2-4e79-8927-89804e046546" containerName="main" containerID="cri-o://05995fcbcfb565fee1adc3e09d0ba2e46aa559c9af239668b52683ea82c7fa36" gracePeriod=45
Sep 19 04:44:09.129421 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.129382    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht" podUID="af286b5f-d1b2-4e79-8927-89804e046546" containerName="main" probeResult="failure" output="Get \"https://10.133.0.62:8000/ready\": dial tcp 10.133.0.62:8000: connect: connection refused"
Sep 19 04:44:09.299076 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.299015    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:44:09.457292 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.457261    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-home\") pod \"af286b5f-d1b2-4e79-8927-89804e046546\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") "
Sep 19 04:44:09.457292 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.457303    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af286b5f-d1b2-4e79-8927-89804e046546-tls-certs\") pod \"af286b5f-d1b2-4e79-8927-89804e046546\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") "
Sep 19 04:44:09.457550 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.457352    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-model-cache\") pod \"af286b5f-d1b2-4e79-8927-89804e046546\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") "
Sep 19 04:44:09.457550 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.457495    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-dshm\") pod \"af286b5f-d1b2-4e79-8927-89804e046546\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") "
Sep 19 04:44:09.457550 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.457520    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-home" (OuterVolumeSpecName: "home") pod "af286b5f-d1b2-4e79-8927-89804e046546" (UID: "af286b5f-d1b2-4e79-8927-89804e046546"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:44:09.457550 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.457543    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpr2x\" (UniqueName: \"kubernetes.io/projected/af286b5f-d1b2-4e79-8927-89804e046546-kube-api-access-cpr2x\") pod \"af286b5f-d1b2-4e79-8927-89804e046546\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") "
Sep 19 04:44:09.457787 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.457563    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-tmp-dir\") pod \"af286b5f-d1b2-4e79-8927-89804e046546\" (UID: \"af286b5f-d1b2-4e79-8927-89804e046546\") "
Sep 19 04:44:09.457787 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.457611    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-model-cache" (OuterVolumeSpecName: "model-cache") pod "af286b5f-d1b2-4e79-8927-89804e046546" (UID: "af286b5f-d1b2-4e79-8927-89804e046546"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:44:09.457907 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.457852    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-home\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:44:09.457907 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.457863    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-model-cache\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:44:09.457907 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.457897    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "af286b5f-d1b2-4e79-8927-89804e046546" (UID: "af286b5f-d1b2-4e79-8927-89804e046546"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:44:09.459788 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.459734    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af286b5f-d1b2-4e79-8927-89804e046546-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "af286b5f-d1b2-4e79-8927-89804e046546" (UID: "af286b5f-d1b2-4e79-8927-89804e046546"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:44:09.459788 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.459783    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-dshm" (OuterVolumeSpecName: "dshm") pod "af286b5f-d1b2-4e79-8927-89804e046546" (UID: "af286b5f-d1b2-4e79-8927-89804e046546"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:44:09.459939 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.459810    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af286b5f-d1b2-4e79-8927-89804e046546-kube-api-access-cpr2x" (OuterVolumeSpecName: "kube-api-access-cpr2x") pod "af286b5f-d1b2-4e79-8927-89804e046546" (UID: "af286b5f-d1b2-4e79-8927-89804e046546"). InnerVolumeSpecName "kube-api-access-cpr2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:44:09.559421 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.559327    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-dshm\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:44:09.559421 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.559359    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpr2x\" (UniqueName: \"kubernetes.io/projected/af286b5f-d1b2-4e79-8927-89804e046546-kube-api-access-cpr2x\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:44:09.559421 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.559373    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af286b5f-d1b2-4e79-8927-89804e046546-tmp-dir\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:44:09.559421 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.559384    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af286b5f-d1b2-4e79-8927-89804e046546-tls-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:44:09.696501 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.696467    2569 generic.go:356] "Generic (PLEG): container finished" podID="af286b5f-d1b2-4e79-8927-89804e046546" containerID="05995fcbcfb565fee1adc3e09d0ba2e46aa559c9af239668b52683ea82c7fa36" exitCode=0
Sep 19 04:44:09.696684 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.696511    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"
Sep 19 04:44:09.696684 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.696548    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht" event={"ID":"af286b5f-d1b2-4e79-8927-89804e046546","Type":"ContainerDied","Data":"05995fcbcfb565fee1adc3e09d0ba2e46aa559c9af239668b52683ea82c7fa36"}
Sep 19 04:44:09.696684 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.696593    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht" event={"ID":"af286b5f-d1b2-4e79-8927-89804e046546","Type":"ContainerDied","Data":"750eef7bfbf25729614edf80a495d996e806c5096e2c7eb5998ad8045a6806cd"}
Sep 19 04:44:09.696684 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.696608    2569 scope.go:117] "RemoveContainer" containerID="05995fcbcfb565fee1adc3e09d0ba2e46aa559c9af239668b52683ea82c7fa36"
Sep 19 04:44:09.706967 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.706949    2569 scope.go:117] "RemoveContainer" containerID="05995fcbcfb565fee1adc3e09d0ba2e46aa559c9af239668b52683ea82c7fa36"
Sep 19 04:44:09.707263 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:44:09.707244    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05995fcbcfb565fee1adc3e09d0ba2e46aa559c9af239668b52683ea82c7fa36\": container with ID starting with 05995fcbcfb565fee1adc3e09d0ba2e46aa559c9af239668b52683ea82c7fa36 not found: ID does not exist" containerID="05995fcbcfb565fee1adc3e09d0ba2e46aa559c9af239668b52683ea82c7fa36"
Sep 19 04:44:09.707310 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.707272    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05995fcbcfb565fee1adc3e09d0ba2e46aa559c9af239668b52683ea82c7fa36"} err="failed to get container status \"05995fcbcfb565fee1adc3e09d0ba2e46aa559c9af239668b52683ea82c7fa36\": rpc error: code = NotFound desc = could not find container \"05995fcbcfb565fee1adc3e09d0ba2e46aa559c9af239668b52683ea82c7fa36\": container with ID starting with 05995fcbcfb565fee1adc3e09d0ba2e46aa559c9af239668b52683ea82c7fa36 not found: ID does not exist"
Sep 19 04:44:09.721738 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.721710    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"]
Sep 19 04:44:09.734529 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:09.734503    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a0ed681d/e2e-lifecycle-model-a0ed681d-kserve-6f7d776d4-nk4ht"]
Sep 19 04:44:10.540062 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:10.540030    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af286b5f-d1b2-4e79-8927-89804e046546" path="/var/lib/kubelet/pods/af286b5f-d1b2-4e79-8927-89804e046546/volumes"
Sep 19 04:44:16.289703 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:16.289670    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:44:31.415014 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:31.414969    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:44:32.220814 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:32.220777    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:44:38.822378 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:38.822327    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:44:41.163141 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.163109    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"]
Sep 19 04:44:41.163529 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.163500    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e4d9fa8-f743-49de-b0d8-5b5d50129282" containerName="payload-pre-processing"
Sep 19 04:44:41.163529 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.163511    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e4d9fa8-f743-49de-b0d8-5b5d50129282" containerName="payload-pre-processing"
Sep 19 04:44:41.163612 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.163537    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1da557-280f-4b7b-817f-e2c6db580529" containerName="payload-processing"
Sep 19 04:44:41.163612 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.163542    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1da557-280f-4b7b-817f-e2c6db580529" containerName="payload-processing"
Sep 19 04:44:41.163612 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.163549    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af286b5f-d1b2-4e79-8927-89804e046546" containerName="main"
Sep 19 04:44:41.163612 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.163554    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="af286b5f-d1b2-4e79-8927-89804e046546" containerName="main"
Sep 19 04:44:41.163612 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.163611    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b1da557-280f-4b7b-817f-e2c6db580529" containerName="payload-processing"
Sep 19 04:44:41.163823 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.163620    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e4d9fa8-f743-49de-b0d8-5b5d50129282" containerName="payload-pre-processing"
Sep 19 04:44:41.163823 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.163627    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="af286b5f-d1b2-4e79-8927-89804e046546" containerName="main"
Sep 19 04:44:41.168237 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.168218    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.171352 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.171332    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-8bbcca\"/\"kube-root-ca.crt\""
Sep 19 04:44:41.172376 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.172356    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-8bbcca\"/\"default-dockercfg-pv8fk\""
Sep 19 04:44:41.172482 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.172396    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-8bbcca\"/\"openshift-service-ca.crt\""
Sep 19 04:44:41.172482 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.172449    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-8bbcca\"/\"auth-test-model-8bbcca-kserve-self-signed-certs\""
Sep 19 04:44:41.195283 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.195256    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"]
Sep 19 04:44:41.209803 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.209773    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:44:41.262738 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.262700    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-model-cache\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.262928 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.262740    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mgqm\" (UniqueName: \"kubernetes.io/projected/347ebb0c-36f2-4e94-b785-703f757224d9-kube-api-access-8mgqm\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.262928 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.262809    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-tmp-dir\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.262928 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.262851    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-dshm\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.263034 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.262952    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/347ebb0c-36f2-4e94-b785-703f757224d9-tls-certs\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.263034 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.262993    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-home\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.363878 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.363845    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-home\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.364083 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.363940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-model-cache\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.364083 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.363976    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mgqm\" (UniqueName: \"kubernetes.io/projected/347ebb0c-36f2-4e94-b785-703f757224d9-kube-api-access-8mgqm\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.364083 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.364012    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-tmp-dir\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.364083 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.364065    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-dshm\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.364303 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.364121    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/347ebb0c-36f2-4e94-b785-703f757224d9-tls-certs\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.364358 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.364315    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-home\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.364416 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.364356    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-model-cache\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.364416 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.364386    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-tmp-dir\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.366483 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.366458    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-dshm\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.366713 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.366692    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/347ebb0c-36f2-4e94-b785-703f757224d9-tls-certs\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.373584 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.373559    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mgqm\" (UniqueName: \"kubernetes.io/projected/347ebb0c-36f2-4e94-b785-703f757224d9-kube-api-access-8mgqm\") pod \"auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") " pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.478218 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.478134    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:41.766370 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.766288    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"]
Sep 19 04:44:41.770267 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:44:41.770237    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod347ebb0c_36f2_4e94_b785_703f757224d9.slice/crio-d2e178457d880c8427dbf5f5148ceaee2a0ab3217a6fa5517a066a0498cadc1d WatchSource:0}: Error finding container d2e178457d880c8427dbf5f5148ceaee2a0ab3217a6fa5517a066a0498cadc1d: Status 404 returned error can't find the container with id d2e178457d880c8427dbf5f5148ceaee2a0ab3217a6fa5517a066a0498cadc1d
Sep 19 04:44:41.868125 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.868091    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z" event={"ID":"347ebb0c-36f2-4e94-b785-703f757224d9","Type":"ContainerStarted","Data":"663b863c82c9933c4ea697fa0a34af139d01b292c42e31c758f7f0f87844195b"}
Sep 19 04:44:41.868125 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.868131    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z" event={"ID":"347ebb0c-36f2-4e94-b785-703f757224d9","Type":"ContainerStarted","Data":"d2e178457d880c8427dbf5f5148ceaee2a0ab3217a6fa5517a066a0498cadc1d"}
Sep 19 04:44:41.899004 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:41.898952    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z" podStartSLOduration=0.898935112 podStartE2EDuration="898.935112ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:44:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:44:41.897952307 +0000 UTC m=+1861.876148698" watchObservedRunningTime="2026-09-19 04:44:41.898935112 +0000 UTC m=+1861.877131501"
Sep 19 04:44:42.478853 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:42.478820    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:51.479105 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:51.479067    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:51.491706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:51.491682    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:51.932890 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:51.932852    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:44:54.375527 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:54.375495    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:44:54.475762 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:54.475720    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:44:54.701056 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:54.701014    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:44:55.979827 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:55.979795    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:44:56.092279 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:56.092241    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:44:56.251447 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:56.251362    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:44:56.909049 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:56.909012    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:44:57.039979 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:57.039948    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:44:58.471728 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:44:58.471693    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:00.188093 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:00.188053    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-561bb1-29829885-pdxpj"]
Sep 19 04:45:00.191562 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:00.191544    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-561bb1-29829885-pdxpj"
Sep 19 04:45:00.197293 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:00.197273    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s6xbq\""
Sep 19 04:45:00.201586 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:00.201568    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-561bb1-29829885-pdxpj"
Sep 19 04:45:00.231872 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:00.231781    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-561bb1-29829885-pdxpj"]
Sep 19 04:45:00.487244 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:00.487156    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-561bb1-29829885-pdxpj"]
Sep 19 04:45:00.490493 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:45:00.490468    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d5dba10_3aca_4ba0_90c4_d857137a973e.slice/crio-a03b227535175f5a728bfafe62d353fa1f7a022afe07abd1ada22f57d358f15b WatchSource:0}: Error finding container a03b227535175f5a728bfafe62d353fa1f7a022afe07abd1ada22f57d358f15b: Status 404 returned error can't find the container with id a03b227535175f5a728bfafe62d353fa1f7a022afe07abd1ada22f57d358f15b
Sep 19 04:45:00.492619 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:00.492603    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 04:45:00.972973 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:00.972941    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-561bb1-29829885-pdxpj" event={"ID":"8d5dba10-3aca-4ba0-90c4-d857137a973e","Type":"ContainerStarted","Data":"a03b227535175f5a728bfafe62d353fa1f7a022afe07abd1ada22f57d358f15b"}
Sep 19 04:45:02.986418 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:02.986326    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-561bb1-29829885-pdxpj" event={"ID":"8d5dba10-3aca-4ba0-90c4-d857137a973e","Type":"ContainerStarted","Data":"d856d86abfd9f934a39568475f1d69198cd93da0adbeb215df173bd2ce50136c"}
Sep 19 04:45:03.007203 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:03.007152    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-561bb1-29829885-pdxpj" podStartSLOduration=0.860101837 podStartE2EDuration="3.007137607s" totalImagesPullingTime="2.14703577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:45:03.005075252 +0000 UTC m=+1882.983271645" watchObservedRunningTime="2026-09-19 04:45:03.007137607 +0000 UTC m=+1882.985333998"
Sep 19 04:45:03.993017 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:03.992978    2569 generic.go:356] "Generic (PLEG): container finished" podID="8d5dba10-3aca-4ba0-90c4-d857137a973e" containerID="d856d86abfd9f934a39568475f1d69198cd93da0adbeb215df173bd2ce50136c" exitCode=0
Sep 19 04:45:03.993468 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:03.993022    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-561bb1-29829885-pdxpj" event={"ID":"8d5dba10-3aca-4ba0-90c4-d857137a973e","Type":"ContainerDied","Data":"d856d86abfd9f934a39568475f1d69198cd93da0adbeb215df173bd2ce50136c"}
Sep 19 04:45:04.948683 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:04.948638    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:05.020561 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:05.020528    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:05.124329 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:05.124304    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-561bb1-29829885-pdxpj"
Sep 19 04:45:05.636778 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:05.636727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:06.006972 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:06.006886    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-561bb1-29829885-pdxpj"
Sep 19 04:45:06.006972 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:06.006916    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-561bb1-29829885-pdxpj" event={"ID":"8d5dba10-3aca-4ba0-90c4-d857137a973e","Type":"ContainerDied","Data":"a03b227535175f5a728bfafe62d353fa1f7a022afe07abd1ada22f57d358f15b"}
Sep 19 04:45:06.007183 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:06.006972    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a03b227535175f5a728bfafe62d353fa1f7a022afe07abd1ada22f57d358f15b"
Sep 19 04:45:11.886888 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:11.886817    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:13.284840 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:13.284804    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:22.675086 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:22.675045    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:22.911429 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:22.911393    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:43.835534 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:43.835493    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:47.918004 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:47.917966    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:49.828222 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:49.828168    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:49.903458 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:49.903424    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:50.165994 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.165957    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:50.510875 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.510788    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"]
Sep 19 04:45:50.511268 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.511252    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d5dba10-3aca-4ba0-90c4-d857137a973e" containerName="cleanup"
Sep 19 04:45:50.511338 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.511269    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d5dba10-3aca-4ba0-90c4-d857137a973e" containerName="cleanup"
Sep 19 04:45:50.511338 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.511333    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d5dba10-3aca-4ba0-90c4-d857137a973e" containerName="cleanup"
Sep 19 04:45:50.514319 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.514296    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.518101 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.517431    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-1a212c-openshift-default-dockercfg-t7g7c\""
Sep 19 04:45:50.524482 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.524427    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 19 04:45:50.531403 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.531379    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"]
Sep 19 04:45:50.550839 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.550804    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:50.623288 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.623258    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:50.635460 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.635430    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-envoy\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.635594 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.635484    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-podinfo\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.635594 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.635523    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ec5051-353b-495d-919e-b1b594c54c8b-istiod-ca-cert\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.635700 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.635595    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-data\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.635700 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.635631    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-credential-socket\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.635700 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.635686    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-workload-socket\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.635857 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.635710    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzpnt\" (UniqueName: \"kubernetes.io/projected/d1ec5051-353b-495d-919e-b1b594c54c8b-kube-api-access-xzpnt\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.635857 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.635728    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-token\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.635857 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.635780    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-workload-certs\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.736581 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.736546    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ec5051-353b-495d-919e-b1b594c54c8b-istiod-ca-cert\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.736780 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.736595    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-data\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.736780 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.736718    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-credential-socket\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.736881 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.736823    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-workload-socket\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.736881 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.736852    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzpnt\" (UniqueName: \"kubernetes.io/projected/d1ec5051-353b-495d-919e-b1b594c54c8b-kube-api-access-xzpnt\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.736881 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.736875    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-token\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.737021 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.736900    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-workload-certs\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.737021 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.736970    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-envoy\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.737021 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.736991    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-data\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.737167 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.737031    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-podinfo\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.737167 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.737029    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-credential-socket\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.737291 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.737256    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-workload-certs\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.737398 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.737383    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-workload-socket\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.737498 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.737481    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ec5051-353b-495d-919e-b1b594c54c8b-istiod-ca-cert\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.739313 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.739297    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-envoy\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.739528 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.739511    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-podinfo\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.745795 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.745771    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzpnt\" (UniqueName: \"kubernetes.io/projected/d1ec5051-353b-495d-919e-b1b594c54c8b-kube-api-access-xzpnt\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.745795 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.745779    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-token\") pod \"e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") " pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:50.834019 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:50.833953    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:51.115311 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:51.115285    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"]
Sep 19 04:45:51.118129 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:45:51.118099    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ec5051_353b_495d_919e_b1b594c54c8b.slice/crio-0e67d7b6bb7fa67a1d6cbfc7a1217dc306bdd67c04c720ffefa1ef528fa00dae WatchSource:0}: Error finding container 0e67d7b6bb7fa67a1d6cbfc7a1217dc306bdd67c04c720ffefa1ef528fa00dae: Status 404 returned error can't find the container with id 0e67d7b6bb7fa67a1d6cbfc7a1217dc306bdd67c04c720ffefa1ef528fa00dae
Sep 19 04:45:51.120334 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:51.120303    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:45:51.120421 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:51.120368    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:45:51.120421 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:51.120397    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:45:51.253725 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:51.253673    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf" event={"ID":"d1ec5051-353b-495d-919e-b1b594c54c8b","Type":"ContainerStarted","Data":"de250558d3c0aea84a7ab6c06145da0e84d759a6b937234777c4241369d42f2c"}
Sep 19 04:45:51.253897 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:51.253783    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf" event={"ID":"d1ec5051-353b-495d-919e-b1b594c54c8b","Type":"ContainerStarted","Data":"0e67d7b6bb7fa67a1d6cbfc7a1217dc306bdd67c04c720ffefa1ef528fa00dae"}
Sep 19 04:45:51.276955 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:51.276902    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf" podStartSLOduration=1.2768846329999999 podStartE2EDuration="1.276884633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:45:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:45:51.275670551 +0000 UTC m=+1931.253866942" watchObservedRunningTime="2026-09-19 04:45:51.276884633 +0000 UTC m=+1931.255081020"
Sep 19 04:45:51.834300 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:51.834263    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:52.407597 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:52.407562    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:52.839843 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:52.839767    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:53.264542 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:53.264504    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:53.265488 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:53.265471    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:45:53.382300 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:53.382270    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:53.472615 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:53.472576    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:54.490999 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:54.490963    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:55.295297 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:55.295238    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:56.022825 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:56.022786    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:56.797787 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:56.797727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:57.478548 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.478510    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"]
Sep 19 04:45:57.482294 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.482275    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:57.485510 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.485492    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-1a212c-serving-cert\""
Sep 19 04:45:57.495798 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.495776    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"]
Sep 19 04:45:57.525427 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.525400    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:57.604423 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.604390    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-openshift-service-ca\") pod \"maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:57.604633 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.604460    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-maas-api-tls\") pod \"maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:57.604633 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.604515    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-metrics-certs\") pod \"maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:57.604633 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.604602    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rwrh\" (UniqueName: \"kubernetes.io/projected/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-kube-api-access-9rwrh\") pod \"maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:57.621190 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.621157    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:57.705593 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.705563    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-openshift-service-ca\") pod \"maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:57.705787 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.705627    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-maas-api-tls\") pod \"maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:57.705787 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.705653    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-metrics-certs\") pod \"maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:57.705787 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.705684    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rwrh\" (UniqueName: \"kubernetes.io/projected/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-kube-api-access-9rwrh\") pod \"maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:57.705981 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:45:57.705809    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-serving-cert: secret "maas-api-e2e-api-a-1a212c-serving-cert" not found
Sep 19 04:45:57.705981 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:45:57.705882    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-maas-api-tls podName:404ea878-1219-4f58-9d7f-1d5c7bdfe45b nodeName:}" failed. No retries permitted until 2026-09-19 04:45:58.205865357 +0000 UTC m=+1938.184061726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-maas-api-tls") pod "maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs" (UID: "404ea878-1219-4f58-9d7f-1d5c7bdfe45b") : secret "maas-api-e2e-api-a-1a212c-serving-cert" not found
Sep 19 04:45:57.706345 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.706320    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-openshift-service-ca\") pod \"maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:57.708268 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.708248    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-metrics-certs\") pod \"maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:57.714629 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.714601    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rwrh\" (UniqueName: \"kubernetes.io/projected/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-kube-api-access-9rwrh\") pod \"maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:57.796461 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:57.796384    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:58.210739 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:58.210711    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-maas-api-tls\") pod \"maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:58.213568 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:58.213538    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-maas-api-tls\") pod \"maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:58.348615 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:58.348580    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:58.394836 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:58.394798    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:45:58.532262 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:58.532177    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:45:58.709280 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:58.709256    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"]
Sep 19 04:45:58.711393 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:45:58.711367    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod404ea878_1219_4f58_9d7f_1d5c7bdfe45b.slice/crio-b22bba3a1b682c74b3ef87c54bdee25efdf207c56565ba55b9bec1cd5bb1ce7f WatchSource:0}: Error finding container b22bba3a1b682c74b3ef87c54bdee25efdf207c56565ba55b9bec1cd5bb1ce7f: Status 404 returned error can't find the container with id b22bba3a1b682c74b3ef87c54bdee25efdf207c56565ba55b9bec1cd5bb1ce7f
Sep 19 04:45:59.297074 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:45:59.297049    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs" event={"ID":"404ea878-1219-4f58-9d7f-1d5c7bdfe45b","Type":"ContainerStarted","Data":"b22bba3a1b682c74b3ef87c54bdee25efdf207c56565ba55b9bec1cd5bb1ce7f"}
Sep 19 04:46:00.311134 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:00.311102    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs" event={"ID":"404ea878-1219-4f58-9d7f-1d5c7bdfe45b","Type":"ContainerStarted","Data":"df92b6bf5302a2dde222e35e0350a76c00a6d639b3af0ed2d088e51b211b5a39"}
Sep 19 04:46:00.311548 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:00.311196    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:46:00.333653 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:00.333604    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs" podStartSLOduration=2.808347449 podStartE2EDuration="3.33358973s" totalImagesPullingTime="525.242281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:45:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:46:00.331993579 +0000 UTC m=+1940.310189968" watchObservedRunningTime="2026-09-19 04:46:00.33358973 +0000 UTC m=+1940.311786188"
Sep 19 04:46:06.322154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:06.322125    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:46:09.037838 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:09.037802    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:19.207294 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:19.207239    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:20.718698 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:20.718654    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:21.448039 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:21.448007    2569 generic.go:356] "Generic (PLEG): container finished" podID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerID="de250558d3c0aea84a7ab6c06145da0e84d759a6b937234777c4241369d42f2c" exitCode=0
Sep 19 04:46:21.448217 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:21.448084    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf" event={"ID":"d1ec5051-353b-495d-919e-b1b594c54c8b","Type":"ContainerDied","Data":"de250558d3c0aea84a7ab6c06145da0e84d759a6b937234777c4241369d42f2c"}
Sep 19 04:46:21.448533 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:21.448513    2569 scope.go:117] "RemoveContainer" containerID="de250558d3c0aea84a7ab6c06145da0e84d759a6b937234777c4241369d42f2c"
Sep 19 04:46:21.449670 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:21.449642    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:46:21.449861 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:21.449705    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:46:21.449861 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:21.449739    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:46:21.491776 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:21.491703    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:21.901189 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:21.901156    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:22.010806 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:22.010742    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:22.455926 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:22.455888    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf" event={"ID":"d1ec5051-353b-495d-919e-b1b594c54c8b","Type":"ContainerStarted","Data":"b38f4a77bb4c26b94295e55717ddd39e9724964985428d6cd92ae8da45cfe6a3"}
Sep 19 04:46:22.499906 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:22.499873    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:22.835087 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:22.834997    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:46:22.836326 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:22.836295    2569 patch_prober.go:28] interesting pod/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 19 04:46:22.836463 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:22.836357    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf" podUID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 19 04:46:23.218487 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:23.218452    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:23.265085 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:23.265056    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:46:23.352325 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:23.352286    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:23.834861 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:23.834826    2569 patch_prober.go:28] interesting pod/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 19 04:46:23.835047 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:23.834882    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf" podUID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 19 04:46:23.840262 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:23.840235    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:23.981418 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:23.981373    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:24.195248 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:24.195219    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:24.321436 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:24.321402    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:24.421263 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:24.421222    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:24.834650 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:24.834617    2569 patch_prober.go:28] interesting pod/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 19 04:46:24.834860 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:24.834686    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf" podUID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 19 04:46:25.050036 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:25.049991    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:25.834414 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:25.834375    2569 patch_prober.go:28] interesting pod/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 19 04:46:25.834922 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:25.834435    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf" podUID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 19 04:46:25.888501 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:25.888462    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:26.742779 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:26.742724    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:26.834512 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:26.834477    2569 patch_prober.go:28] interesting pod/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Sep 19 04:46:26.834938 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:26.834549    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf" podUID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Sep 19 04:46:27.169419 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:27.169383    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:27.311804 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:27.311768    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:27.839286 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:27.839257    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:46:27.840483 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:27.840462    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:46:27.921860 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:27.921829    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:28.807925 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:28.807889    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:29.696303 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:29.696269    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:30.582828 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:30.582777    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:31.285706 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:31.285666    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:31.983661 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:31.983633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:32.815249 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:32.815208    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:32.912542 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:32.912512    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:33.012227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.012193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:33.300097 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.300067    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:33.397468 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.397438    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:33.424963 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.424927    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"]
Sep 19 04:46:33.429715 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.429697    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"
Sep 19 04:46:33.432507 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.432477    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-29f7a5\""
Sep 19 04:46:33.432635 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.432595    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-29f7a5-dockercfg-6cbgf\""
Sep 19 04:46:33.444147 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.444122    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"]
Sep 19 04:46:33.584176 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.584092    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-252tn\" (UniqueName: \"kubernetes.io/projected/3995358b-3998-4080-8e63-b89e3c68a291-kube-api-access-252tn\") pod \"payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj\" (UID: \"3995358b-3998-4080-8e63-b89e3c68a291\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"
Sep 19 04:46:33.584342 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.584208    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3995358b-3998-4080-8e63-b89e3c68a291-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj\" (UID: \"3995358b-3998-4080-8e63-b89e3c68a291\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"
Sep 19 04:46:33.685270 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.685231    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-252tn\" (UniqueName: \"kubernetes.io/projected/3995358b-3998-4080-8e63-b89e3c68a291-kube-api-access-252tn\") pod \"payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj\" (UID: \"3995358b-3998-4080-8e63-b89e3c68a291\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"
Sep 19 04:46:33.685441 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.685313    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3995358b-3998-4080-8e63-b89e3c68a291-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj\" (UID: \"3995358b-3998-4080-8e63-b89e3c68a291\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"
Sep 19 04:46:33.686032 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.686014    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3995358b-3998-4080-8e63-b89e3c68a291-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj\" (UID: \"3995358b-3998-4080-8e63-b89e3c68a291\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"
Sep 19 04:46:33.694225 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.694198    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-252tn\" (UniqueName: \"kubernetes.io/projected/3995358b-3998-4080-8e63-b89e3c68a291-kube-api-access-252tn\") pod \"payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj\" (UID: \"3995358b-3998-4080-8e63-b89e3c68a291\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"
Sep 19 04:46:33.740737 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:33.740712    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"
Sep 19 04:46:34.016895 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:34.016867    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"]
Sep 19 04:46:34.019066 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:46:34.019034    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3995358b_3998_4080_8e63_b89e3c68a291.slice/crio-992062ba0569341a1b908dbca0efdd34650461ab1c3a378b8daa413a40d14093 WatchSource:0}: Error finding container 992062ba0569341a1b908dbca0efdd34650461ab1c3a378b8daa413a40d14093: Status 404 returned error can't find the container with id 992062ba0569341a1b908dbca0efdd34650461ab1c3a378b8daa413a40d14093
Sep 19 04:46:34.531048 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:34.531012    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj" event={"ID":"3995358b-3998-4080-8e63-b89e3c68a291","Type":"ContainerStarted","Data":"c9e83bf297df6c0ab651f13c4203abbbd3f595b7552652481b59618b7955db71"}
Sep 19 04:46:34.531227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:34.531068    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj" event={"ID":"3995358b-3998-4080-8e63-b89e3c68a291","Type":"ContainerStarted","Data":"992062ba0569341a1b908dbca0efdd34650461ab1c3a378b8daa413a40d14093"}
Sep 19 04:46:34.531227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:34.531136    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"
Sep 19 04:46:34.576835 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:34.576785    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj" podStartSLOduration=1.5767685230000001 podStartE2EDuration="1.576768523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:46:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:46:34.575902432 +0000 UTC m=+1974.554098824" watchObservedRunningTime="2026-09-19 04:46:34.576768523 +0000 UTC m=+1974.554964926"
Sep 19 04:46:35.343719 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:35.343684    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:45.539505 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:45.539475    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"
Sep 19 04:46:55.088709 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:55.088664    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:55.988444 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:55.988406    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:56.710575 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:56.710531    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:57.179425 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:57.179390    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:57.447909 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:57.447820    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:58.303785 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:58.303742    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:46:59.305112 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:46:59.305075    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:00.163506 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:00.163476    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:00.970513 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:00.970472    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:01.921055 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:01.921013    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:02.712951 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:02.712905    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:03.494357 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:03.494322    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:04.284352 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:04.284285    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:05.098408 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:05.098364    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:05.937266 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:05.937238    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:06.790836 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:06.790804    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:10.373988 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:10.373950    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:16.001733 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.001701    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"]
Sep 19 04:47:16.002132 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.001919    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs" podUID="404ea878-1219-4f58-9d7f-1d5c7bdfe45b" containerName="maas-api" containerID="cri-o://df92b6bf5302a2dde222e35e0350a76c00a6d639b3af0ed2d088e51b211b5a39" gracePeriod=30
Sep 19 04:47:16.025890 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.025855    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:16.147059 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.147025    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:16.257489 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.257387    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:16.260204 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.260188    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:47:16.341474 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.341431    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:16.408728 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.408689    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-metrics-certs\") pod \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") "
Sep 19 04:47:16.408921 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.408863    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-openshift-service-ca\") pod \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") "
Sep 19 04:47:16.408921 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.408895    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-maas-api-tls\") pod \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") "
Sep 19 04:47:16.408998 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.408921    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rwrh\" (UniqueName: \"kubernetes.io/projected/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-kube-api-access-9rwrh\") pod \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\" (UID: \"404ea878-1219-4f58-9d7f-1d5c7bdfe45b\") "
Sep 19 04:47:16.409615 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.409508    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "404ea878-1219-4f58-9d7f-1d5c7bdfe45b" (UID: "404ea878-1219-4f58-9d7f-1d5c7bdfe45b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:47:16.411314 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.411278    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "404ea878-1219-4f58-9d7f-1d5c7bdfe45b" (UID: "404ea878-1219-4f58-9d7f-1d5c7bdfe45b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:47:16.411949 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.411923    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-kube-api-access-9rwrh" (OuterVolumeSpecName: "kube-api-access-9rwrh") pod "404ea878-1219-4f58-9d7f-1d5c7bdfe45b" (UID: "404ea878-1219-4f58-9d7f-1d5c7bdfe45b"). InnerVolumeSpecName "kube-api-access-9rwrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:47:16.412091 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.412066    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "404ea878-1219-4f58-9d7f-1d5c7bdfe45b" (UID: "404ea878-1219-4f58-9d7f-1d5c7bdfe45b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:47:16.510162 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.510079    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-metrics-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:16.510162 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.510108    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-openshift-service-ca\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:16.510162 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.510117    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-maas-api-tls\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:16.510162 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.510125    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rwrh\" (UniqueName: \"kubernetes.io/projected/404ea878-1219-4f58-9d7f-1d5c7bdfe45b-kube-api-access-9rwrh\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:16.733341 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.733304    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:16.766257 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.766172    2569 generic.go:356] "Generic (PLEG): container finished" podID="404ea878-1219-4f58-9d7f-1d5c7bdfe45b" containerID="df92b6bf5302a2dde222e35e0350a76c00a6d639b3af0ed2d088e51b211b5a39" exitCode=0
Sep 19 04:47:16.766257 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.766221    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"
Sep 19 04:47:16.766445 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.766262    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs" event={"ID":"404ea878-1219-4f58-9d7f-1d5c7bdfe45b","Type":"ContainerDied","Data":"df92b6bf5302a2dde222e35e0350a76c00a6d639b3af0ed2d088e51b211b5a39"}
Sep 19 04:47:16.766445 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.766311    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs" event={"ID":"404ea878-1219-4f58-9d7f-1d5c7bdfe45b","Type":"ContainerDied","Data":"b22bba3a1b682c74b3ef87c54bdee25efdf207c56565ba55b9bec1cd5bb1ce7f"}
Sep 19 04:47:16.766445 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.766336    2569 scope.go:117] "RemoveContainer" containerID="df92b6bf5302a2dde222e35e0350a76c00a6d639b3af0ed2d088e51b211b5a39"
Sep 19 04:47:16.775623 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.775604    2569 scope.go:117] "RemoveContainer" containerID="df92b6bf5302a2dde222e35e0350a76c00a6d639b3af0ed2d088e51b211b5a39"
Sep 19 04:47:16.775891 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:47:16.775869    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df92b6bf5302a2dde222e35e0350a76c00a6d639b3af0ed2d088e51b211b5a39\": container with ID starting with df92b6bf5302a2dde222e35e0350a76c00a6d639b3af0ed2d088e51b211b5a39 not found: ID does not exist" containerID="df92b6bf5302a2dde222e35e0350a76c00a6d639b3af0ed2d088e51b211b5a39"
Sep 19 04:47:16.775975 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.775904    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df92b6bf5302a2dde222e35e0350a76c00a6d639b3af0ed2d088e51b211b5a39"} err="failed to get container status \"df92b6bf5302a2dde222e35e0350a76c00a6d639b3af0ed2d088e51b211b5a39\": rpc error: code = NotFound desc = could not find container \"df92b6bf5302a2dde222e35e0350a76c00a6d639b3af0ed2d088e51b211b5a39\": container with ID starting with df92b6bf5302a2dde222e35e0350a76c00a6d639b3af0ed2d088e51b211b5a39 not found: ID does not exist"
Sep 19 04:47:16.786948 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.786925    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"]
Sep 19 04:47:16.794570 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.794550    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-1a212c-788d866bb4-7jfgs"]
Sep 19 04:47:16.847877 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:16.847844    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:17.662256 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:17.662207    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:18.366453 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:18.366414    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:18.539585 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:18.539551    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="404ea878-1219-4f58-9d7f-1d5c7bdfe45b" path="/var/lib/kubelet/pods/404ea878-1219-4f58-9d7f-1d5c7bdfe45b/volumes"
Sep 19 04:47:19.293161 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:19.293123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:20.073230 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:20.073199    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:20.760777 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:20.760716    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:21.590945 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:21.590914    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:23.768841 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:23.768805    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:23.914716 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:23.914682    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:24.134553 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:24.134509    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"]
Sep 19 04:47:24.134820 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:24.134783    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf" podUID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerName="istio-proxy" containerID="cri-o://b38f4a77bb4c26b94295e55717ddd39e9724964985428d6cd92ae8da45cfe6a3" gracePeriod=30
Sep 19 04:47:24.155332 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:24.155300    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:25.351817 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:25.351779    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:26.102130 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:26.102083    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:26.843001 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:26.842970    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:27.675850 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:27.675809    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:27.842151 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:27.842118    2569 patch_prober.go:28] interesting pod/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 04:47:27.842334 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:27.842180    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf" podUID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 04:47:28.371277 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:28.371240    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:29.078810 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.078779    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:29.405039 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.405019    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:47:29.439040 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439013    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-credential-socket\") pod \"d1ec5051-353b-495d-919e-b1b594c54c8b\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") "
Sep 19 04:47:29.439213 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439051    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-data\") pod \"d1ec5051-353b-495d-919e-b1b594c54c8b\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") "
Sep 19 04:47:29.439213 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439104    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-workload-certs\") pod \"d1ec5051-353b-495d-919e-b1b594c54c8b\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") "
Sep 19 04:47:29.439213 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439129    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ec5051-353b-495d-919e-b1b594c54c8b-istiod-ca-cert\") pod \"d1ec5051-353b-495d-919e-b1b594c54c8b\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") "
Sep 19 04:47:29.439213 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439176    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzpnt\" (UniqueName: \"kubernetes.io/projected/d1ec5051-353b-495d-919e-b1b594c54c8b-kube-api-access-xzpnt\") pod \"d1ec5051-353b-495d-919e-b1b594c54c8b\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") "
Sep 19 04:47:29.439213 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439206    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-workload-socket\") pod \"d1ec5051-353b-495d-919e-b1b594c54c8b\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") "
Sep 19 04:47:29.439479 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439254    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-token\") pod \"d1ec5051-353b-495d-919e-b1b594c54c8b\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") "
Sep 19 04:47:29.439479 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439302    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-podinfo\") pod \"d1ec5051-353b-495d-919e-b1b594c54c8b\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") "
Sep 19 04:47:29.439479 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439328    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-envoy\") pod \"d1ec5051-353b-495d-919e-b1b594c54c8b\" (UID: \"d1ec5051-353b-495d-919e-b1b594c54c8b\") "
Sep 19 04:47:29.439479 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439344    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d1ec5051-353b-495d-919e-b1b594c54c8b" (UID: "d1ec5051-353b-495d-919e-b1b594c54c8b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:47:29.439479 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439356    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-data" (OuterVolumeSpecName: "istio-data") pod "d1ec5051-353b-495d-919e-b1b594c54c8b" (UID: "d1ec5051-353b-495d-919e-b1b594c54c8b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:47:29.439479 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439439    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d1ec5051-353b-495d-919e-b1b594c54c8b" (UID: "d1ec5051-353b-495d-919e-b1b594c54c8b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:47:29.439799 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439689    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-credential-socket\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:29.439799 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439709    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-data\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:29.439799 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439725    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-workload-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:29.439945 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439838    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d1ec5051-353b-495d-919e-b1b594c54c8b" (UID: "d1ec5051-353b-495d-919e-b1b594c54c8b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:47:29.440094 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.439955    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1ec5051-353b-495d-919e-b1b594c54c8b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d1ec5051-353b-495d-919e-b1b594c54c8b" (UID: "d1ec5051-353b-495d-919e-b1b594c54c8b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:47:29.441684 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.441653    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d1ec5051-353b-495d-919e-b1b594c54c8b" (UID: "d1ec5051-353b-495d-919e-b1b594c54c8b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:47:29.441897 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.441874    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d1ec5051-353b-495d-919e-b1b594c54c8b" (UID: "d1ec5051-353b-495d-919e-b1b594c54c8b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:47:29.442158 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.442136    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1ec5051-353b-495d-919e-b1b594c54c8b-kube-api-access-xzpnt" (OuterVolumeSpecName: "kube-api-access-xzpnt") pod "d1ec5051-353b-495d-919e-b1b594c54c8b" (UID: "d1ec5051-353b-495d-919e-b1b594c54c8b"). InnerVolumeSpecName "kube-api-access-xzpnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:47:29.442444 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.442151    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-token" (OuterVolumeSpecName: "istio-token") pod "d1ec5051-353b-495d-919e-b1b594c54c8b" (UID: "d1ec5051-353b-495d-919e-b1b594c54c8b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:47:29.541041 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.541006    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-token\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:29.541041 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.541035    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-podinfo\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:29.541041 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.541045    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-istio-envoy\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:29.541283 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.541053    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d1ec5051-353b-495d-919e-b1b594c54c8b-istiod-ca-cert\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:29.541283 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.541061    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzpnt\" (UniqueName: \"kubernetes.io/projected/d1ec5051-353b-495d-919e-b1b594c54c8b-kube-api-access-xzpnt\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:29.541283 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.541071    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d1ec5051-353b-495d-919e-b1b594c54c8b-workload-socket\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:29.768654 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.768548    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:29.844728 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.844693    2569 generic.go:356] "Generic (PLEG): container finished" podID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerID="b38f4a77bb4c26b94295e55717ddd39e9724964985428d6cd92ae8da45cfe6a3" exitCode=0
Sep 19 04:47:29.844934 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.844742    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"
Sep 19 04:47:29.844934 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.844774    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf" event={"ID":"d1ec5051-353b-495d-919e-b1b594c54c8b","Type":"ContainerDied","Data":"b38f4a77bb4c26b94295e55717ddd39e9724964985428d6cd92ae8da45cfe6a3"}
Sep 19 04:47:29.844934 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.844832    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf" event={"ID":"d1ec5051-353b-495d-919e-b1b594c54c8b","Type":"ContainerDied","Data":"0e67d7b6bb7fa67a1d6cbfc7a1217dc306bdd67c04c720ffefa1ef528fa00dae"}
Sep 19 04:47:29.844934 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.844856    2569 scope.go:117] "RemoveContainer" containerID="b38f4a77bb4c26b94295e55717ddd39e9724964985428d6cd92ae8da45cfe6a3"
Sep 19 04:47:29.855330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.855313    2569 scope.go:117] "RemoveContainer" containerID="de250558d3c0aea84a7ab6c06145da0e84d759a6b937234777c4241369d42f2c"
Sep 19 04:47:29.863888 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.863869    2569 scope.go:117] "RemoveContainer" containerID="b38f4a77bb4c26b94295e55717ddd39e9724964985428d6cd92ae8da45cfe6a3"
Sep 19 04:47:29.864169 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:47:29.864141    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b38f4a77bb4c26b94295e55717ddd39e9724964985428d6cd92ae8da45cfe6a3\": container with ID starting with b38f4a77bb4c26b94295e55717ddd39e9724964985428d6cd92ae8da45cfe6a3 not found: ID does not exist" containerID="b38f4a77bb4c26b94295e55717ddd39e9724964985428d6cd92ae8da45cfe6a3"
Sep 19 04:47:29.864209 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.864178    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b38f4a77bb4c26b94295e55717ddd39e9724964985428d6cd92ae8da45cfe6a3"} err="failed to get container status \"b38f4a77bb4c26b94295e55717ddd39e9724964985428d6cd92ae8da45cfe6a3\": rpc error: code = NotFound desc = could not find container \"b38f4a77bb4c26b94295e55717ddd39e9724964985428d6cd92ae8da45cfe6a3\": container with ID starting with b38f4a77bb4c26b94295e55717ddd39e9724964985428d6cd92ae8da45cfe6a3 not found: ID does not exist"
Sep 19 04:47:29.864209 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.864196    2569 scope.go:117] "RemoveContainer" containerID="de250558d3c0aea84a7ab6c06145da0e84d759a6b937234777c4241369d42f2c"
Sep 19 04:47:29.864464 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:47:29.864449    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de250558d3c0aea84a7ab6c06145da0e84d759a6b937234777c4241369d42f2c\": container with ID starting with de250558d3c0aea84a7ab6c06145da0e84d759a6b937234777c4241369d42f2c not found: ID does not exist" containerID="de250558d3c0aea84a7ab6c06145da0e84d759a6b937234777c4241369d42f2c"
Sep 19 04:47:29.864504 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.864468    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de250558d3c0aea84a7ab6c06145da0e84d759a6b937234777c4241369d42f2c"} err="failed to get container status \"de250558d3c0aea84a7ab6c06145da0e84d759a6b937234777c4241369d42f2c\": rpc error: code = NotFound desc = could not find container \"de250558d3c0aea84a7ab6c06145da0e84d759a6b937234777c4241369d42f2c\": container with ID starting with de250558d3c0aea84a7ab6c06145da0e84d759a6b937234777c4241369d42f2c not found: ID does not exist"
Sep 19 04:47:29.874626 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.874601    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"]
Sep 19 04:47:29.879127 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:29.879104    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-1a212c-openshift-default-7b4c9fbd-t8wtf"]
Sep 19 04:47:30.539656 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:30.539614    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1ec5051-353b-495d-919e-b1b594c54c8b" path="/var/lib/kubelet/pods/d1ec5051-353b-495d-919e-b1b594c54c8b/volumes"
Sep 19 04:47:40.051397 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.051350    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:40.085523 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.085485    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"]
Sep 19 04:47:40.085881 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.085850    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj" podUID="3995358b-3998-4080-8e63-b89e3c68a291" containerName="payload-pre-processing" containerID="cri-o://c9e83bf297df6c0ab651f13c4203abbbd3f595b7552652481b59618b7955db71" gracePeriod=30
Sep 19 04:47:40.134921 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.134856    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:40.247702 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.247665    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:40.342117 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.342094    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"
Sep 19 04:47:40.396945 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.396914    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:40.453071 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.453040    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3995358b-3998-4080-8e63-b89e3c68a291-plugins-config-volume\") pod \"3995358b-3998-4080-8e63-b89e3c68a291\" (UID: \"3995358b-3998-4080-8e63-b89e3c68a291\") "
Sep 19 04:47:40.453208 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.453089    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-252tn\" (UniqueName: \"kubernetes.io/projected/3995358b-3998-4080-8e63-b89e3c68a291-kube-api-access-252tn\") pod \"3995358b-3998-4080-8e63-b89e3c68a291\" (UID: \"3995358b-3998-4080-8e63-b89e3c68a291\") "
Sep 19 04:47:40.453395 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.453372    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3995358b-3998-4080-8e63-b89e3c68a291-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3995358b-3998-4080-8e63-b89e3c68a291" (UID: "3995358b-3998-4080-8e63-b89e3c68a291"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:47:40.455263 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.455240    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3995358b-3998-4080-8e63-b89e3c68a291-kube-api-access-252tn" (OuterVolumeSpecName: "kube-api-access-252tn") pod "3995358b-3998-4080-8e63-b89e3c68a291" (UID: "3995358b-3998-4080-8e63-b89e3c68a291"). InnerVolumeSpecName "kube-api-access-252tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:47:40.553951 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.553924    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3995358b-3998-4080-8e63-b89e3c68a291-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:40.553951 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.553948    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-252tn\" (UniqueName: \"kubernetes.io/projected/3995358b-3998-4080-8e63-b89e3c68a291-kube-api-access-252tn\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:40.799539 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.799503    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:40.906179 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.906146    2569 generic.go:356] "Generic (PLEG): container finished" podID="3995358b-3998-4080-8e63-b89e3c68a291" containerID="c9e83bf297df6c0ab651f13c4203abbbd3f595b7552652481b59618b7955db71" exitCode=0
Sep 19 04:47:40.906336 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.906191    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"
Sep 19 04:47:40.906336 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.906225    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj" event={"ID":"3995358b-3998-4080-8e63-b89e3c68a291","Type":"ContainerDied","Data":"c9e83bf297df6c0ab651f13c4203abbbd3f595b7552652481b59618b7955db71"}
Sep 19 04:47:40.906336 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.906276    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj" event={"ID":"3995358b-3998-4080-8e63-b89e3c68a291","Type":"ContainerDied","Data":"992062ba0569341a1b908dbca0efdd34650461ab1c3a378b8daa413a40d14093"}
Sep 19 04:47:40.906336 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.906290    2569 scope.go:117] "RemoveContainer" containerID="c9e83bf297df6c0ab651f13c4203abbbd3f595b7552652481b59618b7955db71"
Sep 19 04:47:40.912857 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.912788    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:40.915501 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.915486    2569 scope.go:117] "RemoveContainer" containerID="c9e83bf297df6c0ab651f13c4203abbbd3f595b7552652481b59618b7955db71"
Sep 19 04:47:40.915843 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:47:40.915819    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9e83bf297df6c0ab651f13c4203abbbd3f595b7552652481b59618b7955db71\": container with ID starting with c9e83bf297df6c0ab651f13c4203abbbd3f595b7552652481b59618b7955db71 not found: ID does not exist" containerID="c9e83bf297df6c0ab651f13c4203abbbd3f595b7552652481b59618b7955db71"
Sep 19 04:47:40.915940 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.915852    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9e83bf297df6c0ab651f13c4203abbbd3f595b7552652481b59618b7955db71"} err="failed to get container status \"c9e83bf297df6c0ab651f13c4203abbbd3f595b7552652481b59618b7955db71\": rpc error: code = NotFound desc = could not find container \"c9e83bf297df6c0ab651f13c4203abbbd3f595b7552652481b59618b7955db71\": container with ID starting with c9e83bf297df6c0ab651f13c4203abbbd3f595b7552652481b59618b7955db71 not found: ID does not exist"
Sep 19 04:47:40.931436 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.931413    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"]
Sep 19 04:47:40.942258 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:40.942238    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-29f7a5-577d995598-z2knj"]
Sep 19 04:47:42.250217 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:42.250179    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:42.539090 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:42.539013    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3995358b-3998-4080-8e63-b89e3c68a291" path="/var/lib/kubelet/pods/3995358b-3998-4080-8e63-b89e3c68a291/volumes"
Sep 19 04:47:43.278763 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:43.278699    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:44.081891 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:44.081860    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:44.861695 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:44.861655    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:45.588770 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:45.588721    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:47.008040 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:47.008004    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:47.110242 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:47.110211    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:47.320687 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:47.320569    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:47.971947 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:47.971915    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:48.146655 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:48.146624    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:48.997153 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:48.997114    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:49.712996 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:49.712959    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:50.566959 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:50.566921    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:51.390672 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:51.390634    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:52.349308 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:52.349275    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:53.161071 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:53.161035    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"]
Sep 19 04:47:53.248987 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:53.248957    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:53.613927 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:53.613838    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:58.467346 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:58.467310    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:58.495324 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:58.495288    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"]
Sep 19 04:47:58.495546 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:58.495501    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst" podUID="cd1c6206-c249-4e44-8c2f-4039e46820b1" containerName="payload-processing" containerID="cri-o://39c5bcaad79dc11708fb57c5cbd7a27ce1971e138713702cc9381c06bc51bb90" gracePeriod=30
Sep 19 04:47:58.545629 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:58.545568    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:58.657860 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:58.657587    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:58.749900 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:58.749872    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:58.760261 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:58.760242    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"
Sep 19 04:47:58.934180 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:58.934147    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd1c6206-c249-4e44-8c2f-4039e46820b1-plugins-config-volume\") pod \"cd1c6206-c249-4e44-8c2f-4039e46820b1\" (UID: \"cd1c6206-c249-4e44-8c2f-4039e46820b1\") "
Sep 19 04:47:58.934365 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:58.934214    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flfgd\" (UniqueName: \"kubernetes.io/projected/cd1c6206-c249-4e44-8c2f-4039e46820b1-kube-api-access-flfgd\") pod \"cd1c6206-c249-4e44-8c2f-4039e46820b1\" (UID: \"cd1c6206-c249-4e44-8c2f-4039e46820b1\") "
Sep 19 04:47:58.934546 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:58.934515    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd1c6206-c249-4e44-8c2f-4039e46820b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cd1c6206-c249-4e44-8c2f-4039e46820b1" (UID: "cd1c6206-c249-4e44-8c2f-4039e46820b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:47:58.936347 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:58.936323    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd1c6206-c249-4e44-8c2f-4039e46820b1-kube-api-access-flfgd" (OuterVolumeSpecName: "kube-api-access-flfgd") pod "cd1c6206-c249-4e44-8c2f-4039e46820b1" (UID: "cd1c6206-c249-4e44-8c2f-4039e46820b1"). InnerVolumeSpecName "kube-api-access-flfgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:47:59.008607 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:59.008524    2569 generic.go:356] "Generic (PLEG): container finished" podID="cd1c6206-c249-4e44-8c2f-4039e46820b1" containerID="39c5bcaad79dc11708fb57c5cbd7a27ce1971e138713702cc9381c06bc51bb90" exitCode=0
Sep 19 04:47:59.008607 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:59.008566    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"
Sep 19 04:47:59.008607 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:59.008575    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst" event={"ID":"cd1c6206-c249-4e44-8c2f-4039e46820b1","Type":"ContainerDied","Data":"39c5bcaad79dc11708fb57c5cbd7a27ce1971e138713702cc9381c06bc51bb90"}
Sep 19 04:47:59.008857 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:59.008634    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst" event={"ID":"cd1c6206-c249-4e44-8c2f-4039e46820b1","Type":"ContainerDied","Data":"b798ca91c528045136c1dcb18a02fa4affb1ce30d82fe0c2c5f89668f80f649e"}
Sep 19 04:47:59.008857 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:59.008661    2569 scope.go:117] "RemoveContainer" containerID="39c5bcaad79dc11708fb57c5cbd7a27ce1971e138713702cc9381c06bc51bb90"
Sep 19 04:47:59.018124 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:59.018103    2569 scope.go:117] "RemoveContainer" containerID="39c5bcaad79dc11708fb57c5cbd7a27ce1971e138713702cc9381c06bc51bb90"
Sep 19 04:47:59.018404 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:47:59.018383    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39c5bcaad79dc11708fb57c5cbd7a27ce1971e138713702cc9381c06bc51bb90\": container with ID starting with 39c5bcaad79dc11708fb57c5cbd7a27ce1971e138713702cc9381c06bc51bb90 not found: ID does not exist" containerID="39c5bcaad79dc11708fb57c5cbd7a27ce1971e138713702cc9381c06bc51bb90"
Sep 19 04:47:59.018464 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:59.018416    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39c5bcaad79dc11708fb57c5cbd7a27ce1971e138713702cc9381c06bc51bb90"} err="failed to get container status \"39c5bcaad79dc11708fb57c5cbd7a27ce1971e138713702cc9381c06bc51bb90\": rpc error: code = NotFound desc = could not find container \"39c5bcaad79dc11708fb57c5cbd7a27ce1971e138713702cc9381c06bc51bb90\": container with ID starting with 39c5bcaad79dc11708fb57c5cbd7a27ce1971e138713702cc9381c06bc51bb90 not found: ID does not exist"
Sep 19 04:47:59.035707 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:59.035678    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cd1c6206-c249-4e44-8c2f-4039e46820b1-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:59.035707 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:59.035702    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flfgd\" (UniqueName: \"kubernetes.io/projected/cd1c6206-c249-4e44-8c2f-4039e46820b1-kube-api-access-flfgd\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:47:59.042411 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:59.042393    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"]
Sep 19 04:47:59.045991 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:59.045963    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-c1a7b6-65bbdfcf85-7qqst"]
Sep 19 04:47:59.097233 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:59.097203    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:59.168600 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:59.168574    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:47:59.909090 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:47:59.909054    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:00.547380 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:00.547341    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd1c6206-c249-4e44-8c2f-4039e46820b1" path="/var/lib/kubelet/pods/cd1c6206-c249-4e44-8c2f-4039e46820b1/volumes"
Sep 19 04:48:00.768522 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:00.768483    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:01.692296 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:01.692194    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:02.271118 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.271083    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"]
Sep 19 04:48:02.271345 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.271297    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm" podUID="cbc30208-fb02-4fdd-8484-0dbac4b1d070" containerName="maas-api" containerID="cri-o://c44def5b2f747c503fea9e3688e2a7a0368076e00720dd18ad69f45d783483f9" gracePeriod=30
Sep 19 04:48:02.312820 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.312794    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:02.408259 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.408192    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:02.507605 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.507578    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:02.524602 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.524545    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:48:02.609072 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.609041    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:02.669929 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.669899    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-metrics-certs\") pod \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") "
Sep 19 04:48:02.670113 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.669983    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbc30208-fb02-4fdd-8484-0dbac4b1d070-openshift-service-ca\") pod \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") "
Sep 19 04:48:02.670113 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.670035    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkpnf\" (UniqueName: \"kubernetes.io/projected/cbc30208-fb02-4fdd-8484-0dbac4b1d070-kube-api-access-nkpnf\") pod \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") "
Sep 19 04:48:02.670113 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.670050    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-maas-api-tls\") pod \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\" (UID: \"cbc30208-fb02-4fdd-8484-0dbac4b1d070\") "
Sep 19 04:48:02.670370 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.670346    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbc30208-fb02-4fdd-8484-0dbac4b1d070-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cbc30208-fb02-4fdd-8484-0dbac4b1d070" (UID: "cbc30208-fb02-4fdd-8484-0dbac4b1d070"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:48:02.672244 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.672215    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cbc30208-fb02-4fdd-8484-0dbac4b1d070" (UID: "cbc30208-fb02-4fdd-8484-0dbac4b1d070"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:48:02.672347 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.672259    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cbc30208-fb02-4fdd-8484-0dbac4b1d070" (UID: "cbc30208-fb02-4fdd-8484-0dbac4b1d070"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:48:02.672347 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.672318    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc30208-fb02-4fdd-8484-0dbac4b1d070-kube-api-access-nkpnf" (OuterVolumeSpecName: "kube-api-access-nkpnf") pod "cbc30208-fb02-4fdd-8484-0dbac4b1d070" (UID: "cbc30208-fb02-4fdd-8484-0dbac4b1d070"). InnerVolumeSpecName "kube-api-access-nkpnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:48:02.771523 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.771493    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkpnf\" (UniqueName: \"kubernetes.io/projected/cbc30208-fb02-4fdd-8484-0dbac4b1d070-kube-api-access-nkpnf\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:48:02.771523 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.771522    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-maas-api-tls\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:48:02.771523 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.771532    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbc30208-fb02-4fdd-8484-0dbac4b1d070-metrics-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:48:02.771942 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.771540    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cbc30208-fb02-4fdd-8484-0dbac4b1d070-openshift-service-ca\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:48:02.911470 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:02.911442    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:03.009775 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:03.009705    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:03.031260 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:03.031223    2569 generic.go:356] "Generic (PLEG): container finished" podID="cbc30208-fb02-4fdd-8484-0dbac4b1d070" containerID="c44def5b2f747c503fea9e3688e2a7a0368076e00720dd18ad69f45d783483f9" exitCode=0
Sep 19 04:48:03.031446 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:03.031265    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"
Sep 19 04:48:03.031446 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:03.031310    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm" event={"ID":"cbc30208-fb02-4fdd-8484-0dbac4b1d070","Type":"ContainerDied","Data":"c44def5b2f747c503fea9e3688e2a7a0368076e00720dd18ad69f45d783483f9"}
Sep 19 04:48:03.031446 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:03.031364    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm" event={"ID":"cbc30208-fb02-4fdd-8484-0dbac4b1d070","Type":"ContainerDied","Data":"c5edae4bd8f04e350464f62c317c7bc94b58727d7f985ea2995eeafcac3e19e4"}
Sep 19 04:48:03.031446 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:03.031385    2569 scope.go:117] "RemoveContainer" containerID="c44def5b2f747c503fea9e3688e2a7a0368076e00720dd18ad69f45d783483f9"
Sep 19 04:48:03.041968 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:03.041944    2569 scope.go:117] "RemoveContainer" containerID="c44def5b2f747c503fea9e3688e2a7a0368076e00720dd18ad69f45d783483f9"
Sep 19 04:48:03.042259 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:48:03.042240    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c44def5b2f747c503fea9e3688e2a7a0368076e00720dd18ad69f45d783483f9\": container with ID starting with c44def5b2f747c503fea9e3688e2a7a0368076e00720dd18ad69f45d783483f9 not found: ID does not exist" containerID="c44def5b2f747c503fea9e3688e2a7a0368076e00720dd18ad69f45d783483f9"
Sep 19 04:48:03.042321 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:03.042272    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c44def5b2f747c503fea9e3688e2a7a0368076e00720dd18ad69f45d783483f9"} err="failed to get container status \"c44def5b2f747c503fea9e3688e2a7a0368076e00720dd18ad69f45d783483f9\": rpc error: code = NotFound desc = could not find container \"c44def5b2f747c503fea9e3688e2a7a0368076e00720dd18ad69f45d783483f9\": container with ID starting with c44def5b2f747c503fea9e3688e2a7a0368076e00720dd18ad69f45d783483f9 not found: ID does not exist"
Sep 19 04:48:03.055452 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:03.055429    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"]
Sep 19 04:48:03.064412 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:03.064393    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-87e3e6-75ddbd55c4-zbvgm"]
Sep 19 04:48:03.737155 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:03.737119    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:04.540404 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:04.540363    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbc30208-fb02-4fdd-8484-0dbac4b1d070" path="/var/lib/kubelet/pods/cbc30208-fb02-4fdd-8484-0dbac4b1d070/volumes"
Sep 19 04:48:04.586116 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:04.586079    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:05.306111 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:05.306073    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:05.967645 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:05.967610    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:06.067812 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:06.067773    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:06.291538 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:06.291445    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:06.960929 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:06.960900    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:08.107474 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.107435    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:08.181353 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.181305    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn" podUID="3509f8f9-4eca-4fe2-9702-652f14a81e54" containerName="main" containerID="cri-o://b931d9488fbc146cf9f4593ac94b7d91a60e7b10932a060ff318e32ed208ea19" gracePeriod=45
Sep 19 04:48:08.428788 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.428743    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:48:08.523294 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.523259    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-tmp-dir\") pod \"3509f8f9-4eca-4fe2-9702-652f14a81e54\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") "
Sep 19 04:48:08.523462 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.523361    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3509f8f9-4eca-4fe2-9702-652f14a81e54-tls-certs\") pod \"3509f8f9-4eca-4fe2-9702-652f14a81e54\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") "
Sep 19 04:48:08.523462 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.523447    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-home\") pod \"3509f8f9-4eca-4fe2-9702-652f14a81e54\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") "
Sep 19 04:48:08.523565 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.523494    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chp4l\" (UniqueName: \"kubernetes.io/projected/3509f8f9-4eca-4fe2-9702-652f14a81e54-kube-api-access-chp4l\") pod \"3509f8f9-4eca-4fe2-9702-652f14a81e54\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") "
Sep 19 04:48:08.523565 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.523512    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3509f8f9-4eca-4fe2-9702-652f14a81e54" (UID: "3509f8f9-4eca-4fe2-9702-652f14a81e54"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:48:08.523565 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.523529    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-model-cache\") pod \"3509f8f9-4eca-4fe2-9702-652f14a81e54\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") "
Sep 19 04:48:08.523715 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.523580    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-dshm\") pod \"3509f8f9-4eca-4fe2-9702-652f14a81e54\" (UID: \"3509f8f9-4eca-4fe2-9702-652f14a81e54\") "
Sep 19 04:48:08.523715 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.523690    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-home" (OuterVolumeSpecName: "home") pod "3509f8f9-4eca-4fe2-9702-652f14a81e54" (UID: "3509f8f9-4eca-4fe2-9702-652f14a81e54"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:48:08.523924 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.523900    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-model-cache" (OuterVolumeSpecName: "model-cache") pod "3509f8f9-4eca-4fe2-9702-652f14a81e54" (UID: "3509f8f9-4eca-4fe2-9702-652f14a81e54"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:48:08.524051 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.524029    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-tmp-dir\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:48:08.524124 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.524055    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-home\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:48:08.524124 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.524072    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-model-cache\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:48:08.526315 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.526211    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-dshm" (OuterVolumeSpecName: "dshm") pod "3509f8f9-4eca-4fe2-9702-652f14a81e54" (UID: "3509f8f9-4eca-4fe2-9702-652f14a81e54"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:48:08.526315 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.526223    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3509f8f9-4eca-4fe2-9702-652f14a81e54-kube-api-access-chp4l" (OuterVolumeSpecName: "kube-api-access-chp4l") pod "3509f8f9-4eca-4fe2-9702-652f14a81e54" (UID: "3509f8f9-4eca-4fe2-9702-652f14a81e54"). InnerVolumeSpecName "kube-api-access-chp4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:48:08.526834 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.526809    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3509f8f9-4eca-4fe2-9702-652f14a81e54-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3509f8f9-4eca-4fe2-9702-652f14a81e54" (UID: "3509f8f9-4eca-4fe2-9702-652f14a81e54"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:48:08.625416 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.625384    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3509f8f9-4eca-4fe2-9702-652f14a81e54-dshm\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:48:08.625416 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.625414    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3509f8f9-4eca-4fe2-9702-652f14a81e54-tls-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:48:08.625416 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:08.625425    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chp4l\" (UniqueName: \"kubernetes.io/projected/3509f8f9-4eca-4fe2-9702-652f14a81e54-kube-api-access-chp4l\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:48:09.065272 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:09.065238    2569 generic.go:356] "Generic (PLEG): container finished" podID="3509f8f9-4eca-4fe2-9702-652f14a81e54" containerID="b931d9488fbc146cf9f4593ac94b7d91a60e7b10932a060ff318e32ed208ea19" exitCode=0
Sep 19 04:48:09.065451 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:09.065284    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"
Sep 19 04:48:09.065451 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:09.065316    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn" event={"ID":"3509f8f9-4eca-4fe2-9702-652f14a81e54","Type":"ContainerDied","Data":"b931d9488fbc146cf9f4593ac94b7d91a60e7b10932a060ff318e32ed208ea19"}
Sep 19 04:48:09.065451 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:09.065365    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn" event={"ID":"3509f8f9-4eca-4fe2-9702-652f14a81e54","Type":"ContainerDied","Data":"e3887702b8fbc011e1bc2458aaa1d63e2b8e1a72eda79698f86578d863617095"}
Sep 19 04:48:09.065451 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:09.065391    2569 scope.go:117] "RemoveContainer" containerID="b931d9488fbc146cf9f4593ac94b7d91a60e7b10932a060ff318e32ed208ea19"
Sep 19 04:48:09.074788 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:09.074740    2569 scope.go:117] "RemoveContainer" containerID="b931d9488fbc146cf9f4593ac94b7d91a60e7b10932a060ff318e32ed208ea19"
Sep 19 04:48:09.075080 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:48:09.075059    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b931d9488fbc146cf9f4593ac94b7d91a60e7b10932a060ff318e32ed208ea19\": container with ID starting with b931d9488fbc146cf9f4593ac94b7d91a60e7b10932a060ff318e32ed208ea19 not found: ID does not exist" containerID="b931d9488fbc146cf9f4593ac94b7d91a60e7b10932a060ff318e32ed208ea19"
Sep 19 04:48:09.075142 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:09.075089    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b931d9488fbc146cf9f4593ac94b7d91a60e7b10932a060ff318e32ed208ea19"} err="failed to get container status \"b931d9488fbc146cf9f4593ac94b7d91a60e7b10932a060ff318e32ed208ea19\": rpc error: code = NotFound desc = could not find container \"b931d9488fbc146cf9f4593ac94b7d91a60e7b10932a060ff318e32ed208ea19\": container with ID starting with b931d9488fbc146cf9f4593ac94b7d91a60e7b10932a060ff318e32ed208ea19 not found: ID does not exist"
Sep 19 04:48:09.085187 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:09.085160    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"]
Sep 19 04:48:09.090493 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:09.090469    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-87e3e6/simulator-w0-87e3e6-kserve-7c97df6bd4-26nvn"]
Sep 19 04:48:09.120325 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:09.120298    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:10.035188 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:10.035154    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:10.538969 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:10.538937    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3509f8f9-4eca-4fe2-9702-652f14a81e54" path="/var/lib/kubelet/pods/3509f8f9-4eca-4fe2-9702-652f14a81e54/volumes"
Sep 19 04:48:10.682152 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:10.682120    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:10.782735 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:10.782697    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:10.970153 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:10.970121    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:11.129918 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:11.129882    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:12.124381 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:12.124343    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:16.756799 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:16.756762    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:17.442372 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.442339    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:17.490168 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.490124    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"]
Sep 19 04:48:17.490408 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.490377    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n" podUID="2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51" containerName="payload-processing" containerID="cri-o://0eee6c1cc108b20f015c25950b08d680a225d1417fb92a0c23a1041e00a08431" gracePeriod=30
Sep 19 04:48:17.519077 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.519043    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"]
Sep 19 04:48:17.519331 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.519285    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl" podUID="88109ad6-7267-4412-b1d9-8ecc03c47698" containerName="payload-pre-processing" containerID="cri-o://cbf430fa9d70b18035f3ae0fbc869f50c8a3fec97ff8a90b60168bf3099c0e9b" gracePeriod=30
Sep 19 04:48:17.537869 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.537833    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:17.609647 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.609614    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:17.684679 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.684616    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:17.760565 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.760528    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:17.810280 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.810258    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"
Sep 19 04:48:17.813111 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.813093    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"
Sep 19 04:48:17.919061 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.919031    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnhkg\" (UniqueName: \"kubernetes.io/projected/2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51-kube-api-access-hnhkg\") pod \"2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51\" (UID: \"2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51\") "
Sep 19 04:48:17.919061 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.919065    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw6qg\" (UniqueName: \"kubernetes.io/projected/88109ad6-7267-4412-b1d9-8ecc03c47698-kube-api-access-jw6qg\") pod \"88109ad6-7267-4412-b1d9-8ecc03c47698\" (UID: \"88109ad6-7267-4412-b1d9-8ecc03c47698\") "
Sep 19 04:48:17.919271 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.919087    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88109ad6-7267-4412-b1d9-8ecc03c47698-plugins-config-volume\") pod \"88109ad6-7267-4412-b1d9-8ecc03c47698\" (UID: \"88109ad6-7267-4412-b1d9-8ecc03c47698\") "
Sep 19 04:48:17.919271 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.919138    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51-plugins-config-volume\") pod \"2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51\" (UID: \"2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51\") "
Sep 19 04:48:17.919503 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.919479    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88109ad6-7267-4412-b1d9-8ecc03c47698-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "88109ad6-7267-4412-b1d9-8ecc03c47698" (UID: "88109ad6-7267-4412-b1d9-8ecc03c47698"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:48:17.919579 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.919507    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51" (UID: "2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:48:17.921523 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.921502    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88109ad6-7267-4412-b1d9-8ecc03c47698-kube-api-access-jw6qg" (OuterVolumeSpecName: "kube-api-access-jw6qg") pod "88109ad6-7267-4412-b1d9-8ecc03c47698" (UID: "88109ad6-7267-4412-b1d9-8ecc03c47698"). InnerVolumeSpecName "kube-api-access-jw6qg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:48:17.921637 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:17.921530    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51-kube-api-access-hnhkg" (OuterVolumeSpecName: "kube-api-access-hnhkg") pod "2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51" (UID: "2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51"). InnerVolumeSpecName "kube-api-access-hnhkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:48:18.020126 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.020044    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:48:18.020126 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.020072    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnhkg\" (UniqueName: \"kubernetes.io/projected/2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51-kube-api-access-hnhkg\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:48:18.020126 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.020081    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw6qg\" (UniqueName: \"kubernetes.io/projected/88109ad6-7267-4412-b1d9-8ecc03c47698-kube-api-access-jw6qg\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:48:18.020126 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.020090    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88109ad6-7267-4412-b1d9-8ecc03c47698-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:48:18.039764 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.039720    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:18.113197 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.113163    2569 generic.go:356] "Generic (PLEG): container finished" podID="88109ad6-7267-4412-b1d9-8ecc03c47698" containerID="cbf430fa9d70b18035f3ae0fbc869f50c8a3fec97ff8a90b60168bf3099c0e9b" exitCode=0
Sep 19 04:48:18.113377 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.113211    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"
Sep 19 04:48:18.113377 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.113252    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl" event={"ID":"88109ad6-7267-4412-b1d9-8ecc03c47698","Type":"ContainerDied","Data":"cbf430fa9d70b18035f3ae0fbc869f50c8a3fec97ff8a90b60168bf3099c0e9b"}
Sep 19 04:48:18.113377 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.113313    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl" event={"ID":"88109ad6-7267-4412-b1d9-8ecc03c47698","Type":"ContainerDied","Data":"dd93ca0da83913a269d6acd6ed6e2b9126ad0d243fdba67515781baab4f59fc5"}
Sep 19 04:48:18.113377 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.113345    2569 scope.go:117] "RemoveContainer" containerID="cbf430fa9d70b18035f3ae0fbc869f50c8a3fec97ff8a90b60168bf3099c0e9b"
Sep 19 04:48:18.114670 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.114645    2569 generic.go:356] "Generic (PLEG): container finished" podID="2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51" containerID="0eee6c1cc108b20f015c25950b08d680a225d1417fb92a0c23a1041e00a08431" exitCode=0
Sep 19 04:48:18.114815 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.114683    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"
Sep 19 04:48:18.114815 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.114681    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n" event={"ID":"2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51","Type":"ContainerDied","Data":"0eee6c1cc108b20f015c25950b08d680a225d1417fb92a0c23a1041e00a08431"}
Sep 19 04:48:18.114925 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.114815    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n" event={"ID":"2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51","Type":"ContainerDied","Data":"be7fb297ac9978bef882d4662b76dfdcf3918b8ef43f7aaa01060e658b4dc90d"}
Sep 19 04:48:18.124051 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.123956    2569 scope.go:117] "RemoveContainer" containerID="cbf430fa9d70b18035f3ae0fbc869f50c8a3fec97ff8a90b60168bf3099c0e9b"
Sep 19 04:48:18.124301 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:48:18.124269    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbf430fa9d70b18035f3ae0fbc869f50c8a3fec97ff8a90b60168bf3099c0e9b\": container with ID starting with cbf430fa9d70b18035f3ae0fbc869f50c8a3fec97ff8a90b60168bf3099c0e9b not found: ID does not exist" containerID="cbf430fa9d70b18035f3ae0fbc869f50c8a3fec97ff8a90b60168bf3099c0e9b"
Sep 19 04:48:18.124401 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.124308    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbf430fa9d70b18035f3ae0fbc869f50c8a3fec97ff8a90b60168bf3099c0e9b"} err="failed to get container status \"cbf430fa9d70b18035f3ae0fbc869f50c8a3fec97ff8a90b60168bf3099c0e9b\": rpc error: code = NotFound desc = could not find container \"cbf430fa9d70b18035f3ae0fbc869f50c8a3fec97ff8a90b60168bf3099c0e9b\": container with ID starting with cbf430fa9d70b18035f3ae0fbc869f50c8a3fec97ff8a90b60168bf3099c0e9b not found: ID does not exist"
Sep 19 04:48:18.124401 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.124332    2569 scope.go:117] "RemoveContainer" containerID="0eee6c1cc108b20f015c25950b08d680a225d1417fb92a0c23a1041e00a08431"
Sep 19 04:48:18.132648 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.132633    2569 scope.go:117] "RemoveContainer" containerID="0eee6c1cc108b20f015c25950b08d680a225d1417fb92a0c23a1041e00a08431"
Sep 19 04:48:18.132925 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:48:18.132906    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eee6c1cc108b20f015c25950b08d680a225d1417fb92a0c23a1041e00a08431\": container with ID starting with 0eee6c1cc108b20f015c25950b08d680a225d1417fb92a0c23a1041e00a08431 not found: ID does not exist" containerID="0eee6c1cc108b20f015c25950b08d680a225d1417fb92a0c23a1041e00a08431"
Sep 19 04:48:18.132995 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.132933    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eee6c1cc108b20f015c25950b08d680a225d1417fb92a0c23a1041e00a08431"} err="failed to get container status \"0eee6c1cc108b20f015c25950b08d680a225d1417fb92a0c23a1041e00a08431\": rpc error: code = NotFound desc = could not find container \"0eee6c1cc108b20f015c25950b08d680a225d1417fb92a0c23a1041e00a08431\": container with ID starting with 0eee6c1cc108b20f015c25950b08d680a225d1417fb92a0c23a1041e00a08431 not found: ID does not exist"
Sep 19 04:48:18.139329 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.139306    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"]
Sep 19 04:48:18.143104 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.143082    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-eac6c5-57f8f98bcd-wmbdl"]
Sep 19 04:48:18.156794 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.156771    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"]
Sep 19 04:48:18.161100 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.161081    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-eac6c5-6b98888c65-t4j4n"]
Sep 19 04:48:18.203708 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.203680    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:18.538917 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.538886    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51" path="/var/lib/kubelet/pods/2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51/volumes"
Sep 19 04:48:18.539276 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.539263    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88109ad6-7267-4412-b1d9-8ecc03c47698" path="/var/lib/kubelet/pods/88109ad6-7267-4412-b1d9-8ecc03c47698/volumes"
Sep 19 04:48:18.952382 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:18.952348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:19.891018 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:19.890983    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:21.863997 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:21.863965    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:21.951487 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:21.951453    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:24.522197 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:24.522158    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:24.622814 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:24.622775    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:24.834336 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:24.834246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:30.914874 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:30.914807    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:31.011901 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:31.011861    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:31.313614 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:31.313519    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:37.669004 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:37.668971    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:45.465996 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:45.465960    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:56.426289 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:56.426251    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:48:56.498984 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:48:56.498951    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:49:14.707926 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:14.707888    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:49:16.732675 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:16.732631    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"]
Sep 19 04:49:16.795638 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:16.795604    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:49:28.790562 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:28.790507    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:49:31.752387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:31.752285    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z" podUID="347ebb0c-36f2-4e94-b785-703f757224d9" containerName="main" containerID="cri-o://663b863c82c9933c4ea697fa0a34af139d01b292c42e31c758f7f0f87844195b" gracePeriod=45
Sep 19 04:49:32.012522 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.012461    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:49:32.104108 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.104065    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mgqm\" (UniqueName: \"kubernetes.io/projected/347ebb0c-36f2-4e94-b785-703f757224d9-kube-api-access-8mgqm\") pod \"347ebb0c-36f2-4e94-b785-703f757224d9\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") "
Sep 19 04:49:32.104304 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.104163    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-dshm\") pod \"347ebb0c-36f2-4e94-b785-703f757224d9\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") "
Sep 19 04:49:32.104304 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.104190    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-tmp-dir\") pod \"347ebb0c-36f2-4e94-b785-703f757224d9\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") "
Sep 19 04:49:32.104304 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.104249    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-model-cache\") pod \"347ebb0c-36f2-4e94-b785-703f757224d9\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") "
Sep 19 04:49:32.104304 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.104296    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-home\") pod \"347ebb0c-36f2-4e94-b785-703f757224d9\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") "
Sep 19 04:49:32.104520 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.104321    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/347ebb0c-36f2-4e94-b785-703f757224d9-tls-certs\") pod \"347ebb0c-36f2-4e94-b785-703f757224d9\" (UID: \"347ebb0c-36f2-4e94-b785-703f757224d9\") "
Sep 19 04:49:32.104520 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.104474    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "347ebb0c-36f2-4e94-b785-703f757224d9" (UID: "347ebb0c-36f2-4e94-b785-703f757224d9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:49:32.104614 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.104554    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-model-cache" (OuterVolumeSpecName: "model-cache") pod "347ebb0c-36f2-4e94-b785-703f757224d9" (UID: "347ebb0c-36f2-4e94-b785-703f757224d9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:49:32.104614 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.104567    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-home" (OuterVolumeSpecName: "home") pod "347ebb0c-36f2-4e94-b785-703f757224d9" (UID: "347ebb0c-36f2-4e94-b785-703f757224d9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:49:32.104698 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.104669    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-tmp-dir\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:49:32.104698 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.104689    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-model-cache\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:49:32.104843 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.104702    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-home\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:49:32.106533 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.106507    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-dshm" (OuterVolumeSpecName: "dshm") pod "347ebb0c-36f2-4e94-b785-703f757224d9" (UID: "347ebb0c-36f2-4e94-b785-703f757224d9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:49:32.106611 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.106589    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/347ebb0c-36f2-4e94-b785-703f757224d9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "347ebb0c-36f2-4e94-b785-703f757224d9" (UID: "347ebb0c-36f2-4e94-b785-703f757224d9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:49:32.106658 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.106646    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/347ebb0c-36f2-4e94-b785-703f757224d9-kube-api-access-8mgqm" (OuterVolumeSpecName: "kube-api-access-8mgqm") pod "347ebb0c-36f2-4e94-b785-703f757224d9" (UID: "347ebb0c-36f2-4e94-b785-703f757224d9"). InnerVolumeSpecName "kube-api-access-8mgqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:49:32.206131 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.206091    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/347ebb0c-36f2-4e94-b785-703f757224d9-dshm\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:49:32.206131 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.206124    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/347ebb0c-36f2-4e94-b785-703f757224d9-tls-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:49:32.206131 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.206139    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mgqm\" (UniqueName: \"kubernetes.io/projected/347ebb0c-36f2-4e94-b785-703f757224d9-kube-api-access-8mgqm\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:49:32.495441 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.495398    2569 generic.go:356] "Generic (PLEG): container finished" podID="347ebb0c-36f2-4e94-b785-703f757224d9" containerID="663b863c82c9933c4ea697fa0a34af139d01b292c42e31c758f7f0f87844195b" exitCode=0
Sep 19 04:49:32.495441 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.495446    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"
Sep 19 04:49:32.495663 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.495469    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z" event={"ID":"347ebb0c-36f2-4e94-b785-703f757224d9","Type":"ContainerDied","Data":"663b863c82c9933c4ea697fa0a34af139d01b292c42e31c758f7f0f87844195b"}
Sep 19 04:49:32.495663 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.495510    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z" event={"ID":"347ebb0c-36f2-4e94-b785-703f757224d9","Type":"ContainerDied","Data":"d2e178457d880c8427dbf5f5148ceaee2a0ab3217a6fa5517a066a0498cadc1d"}
Sep 19 04:49:32.495663 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.495532    2569 scope.go:117] "RemoveContainer" containerID="663b863c82c9933c4ea697fa0a34af139d01b292c42e31c758f7f0f87844195b"
Sep 19 04:49:32.504616 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.504596    2569 scope.go:117] "RemoveContainer" containerID="663b863c82c9933c4ea697fa0a34af139d01b292c42e31c758f7f0f87844195b"
Sep 19 04:49:32.504917 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:49:32.504896    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"663b863c82c9933c4ea697fa0a34af139d01b292c42e31c758f7f0f87844195b\": container with ID starting with 663b863c82c9933c4ea697fa0a34af139d01b292c42e31c758f7f0f87844195b not found: ID does not exist" containerID="663b863c82c9933c4ea697fa0a34af139d01b292c42e31c758f7f0f87844195b"
Sep 19 04:49:32.504981 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.504925    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663b863c82c9933c4ea697fa0a34af139d01b292c42e31c758f7f0f87844195b"} err="failed to get container status \"663b863c82c9933c4ea697fa0a34af139d01b292c42e31c758f7f0f87844195b\": rpc error: code = NotFound desc = could not find container \"663b863c82c9933c4ea697fa0a34af139d01b292c42e31c758f7f0f87844195b\": container with ID starting with 663b863c82c9933c4ea697fa0a34af139d01b292c42e31c758f7f0f87844195b not found: ID does not exist"
Sep 19 04:49:32.520558 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.520528    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"]
Sep 19 04:49:32.527357 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.527328    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z"]
Sep 19 04:49:32.538557 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.538524    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="347ebb0c-36f2-4e94-b785-703f757224d9" path="/var/lib/kubelet/pods/347ebb0c-36f2-4e94-b785-703f757224d9/volumes"
Sep 19 04:49:32.922835 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:32.922794    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-b-w3-8bbcca/auth-test-model-8bbcca-kserve-7bdbcc8ccb-w292z" podUID="347ebb0c-36f2-4e94-b785-703f757224d9" containerName="main" probeResult="failure" output="Get \"https://10.133.0.65:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 19 04:49:54.677093 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:49:54.677058    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:50:32.318560 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:32.318514    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:50:33.984726 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:33.984691    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:50:34.514783 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.514732    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-10379-d2a830"]
Sep 19 04:50:34.515150 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515137    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc30208-fb02-4fdd-8484-0dbac4b1d070" containerName="maas-api"
Sep 19 04:50:34.515195 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515153    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc30208-fb02-4fdd-8484-0dbac4b1d070" containerName="maas-api"
Sep 19 04:50:34.515195 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515162    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerName="istio-proxy"
Sep 19 04:50:34.515195 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515167    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerName="istio-proxy"
Sep 19 04:50:34.515195 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515177    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd1c6206-c249-4e44-8c2f-4039e46820b1" containerName="payload-processing"
Sep 19 04:50:34.515195 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515186    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd1c6206-c249-4e44-8c2f-4039e46820b1" containerName="payload-processing"
Sep 19 04:50:34.515195 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515196    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="347ebb0c-36f2-4e94-b785-703f757224d9" containerName="main"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515203    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="347ebb0c-36f2-4e94-b785-703f757224d9" containerName="main"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515211    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3995358b-3998-4080-8e63-b89e3c68a291" containerName="payload-pre-processing"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515216    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3995358b-3998-4080-8e63-b89e3c68a291" containerName="payload-pre-processing"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515230    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerName="istio-proxy"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515236    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerName="istio-proxy"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515243    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3509f8f9-4eca-4fe2-9702-652f14a81e54" containerName="main"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515247    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3509f8f9-4eca-4fe2-9702-652f14a81e54" containerName="main"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515254    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88109ad6-7267-4412-b1d9-8ecc03c47698" containerName="payload-pre-processing"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515259    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="88109ad6-7267-4412-b1d9-8ecc03c47698" containerName="payload-pre-processing"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515268    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51" containerName="payload-processing"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515277    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51" containerName="payload-processing"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515286    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="404ea878-1219-4f58-9d7f-1d5c7bdfe45b" containerName="maas-api"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515291    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="404ea878-1219-4f58-9d7f-1d5c7bdfe45b" containerName="maas-api"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515362    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3509f8f9-4eca-4fe2-9702-652f14a81e54" containerName="main"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515370    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="347ebb0c-36f2-4e94-b785-703f757224d9" containerName="main"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515376    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="88109ad6-7267-4412-b1d9-8ecc03c47698" containerName="payload-pre-processing"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515383    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbc30208-fb02-4fdd-8484-0dbac4b1d070" containerName="maas-api"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515388    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="404ea878-1219-4f58-9d7f-1d5c7bdfe45b" containerName="maas-api"
Sep 19 04:50:34.515387 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515394    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3995358b-3998-4080-8e63-b89e3c68a291" containerName="payload-pre-processing"
Sep 19 04:50:34.515982 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515400    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd1c6206-c249-4e44-8c2f-4039e46820b1" containerName="payload-processing"
Sep 19 04:50:34.515982 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515407    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerName="istio-proxy"
Sep 19 04:50:34.515982 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515412    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2265c6c7-2d93-40c6-a60e-f8fa5ae5ea51" containerName="payload-processing"
Sep 19 04:50:34.515982 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.515418    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1ec5051-353b-495d-919e-b1b594c54c8b" containerName="istio-proxy"
Sep 19 04:50:34.518810 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.518792    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10379-d2a830"
Sep 19 04:50:34.521641 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.521620    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6vmt9\""
Sep 19 04:50:34.526664 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.526172    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-10379-d2a830"]
Sep 19 04:50:34.598310 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.598271    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdrp7\" (UniqueName: \"kubernetes.io/projected/1b66395d-2c9d-41d3-bff8-f27b5164ae67-kube-api-access-cdrp7\") pod \"test-curl-10379-d2a830\" (UID: \"1b66395d-2c9d-41d3-bff8-f27b5164ae67\") " pod="opendatahub/test-curl-10379-d2a830"
Sep 19 04:50:34.699172 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.699134    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdrp7\" (UniqueName: \"kubernetes.io/projected/1b66395d-2c9d-41d3-bff8-f27b5164ae67-kube-api-access-cdrp7\") pod \"test-curl-10379-d2a830\" (UID: \"1b66395d-2c9d-41d3-bff8-f27b5164ae67\") " pod="opendatahub/test-curl-10379-d2a830"
Sep 19 04:50:34.710112 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.710077    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdrp7\" (UniqueName: \"kubernetes.io/projected/1b66395d-2c9d-41d3-bff8-f27b5164ae67-kube-api-access-cdrp7\") pod \"test-curl-10379-d2a830\" (UID: \"1b66395d-2c9d-41d3-bff8-f27b5164ae67\") " pod="opendatahub/test-curl-10379-d2a830"
Sep 19 04:50:34.830210 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:34.830126    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10379-d2a830"
Sep 19 04:50:35.109407 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:50:35.109379    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b66395d_2c9d_41d3_bff8_f27b5164ae67.slice/crio-16a608cb9a13573b5c12306bef4f79ba34aa5cbf9cb57d716c0bff95db9c1e46 WatchSource:0}: Error finding container 16a608cb9a13573b5c12306bef4f79ba34aa5cbf9cb57d716c0bff95db9c1e46: Status 404 returned error can't find the container with id 16a608cb9a13573b5c12306bef4f79ba34aa5cbf9cb57d716c0bff95db9c1e46
Sep 19 04:50:35.109788 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:35.109598    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-10379-d2a830"]
Sep 19 04:50:35.819439 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:35.819407    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-10379-d2a830" event={"ID":"1b66395d-2c9d-41d3-bff8-f27b5164ae67","Type":"ContainerStarted","Data":"e59807ea11fcc057a076f639eb4514c7b6b9779a0797e3638e4222266723dcad"}
Sep 19 04:50:35.819439 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:35.819447    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-10379-d2a830" event={"ID":"1b66395d-2c9d-41d3-bff8-f27b5164ae67","Type":"ContainerStarted","Data":"16a608cb9a13573b5c12306bef4f79ba34aa5cbf9cb57d716c0bff95db9c1e46"}
Sep 19 04:50:36.451342 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:36.451286    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-10379-d2a830" podStartSLOduration=2.451266179 podStartE2EDuration="2.451266179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:50:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:50:35.842267946 +0000 UTC m=+2215.820464336" watchObservedRunningTime="2026-09-19 04:50:36.451266179 +0000 UTC m=+2216.429462574"
Sep 19 04:50:36.452288 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:36.452265    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-10379-d2a830"]
Sep 19 04:50:36.458949 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:36.458821    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-10379-d2a830"]
Sep 19 04:50:36.824001 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:50:36.823964    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-10379-d2a830" container="test-curl-10379-d2a830"
Sep 19 04:50:37.828513 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:37.828467    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-10379-d2a830" podUID="1b66395d-2c9d-41d3-bff8-f27b5164ae67" containerName="test-curl-10379-d2a830" containerID="cri-o://e59807ea11fcc057a076f639eb4514c7b6b9779a0797e3638e4222266723dcad" gracePeriod=2
Sep 19 04:50:39.980083 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:39.980060    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10379-d2a830"
Sep 19 04:50:40.148739 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:40.148704    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdrp7\" (UniqueName: \"kubernetes.io/projected/1b66395d-2c9d-41d3-bff8-f27b5164ae67-kube-api-access-cdrp7\") pod \"1b66395d-2c9d-41d3-bff8-f27b5164ae67\" (UID: \"1b66395d-2c9d-41d3-bff8-f27b5164ae67\") "
Sep 19 04:50:40.150992 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:40.150959    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b66395d-2c9d-41d3-bff8-f27b5164ae67-kube-api-access-cdrp7" (OuterVolumeSpecName: "kube-api-access-cdrp7") pod "1b66395d-2c9d-41d3-bff8-f27b5164ae67" (UID: "1b66395d-2c9d-41d3-bff8-f27b5164ae67"). InnerVolumeSpecName "kube-api-access-cdrp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:50:40.249949 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:40.249911    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdrp7\" (UniqueName: \"kubernetes.io/projected/1b66395d-2c9d-41d3-bff8-f27b5164ae67-kube-api-access-cdrp7\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:50:40.538932 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:40.538856    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b66395d-2c9d-41d3-bff8-f27b5164ae67" path="/var/lib/kubelet/pods/1b66395d-2c9d-41d3-bff8-f27b5164ae67/volumes"
Sep 19 04:50:40.848358 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:40.848261    2569 generic.go:356] "Generic (PLEG): container finished" podID="1b66395d-2c9d-41d3-bff8-f27b5164ae67" containerID="e59807ea11fcc057a076f639eb4514c7b6b9779a0797e3638e4222266723dcad" exitCode=137
Sep 19 04:50:40.848358 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:40.848317    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-10379-d2a830"
Sep 19 04:50:40.848599 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:40.848372    2569 scope.go:117] "RemoveContainer" containerID="e59807ea11fcc057a076f639eb4514c7b6b9779a0797e3638e4222266723dcad"
Sep 19 04:50:40.856688 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:40.856671    2569 scope.go:117] "RemoveContainer" containerID="e59807ea11fcc057a076f639eb4514c7b6b9779a0797e3638e4222266723dcad"
Sep 19 04:50:40.856959 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:50:40.856938    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e59807ea11fcc057a076f639eb4514c7b6b9779a0797e3638e4222266723dcad\": container with ID starting with e59807ea11fcc057a076f639eb4514c7b6b9779a0797e3638e4222266723dcad not found: ID does not exist" containerID="e59807ea11fcc057a076f639eb4514c7b6b9779a0797e3638e4222266723dcad"
Sep 19 04:50:40.857035 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:40.856968    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e59807ea11fcc057a076f639eb4514c7b6b9779a0797e3638e4222266723dcad"} err="failed to get container status \"e59807ea11fcc057a076f639eb4514c7b6b9779a0797e3638e4222266723dcad\": rpc error: code = NotFound desc = could not find container \"e59807ea11fcc057a076f639eb4514c7b6b9779a0797e3638e4222266723dcad\": container with ID starting with e59807ea11fcc057a076f639eb4514c7b6b9779a0797e3638e4222266723dcad not found: ID does not exist"
Sep 19 04:50:41.101696 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:41.101602    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:50:43.229946 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:43.229907    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:50:53.549847 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:50:53.549805    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:51:09.934168 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:51:09.934041    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:51:33.235864 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:51:33.235814    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:51:53.574069 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:51:53.574037    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:20.018504 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:20.018463    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:21.555359 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:21.555324    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:23.169891 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:23.169850    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:23.587895 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:23.587810    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:23.927516 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:23.927485    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:24.206171 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:24.206074    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:26.580327 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:26.580285    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:26.894584 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:26.894532    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:26.991945 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:26.991911    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:27.578837 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:27.578805    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:28.669152 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.669119    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"]
Sep 19 04:52:28.669621 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.669500    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b66395d-2c9d-41d3-bff8-f27b5164ae67" containerName="test-curl-10379-d2a830"
Sep 19 04:52:28.669621 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.669512    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b66395d-2c9d-41d3-bff8-f27b5164ae67" containerName="test-curl-10379-d2a830"
Sep 19 04:52:28.669621 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.669590    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b66395d-2c9d-41d3-bff8-f27b5164ae67" containerName="test-curl-10379-d2a830"
Sep 19 04:52:28.672786 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.672765    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:28.675436 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.675411    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-cacd12-serving-cert\""
Sep 19 04:52:28.683988 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.683963    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"]
Sep 19 04:52:28.712886 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.712850    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:28.742960 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.742924    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-metrics-certs\") pod \"maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:28.743148 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.743016    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4grsr\" (UniqueName: \"kubernetes.io/projected/1ab80788-d0fc-4a29-9221-2dbbe09cad92-kube-api-access-4grsr\") pod \"maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:28.743148 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.743060    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-maas-api-tls\") pod \"maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:28.743148 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.743092    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ab80788-d0fc-4a29-9221-2dbbe09cad92-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:28.797532 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.797487    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:28.843863 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.843823    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4grsr\" (UniqueName: \"kubernetes.io/projected/1ab80788-d0fc-4a29-9221-2dbbe09cad92-kube-api-access-4grsr\") pod \"maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:28.844068 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.843891    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-maas-api-tls\") pod \"maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:28.844068 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.843940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ab80788-d0fc-4a29-9221-2dbbe09cad92-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:28.844068 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.843978    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-metrics-certs\") pod \"maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:28.844279 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:52:28.844154    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-serving-cert: secret "maas-api-e2e-ipp-a-cacd12-serving-cert" not found
Sep 19 04:52:28.844279 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:52:28.844222    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-maas-api-tls podName:1ab80788-d0fc-4a29-9221-2dbbe09cad92 nodeName:}" failed. No retries permitted until 2026-09-19 04:52:29.344200711 +0000 UTC m=+2329.322397081 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-maas-api-tls") pod "maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5" (UID: "1ab80788-d0fc-4a29-9221-2dbbe09cad92") : secret "maas-api-e2e-ipp-a-cacd12-serving-cert" not found
Sep 19 04:52:28.844850 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.844829    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ab80788-d0fc-4a29-9221-2dbbe09cad92-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:28.846591 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.846567    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-metrics-certs\") pod \"maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:28.855806 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.855784    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4grsr\" (UniqueName: \"kubernetes.io/projected/1ab80788-d0fc-4a29-9221-2dbbe09cad92-kube-api-access-4grsr\") pod \"maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:28.901392 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:28.901365    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:29.348406 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.348370    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-maas-api-tls\") pod \"maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:29.350943 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.350923    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-maas-api-tls\") pod \"maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:29.358179 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.358151    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:29.460681 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.460637    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:29.586582 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.586551    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:29.652618 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.652590    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"]
Sep 19 04:52:29.657509 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.657053    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"
Sep 19 04:52:29.660495 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.660472    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-cacd12\""
Sep 19 04:52:29.660795 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.660778    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-cacd12-dockercfg-l5pc2\""
Sep 19 04:52:29.667935 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.667868    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"]
Sep 19 04:52:29.753107 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.753066    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1298451-7498-4914-8033-983877899c0d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw\" (UID: \"b1298451-7498-4914-8033-983877899c0d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"
Sep 19 04:52:29.753510 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.753134    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9c6c\" (UniqueName: \"kubernetes.io/projected/b1298451-7498-4914-8033-983877899c0d-kube-api-access-l9c6c\") pod \"payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw\" (UID: \"b1298451-7498-4914-8033-983877899c0d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"
Sep 19 04:52:29.854579 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.854542    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9c6c\" (UniqueName: \"kubernetes.io/projected/b1298451-7498-4914-8033-983877899c0d-kube-api-access-l9c6c\") pod \"payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw\" (UID: \"b1298451-7498-4914-8033-983877899c0d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"
Sep 19 04:52:29.854777 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.854655    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1298451-7498-4914-8033-983877899c0d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw\" (UID: \"b1298451-7498-4914-8033-983877899c0d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"
Sep 19 04:52:29.855350 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.855332    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1298451-7498-4914-8033-983877899c0d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw\" (UID: \"b1298451-7498-4914-8033-983877899c0d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"
Sep 19 04:52:29.864700 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.864666    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9c6c\" (UniqueName: \"kubernetes.io/projected/b1298451-7498-4914-8033-983877899c0d-kube-api-access-l9c6c\") pod \"payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw\" (UID: \"b1298451-7498-4914-8033-983877899c0d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"
Sep 19 04:52:29.867118 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.867070    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"]
Sep 19 04:52:29.869493 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:52:29.869463    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ab80788_d0fc_4a29_9221_2dbbe09cad92.slice/crio-0f6907abc1631379fd1a87e57b557738e8a23bc44f82071e7909b45fa98b10a8 WatchSource:0}: Error finding container 0f6907abc1631379fd1a87e57b557738e8a23bc44f82071e7909b45fa98b10a8: Status 404 returned error can't find the container with id 0f6907abc1631379fd1a87e57b557738e8a23bc44f82071e7909b45fa98b10a8
Sep 19 04:52:29.870902 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.870883    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 04:52:29.974425 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:29.974338    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"
Sep 19 04:52:30.249813 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:30.249784    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"]
Sep 19 04:52:30.251695 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:52:30.251671    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1298451_7498_4914_8033_983877899c0d.slice/crio-8973827e8925c11041cc8cfaf089283139a4952963bb505fbd3dc615affcc6fa WatchSource:0}: Error finding container 8973827e8925c11041cc8cfaf089283139a4952963bb505fbd3dc615affcc6fa: Status 404 returned error can't find the container with id 8973827e8925c11041cc8cfaf089283139a4952963bb505fbd3dc615affcc6fa
Sep 19 04:52:30.403179 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:30.403138    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw" event={"ID":"b1298451-7498-4914-8033-983877899c0d","Type":"ContainerStarted","Data":"0cebdca48d6f3a1a745ad840be0dceea660027d64c7cc642b7b2a343502c0efa"}
Sep 19 04:52:30.403394 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:30.403205    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"
Sep 19 04:52:30.403394 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:30.403223    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw" event={"ID":"b1298451-7498-4914-8033-983877899c0d","Type":"ContainerStarted","Data":"8973827e8925c11041cc8cfaf089283139a4952963bb505fbd3dc615affcc6fa"}
Sep 19 04:52:30.404831 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:30.404802    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5" event={"ID":"1ab80788-d0fc-4a29-9221-2dbbe09cad92","Type":"ContainerStarted","Data":"1ed16802e55cbcaaa77458ce25c6b7c909e6256424f2a4dca0a5e65c1be54fc6"}
Sep 19 04:52:30.404954 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:30.404843    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5" event={"ID":"1ab80788-d0fc-4a29-9221-2dbbe09cad92","Type":"ContainerStarted","Data":"0f6907abc1631379fd1a87e57b557738e8a23bc44f82071e7909b45fa98b10a8"}
Sep 19 04:52:30.404954 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:30.404883    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:30.435956 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:30.435896    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw" podStartSLOduration=1.435865744 podStartE2EDuration="1.435865744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:52:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:52:30.435736593 +0000 UTC m=+2330.413932985" watchObservedRunningTime="2026-09-19 04:52:30.435865744 +0000 UTC m=+2330.414062134"
Sep 19 04:52:30.464779 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:30.464705    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5" podStartSLOduration=2.048249743 podStartE2EDuration="2.464686664s" totalImagesPullingTime="416.436921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:52:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:52:30.463302521 +0000 UTC m=+2330.441498910" watchObservedRunningTime="2026-09-19 04:52:30.464686664 +0000 UTC m=+2330.442883057"
Sep 19 04:52:36.416258 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:36.416183    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:52:41.412440 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:41.412409    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"
Sep 19 04:52:51.299796 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:51.299731    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:51.850436 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:51.850399    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:52.490154 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:52.490114    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:52.595101 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:52.595069    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:52.948897 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:52.948856    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:53.049608 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:53.049577    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:53.502132 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:53.502092    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:54.324237 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:54.324202    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:55.235514 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:55.235474    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:56.118721 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:56.118676    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:56.219628 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:56.219595    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:57.207718 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:57.207682    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:58.181803 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:58.181771    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:58.952399 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:58.952366    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"]
Sep 19 04:52:58.956522 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:58.956498    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:52:58.959886 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:58.959863    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-618e62-serving-cert\""
Sep 19 04:52:58.970269 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:58.970240    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"]
Sep 19 04:52:59.005277 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.005234    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:59.029544 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.029509    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a8416ba-4589-4c2b-8fca-79c83bcc7448-maas-api-tls\") pod \"maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:52:59.029697 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.029576    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a8416ba-4589-4c2b-8fca-79c83bcc7448-metrics-certs\") pod \"maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:52:59.029697 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.029622    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2dg9\" (UniqueName: \"kubernetes.io/projected/6a8416ba-4589-4c2b-8fca-79c83bcc7448-kube-api-access-d2dg9\") pod \"maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:52:59.029697 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.029651    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a8416ba-4589-4c2b-8fca-79c83bcc7448-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:52:59.106275 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.106240    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:59.130438 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.130412    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a8416ba-4589-4c2b-8fca-79c83bcc7448-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:52:59.130630 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.130483    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a8416ba-4589-4c2b-8fca-79c83bcc7448-maas-api-tls\") pod \"maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:52:59.130630 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.130564    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a8416ba-4589-4c2b-8fca-79c83bcc7448-metrics-certs\") pod \"maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:52:59.130630 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.130621    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2dg9\" (UniqueName: \"kubernetes.io/projected/6a8416ba-4589-4c2b-8fca-79c83bcc7448-kube-api-access-d2dg9\") pod \"maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:52:59.131213 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.131181    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a8416ba-4589-4c2b-8fca-79c83bcc7448-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:52:59.133200 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.133172    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a8416ba-4589-4c2b-8fca-79c83bcc7448-maas-api-tls\") pod \"maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:52:59.133302 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.133233    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a8416ba-4589-4c2b-8fca-79c83bcc7448-metrics-certs\") pod \"maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:52:59.141195 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.141174    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2dg9\" (UniqueName: \"kubernetes.io/projected/6a8416ba-4589-4c2b-8fca-79c83bcc7448-kube-api-access-d2dg9\") pod \"maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:52:59.269284 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.269201    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:52:59.546610 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.546583    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"]
Sep 19 04:52:59.548576 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:52:59.548548    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a8416ba_4589_4c2b_8fca_79c83bcc7448.slice/crio-ad18efe7c560f7dcfb5bb7ef163c5f4fef5f232261bac6da13a9b514849f3b94 WatchSource:0}: Error finding container ad18efe7c560f7dcfb5bb7ef163c5f4fef5f232261bac6da13a9b514849f3b94: Status 404 returned error can't find the container with id ad18efe7c560f7dcfb5bb7ef163c5f4fef5f232261bac6da13a9b514849f3b94
Sep 19 04:52:59.630394 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.630360    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:52:59.735985 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:52:59.735946    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:53:00.559796 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:00.559723    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d" event={"ID":"6a8416ba-4589-4c2b-8fca-79c83bcc7448","Type":"ContainerStarted","Data":"73456ff0db302206fc9c79134ef4b3b1bb2f0f39adbf291b677e8c89c30c8860"}
Sep 19 04:53:00.560238 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:00.559810    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:53:00.560238 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:00.559830    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d" event={"ID":"6a8416ba-4589-4c2b-8fca-79c83bcc7448","Type":"ContainerStarted","Data":"ad18efe7c560f7dcfb5bb7ef163c5f4fef5f232261bac6da13a9b514849f3b94"}
Sep 19 04:53:00.583237 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:00.583186    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d" podStartSLOduration=2.154664828 podStartE2EDuration="2.583171258s" totalImagesPullingTime="428.50643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:52:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:53:00.580631343 +0000 UTC m=+2360.558827735" watchObservedRunningTime="2026-09-19 04:53:00.583171258 +0000 UTC m=+2360.561367654"
Sep 19 04:53:06.572220 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:06.572192    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:53:13.097339 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:13.097304    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:53:20.078125 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:20.078086    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:53:21.721352 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:21.721311    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:53:22.736235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:22.736190    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:53:23.592492 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:23.592454    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:53:24.493563 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:24.493527    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:53:25.275962 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:25.275923    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:53:26.115890 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:26.115852    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:53:28.903870 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:28.903833    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:53:28.968270 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:28.968235    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:53:43.586510 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:43.586471    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:53:46.181486 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:53:46.181444    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:07.553875 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:07.553783    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:07.618646 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:07.618615    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:20.000972 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:20.000937    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw_b1298451-7498-4914-8033-983877899c0d/payload-processing/0.log"
Sep 19 04:54:20.743568 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:20.743531    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:21.040864 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.040779    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"]
Sep 19 04:54:21.044885 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.044862    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.049819 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.049796    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 19 04:54:21.050139 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.050119    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-022574-openshift-default-dockercfg-mxmnp\""
Sep 19 04:54:21.063026 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.062999    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"]
Sep 19 04:54:21.081958 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.081922    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:21.116144 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.116112    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-token\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.116281 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.116148    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-data\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.116281 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.116176    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-credential-socket\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.116281 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.116253    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4799\" (UniqueName: \"kubernetes.io/projected/2b93f3e4-ea9b-428c-9fe3-7287ea100079-kube-api-access-g4799\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.116402 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.116301    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-envoy\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.116402 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.116341    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-workload-certs\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.116402 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.116397    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-workload-socket\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.116517 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.116418    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-podinfo\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.116517 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.116482    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istiod-ca-cert\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.196312 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.196267    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:21.217519 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.217492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-workload-socket\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.217666 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.217525    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-podinfo\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.217666 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.217560    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istiod-ca-cert\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.217796 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.217675    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-token\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.217796 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.217719    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-data\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.217796 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.217772    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-credential-socket\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.217962 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.217809    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4799\" (UniqueName: \"kubernetes.io/projected/2b93f3e4-ea9b-428c-9fe3-7287ea100079-kube-api-access-g4799\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.217962 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.217864    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-envoy\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.217962 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.217896    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-workload-certs\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.217962 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.217912    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-workload-socket\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.218195 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.218049    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-data\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.218195 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.218132    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-credential-socket\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.218325 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.218218    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-workload-certs\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.218325 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.218279    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istiod-ca-cert\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.220195 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.220174    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-envoy\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.220402 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.220382    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-podinfo\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.227348 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.227326    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-token\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.227553 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.227536    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4799\" (UniqueName: \"kubernetes.io/projected/2b93f3e4-ea9b-428c-9fe3-7287ea100079-kube-api-access-g4799\") pod \"e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") " pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.355830 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.355729    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:21.637416 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.637384    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"]
Sep 19 04:54:21.640922 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:54:21.640892    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b93f3e4_ea9b_428c_9fe3_7287ea100079.slice/crio-9287d84779b24e8ff4abbaeabb05aca8ea2b603c18db1a834e0c9439551d058c WatchSource:0}: Error finding container 9287d84779b24e8ff4abbaeabb05aca8ea2b603c18db1a834e0c9439551d058c: Status 404 returned error can't find the container with id 9287d84779b24e8ff4abbaeabb05aca8ea2b603c18db1a834e0c9439551d058c
Sep 19 04:54:21.643186 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.643154    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:54:21.643292 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.643218    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:54:21.643292 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.643248    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:54:21.981018 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.980920    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk" event={"ID":"2b93f3e4-ea9b-428c-9fe3-7287ea100079","Type":"ContainerStarted","Data":"460ed17ed2f731aef5845028a784105d03fcdcdf73c10b5ebec6cfc91b9052c6"}
Sep 19 04:54:21.981018 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:21.980976    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk" event={"ID":"2b93f3e4-ea9b-428c-9fe3-7287ea100079","Type":"ContainerStarted","Data":"9287d84779b24e8ff4abbaeabb05aca8ea2b603c18db1a834e0c9439551d058c"}
Sep 19 04:54:22.041291 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:22.041237    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk" podStartSLOduration=1.0412198 podStartE2EDuration="1.0412198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:54:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:54:22.040334915 +0000 UTC m=+2442.018531306" watchObservedRunningTime="2026-09-19 04:54:22.0412198 +0000 UTC m=+2442.019416230"
Sep 19 04:54:22.355976 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:22.355901    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:22.361120 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:22.361089    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:22.986883 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:22.986852    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:22.987928 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:22.987909    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:23.386850 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:23.386817    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:24.161791 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:24.161757    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:24.287656 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:24.287615    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:25.337705 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:25.337661    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:26.507959 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:26.507918    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:27.402523 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:27.402493    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:28.275226 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:28.275192    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:28.374592 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:28.374551    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:28.743334 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:28.743298    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:28.839801 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:28.839739    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:28.929557 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:28.929523    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:28.966092 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:28.966058    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"]
Sep 19 04:54:28.969718 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:28.969702    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"
Sep 19 04:54:28.973743 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:28.973720    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-022574\""
Sep 19 04:54:28.974463 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:28.974444    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-022574-dockercfg-j426z\""
Sep 19 04:54:28.983252 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:28.983225    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"]
Sep 19 04:54:29.092227 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:29.092135    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzndp\" (UniqueName: \"kubernetes.io/projected/b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c-kube-api-access-dzndp\") pod \"payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd\" (UID: \"b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"
Sep 19 04:54:29.092388 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:29.092278    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd\" (UID: \"b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"
Sep 19 04:54:29.193662 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:29.193628    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd\" (UID: \"b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"
Sep 19 04:54:29.193855 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:29.193701    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzndp\" (UniqueName: \"kubernetes.io/projected/b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c-kube-api-access-dzndp\") pod \"payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd\" (UID: \"b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"
Sep 19 04:54:29.194328 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:29.194309    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd\" (UID: \"b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"
Sep 19 04:54:29.204857 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:29.204832    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzndp\" (UniqueName: \"kubernetes.io/projected/b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c-kube-api-access-dzndp\") pod \"payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd\" (UID: \"b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"
Sep 19 04:54:29.281570 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:29.281538    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"
Sep 19 04:54:29.556128 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:29.556103    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"]
Sep 19 04:54:29.558055 ip-10-0-130-52 kubenswrapper[2569]: W0919 04:54:29.558028    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31b46e8_bd2f_4d0c_9c4d_9dc3adbb8b4c.slice/crio-d2023622a7f0f406623f1d221d01823b1cf5f832d02cd74818d4d13590a137bb WatchSource:0}: Error finding container d2023622a7f0f406623f1d221d01823b1cf5f832d02cd74818d4d13590a137bb: Status 404 returned error can't find the container with id d2023622a7f0f406623f1d221d01823b1cf5f832d02cd74818d4d13590a137bb
Sep 19 04:54:30.023117 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:30.023080    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd" event={"ID":"b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c","Type":"ContainerStarted","Data":"a0243f6bd9ed0f79e2210abe1f557d88f93b4200df8104402b645da2d9eade1a"}
Sep 19 04:54:30.023328 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:30.023155    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd" event={"ID":"b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c","Type":"ContainerStarted","Data":"d2023622a7f0f406623f1d221d01823b1cf5f832d02cd74818d4d13590a137bb"}
Sep 19 04:54:30.023328 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:30.023241    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"
Sep 19 04:54:30.044480 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:30.044432    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd" podStartSLOduration=2.044418195 podStartE2EDuration="2.044418195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:54:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:54:30.043068503 +0000 UTC m=+2450.021264894" watchObservedRunningTime="2026-09-19 04:54:30.044418195 +0000 UTC m=+2450.022614584"
Sep 19 04:54:41.029941 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:41.029911    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"
Sep 19 04:54:47.126034 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:47.125944    2569 generic.go:356] "Generic (PLEG): container finished" podID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" containerID="460ed17ed2f731aef5845028a784105d03fcdcdf73c10b5ebec6cfc91b9052c6" exitCode=0
Sep 19 04:54:47.126421 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:47.126022    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk" event={"ID":"2b93f3e4-ea9b-428c-9fe3-7287ea100079","Type":"ContainerDied","Data":"460ed17ed2f731aef5845028a784105d03fcdcdf73c10b5ebec6cfc91b9052c6"}
Sep 19 04:54:47.126501 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:47.126487    2569 scope.go:117] "RemoveContainer" containerID="460ed17ed2f731aef5845028a784105d03fcdcdf73c10b5ebec6cfc91b9052c6"
Sep 19 04:54:47.127616 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:47.127590    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:54:47.127673 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:47.127657    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:54:47.127708 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:47.127690    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:54:48.133984 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:48.133947    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk" event={"ID":"2b93f3e4-ea9b-428c-9fe3-7287ea100079","Type":"ContainerStarted","Data":"f6af735e360b754c82ff0f27446cc622e98fa8b6b21f56d8d80bc7dd68879b77"}
Sep 19 04:54:48.356818 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:48.356779    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:48.358163 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:48.358134    2569 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 19 04:54:48.358292 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:48.358195    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk" podUID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 19 04:54:49.356398 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:49.356365    2569 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 19 04:54:49.356767 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:49.356423    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk" podUID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 19 04:54:50.356249 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:50.356214    2569 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 19 04:54:50.356438 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:50.356270    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk" podUID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 19 04:54:51.356618 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:51.356583    2569 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 19 04:54:51.357114 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:51.356648    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk" podUID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 19 04:54:51.380556 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:51.380524    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:52.356289 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:52.356255    2569 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Sep 19 04:54:52.356481 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:52.356310    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk" podUID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Sep 19 04:54:52.595379 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:52.595343    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:52.986947 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:52.986906    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:53.361064 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:53.360954    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:53.403579 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:53.403529    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:53.405056 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:53.405029    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:54:54.288951 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:54.288920    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:54.391306 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:54.391274    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:55.317900 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:55.317866    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:56.314012 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:56.313979    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:57.119024 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:57.118987    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:57.971960 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:57.971924    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:58.754147 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:58.754100    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:54:59.479220 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:54:59.479192    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:00.395305 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:00.395266    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:05.526000 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:05.525960    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:06.144302 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.144265    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:06.189401 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.189365    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"]
Sep 19 04:55:06.189634 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.189603    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd" podUID="b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c" containerName="payload-pre-processing" containerID="cri-o://a0243f6bd9ed0f79e2210abe1f557d88f93b4200df8104402b645da2d9eade1a" gracePeriod=30
Sep 19 04:55:06.250330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.250300    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:06.348411 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.348366    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:06.449441 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.449409    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"
Sep 19 04:55:06.450488 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.450456    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:06.561189 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.561154    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzndp\" (UniqueName: \"kubernetes.io/projected/b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c-kube-api-access-dzndp\") pod \"b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c\" (UID: \"b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c\") "
Sep 19 04:55:06.561579 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.561248    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c-plugins-config-volume\") pod \"b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c\" (UID: \"b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c\") "
Sep 19 04:55:06.561650 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.561628    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c" (UID: "b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:55:06.563506 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.563483    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c-kube-api-access-dzndp" (OuterVolumeSpecName: "kube-api-access-dzndp") pod "b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c" (UID: "b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c"). InnerVolumeSpecName "kube-api-access-dzndp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:55:06.663094 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.663045    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzndp\" (UniqueName: \"kubernetes.io/projected/b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c-kube-api-access-dzndp\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:06.663094 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.663087    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:06.893123 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.893071    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:06.985701 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:06.985661    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:07.239144 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:07.239055    2569 generic.go:356] "Generic (PLEG): container finished" podID="b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c" containerID="a0243f6bd9ed0f79e2210abe1f557d88f93b4200df8104402b645da2d9eade1a" exitCode=0
Sep 19 04:55:07.239144 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:07.239102    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"
Sep 19 04:55:07.239333 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:07.239103    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd" event={"ID":"b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c","Type":"ContainerDied","Data":"a0243f6bd9ed0f79e2210abe1f557d88f93b4200df8104402b645da2d9eade1a"}
Sep 19 04:55:07.239333 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:07.239233    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd" event={"ID":"b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c","Type":"ContainerDied","Data":"d2023622a7f0f406623f1d221d01823b1cf5f832d02cd74818d4d13590a137bb"}
Sep 19 04:55:07.239333 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:07.239263    2569 scope.go:117] "RemoveContainer" containerID="a0243f6bd9ed0f79e2210abe1f557d88f93b4200df8104402b645da2d9eade1a"
Sep 19 04:55:07.248724 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:07.248700    2569 scope.go:117] "RemoveContainer" containerID="a0243f6bd9ed0f79e2210abe1f557d88f93b4200df8104402b645da2d9eade1a"
Sep 19 04:55:07.249035 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:55:07.249016    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0243f6bd9ed0f79e2210abe1f557d88f93b4200df8104402b645da2d9eade1a\": container with ID starting with a0243f6bd9ed0f79e2210abe1f557d88f93b4200df8104402b645da2d9eade1a not found: ID does not exist" containerID="a0243f6bd9ed0f79e2210abe1f557d88f93b4200df8104402b645da2d9eade1a"
Sep 19 04:55:07.249091 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:07.249044    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0243f6bd9ed0f79e2210abe1f557d88f93b4200df8104402b645da2d9eade1a"} err="failed to get container status \"a0243f6bd9ed0f79e2210abe1f557d88f93b4200df8104402b645da2d9eade1a\": rpc error: code = NotFound desc = could not find container \"a0243f6bd9ed0f79e2210abe1f557d88f93b4200df8104402b645da2d9eade1a\": container with ID starting with a0243f6bd9ed0f79e2210abe1f557d88f93b4200df8104402b645da2d9eade1a not found: ID does not exist"
Sep 19 04:55:07.270401 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:07.270368    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"]
Sep 19 04:55:07.272163 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:07.272143    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-022574-657c4fcfdb-qrptd"]
Sep 19 04:55:08.002462 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:08.002399    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:08.542927 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:08.541063    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c" path="/var/lib/kubelet/pods/b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c/volumes"
Sep 19 04:55:08.784306 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:08.784268    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:09.688978 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:09.688914    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:10.631807 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:10.631743    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:13.713503 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:13.713431    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:13.799401 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:13.799366    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:13.980303 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:13.980213    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"]
Sep 19 04:55:13.980473 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:13.980427    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk" podUID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" containerName="istio-proxy" containerID="cri-o://f6af735e360b754c82ff0f27446cc622e98fa8b6b21f56d8d80bc7dd68879b77" gracePeriod=30
Sep 19 04:55:13.994335 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:13.994305    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:17.935949 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:17.935914    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:18.943577 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:18.943538    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:19.239017 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.238990    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:55:19.303311 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.303275    2569 generic.go:356] "Generic (PLEG): container finished" podID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" containerID="f6af735e360b754c82ff0f27446cc622e98fa8b6b21f56d8d80bc7dd68879b77" exitCode=0
Sep 19 04:55:19.303500 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.303332    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"
Sep 19 04:55:19.303500 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.303371    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk" event={"ID":"2b93f3e4-ea9b-428c-9fe3-7287ea100079","Type":"ContainerDied","Data":"f6af735e360b754c82ff0f27446cc622e98fa8b6b21f56d8d80bc7dd68879b77"}
Sep 19 04:55:19.303500 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.303432    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk" event={"ID":"2b93f3e4-ea9b-428c-9fe3-7287ea100079","Type":"ContainerDied","Data":"9287d84779b24e8ff4abbaeabb05aca8ea2b603c18db1a834e0c9439551d058c"}
Sep 19 04:55:19.303500 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.303456    2569 scope.go:117] "RemoveContainer" containerID="f6af735e360b754c82ff0f27446cc622e98fa8b6b21f56d8d80bc7dd68879b77"
Sep 19 04:55:19.312921 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.312905    2569 scope.go:117] "RemoveContainer" containerID="460ed17ed2f731aef5845028a784105d03fcdcdf73c10b5ebec6cfc91b9052c6"
Sep 19 04:55:19.321548 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.321529    2569 scope.go:117] "RemoveContainer" containerID="f6af735e360b754c82ff0f27446cc622e98fa8b6b21f56d8d80bc7dd68879b77"
Sep 19 04:55:19.321837 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:55:19.321820    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6af735e360b754c82ff0f27446cc622e98fa8b6b21f56d8d80bc7dd68879b77\": container with ID starting with f6af735e360b754c82ff0f27446cc622e98fa8b6b21f56d8d80bc7dd68879b77 not found: ID does not exist" containerID="f6af735e360b754c82ff0f27446cc622e98fa8b6b21f56d8d80bc7dd68879b77"
Sep 19 04:55:19.321888 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.321846    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6af735e360b754c82ff0f27446cc622e98fa8b6b21f56d8d80bc7dd68879b77"} err="failed to get container status \"f6af735e360b754c82ff0f27446cc622e98fa8b6b21f56d8d80bc7dd68879b77\": rpc error: code = NotFound desc = could not find container \"f6af735e360b754c82ff0f27446cc622e98fa8b6b21f56d8d80bc7dd68879b77\": container with ID starting with f6af735e360b754c82ff0f27446cc622e98fa8b6b21f56d8d80bc7dd68879b77 not found: ID does not exist"
Sep 19 04:55:19.321888 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.321865    2569 scope.go:117] "RemoveContainer" containerID="460ed17ed2f731aef5845028a784105d03fcdcdf73c10b5ebec6cfc91b9052c6"
Sep 19 04:55:19.322086 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:55:19.322070    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"460ed17ed2f731aef5845028a784105d03fcdcdf73c10b5ebec6cfc91b9052c6\": container with ID starting with 460ed17ed2f731aef5845028a784105d03fcdcdf73c10b5ebec6cfc91b9052c6 not found: ID does not exist" containerID="460ed17ed2f731aef5845028a784105d03fcdcdf73c10b5ebec6cfc91b9052c6"
Sep 19 04:55:19.322138 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.322091    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460ed17ed2f731aef5845028a784105d03fcdcdf73c10b5ebec6cfc91b9052c6"} err="failed to get container status \"460ed17ed2f731aef5845028a784105d03fcdcdf73c10b5ebec6cfc91b9052c6\": rpc error: code = NotFound desc = could not find container \"460ed17ed2f731aef5845028a784105d03fcdcdf73c10b5ebec6cfc91b9052c6\": container with ID starting with 460ed17ed2f731aef5845028a784105d03fcdcdf73c10b5ebec6cfc91b9052c6 not found: ID does not exist"
Sep 19 04:55:19.384861 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.384813    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istiod-ca-cert\") pod \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") "
Sep 19 04:55:19.384861 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.384863    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-credential-socket\") pod \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") "
Sep 19 04:55:19.385099 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.384908    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-podinfo\") pod \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") "
Sep 19 04:55:19.385099 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.384964    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-data\") pod \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") "
Sep 19 04:55:19.385099 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.384986    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-token\") pod \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") "
Sep 19 04:55:19.385099 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.385007    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-workload-socket\") pod \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") "
Sep 19 04:55:19.385099 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.385034    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-workload-certs\") pod \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") "
Sep 19 04:55:19.385099 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.385078    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-envoy\") pod \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") "
Sep 19 04:55:19.385379 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.385121    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4799\" (UniqueName: \"kubernetes.io/projected/2b93f3e4-ea9b-428c-9fe3-7287ea100079-kube-api-access-g4799\") pod \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\" (UID: \"2b93f3e4-ea9b-428c-9fe3-7287ea100079\") "
Sep 19 04:55:19.385379 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.385210    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2b93f3e4-ea9b-428c-9fe3-7287ea100079" (UID: "2b93f3e4-ea9b-428c-9fe3-7287ea100079"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:55:19.385379 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.385277    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-data" (OuterVolumeSpecName: "istio-data") pod "2b93f3e4-ea9b-428c-9fe3-7287ea100079" (UID: "2b93f3e4-ea9b-428c-9fe3-7287ea100079"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:55:19.385379 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.385281    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2b93f3e4-ea9b-428c-9fe3-7287ea100079" (UID: "2b93f3e4-ea9b-428c-9fe3-7287ea100079"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:55:19.385587 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.385417    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2b93f3e4-ea9b-428c-9fe3-7287ea100079" (UID: "2b93f3e4-ea9b-428c-9fe3-7287ea100079"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:55:19.385587 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.385518    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2b93f3e4-ea9b-428c-9fe3-7287ea100079" (UID: "2b93f3e4-ea9b-428c-9fe3-7287ea100079"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:55:19.385587 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.385535    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istiod-ca-cert\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:19.385587 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.385558    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-credential-socket\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:19.385587 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.385569    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-data\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:19.385587 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.385582    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-workload-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:19.387613 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.387580    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-token" (OuterVolumeSpecName: "istio-token") pod "2b93f3e4-ea9b-428c-9fe3-7287ea100079" (UID: "2b93f3e4-ea9b-428c-9fe3-7287ea100079"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:55:19.387613 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.387605    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2b93f3e4-ea9b-428c-9fe3-7287ea100079" (UID: "2b93f3e4-ea9b-428c-9fe3-7287ea100079"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:55:19.387947 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.387923    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b93f3e4-ea9b-428c-9fe3-7287ea100079-kube-api-access-g4799" (OuterVolumeSpecName: "kube-api-access-g4799") pod "2b93f3e4-ea9b-428c-9fe3-7287ea100079" (UID: "2b93f3e4-ea9b-428c-9fe3-7287ea100079"). InnerVolumeSpecName "kube-api-access-g4799". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:55:19.388039 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.387923    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2b93f3e4-ea9b-428c-9fe3-7287ea100079" (UID: "2b93f3e4-ea9b-428c-9fe3-7287ea100079"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:55:19.486396 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.486316    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-podinfo\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:19.486396 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.486340    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-token\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:19.486396 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.486350    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-workload-socket\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:19.486396 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.486358    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2b93f3e4-ea9b-428c-9fe3-7287ea100079-istio-envoy\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:19.486396 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.486367    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4799\" (UniqueName: \"kubernetes.io/projected/2b93f3e4-ea9b-428c-9fe3-7287ea100079-kube-api-access-g4799\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:19.636835 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.636804    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"]
Sep 19 04:55:19.640289 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.640265    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-022574-openshift-default-67669d4548-2gzkk"]
Sep 19 04:55:19.810338 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:19.810255    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:20.542636 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:20.542596    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" path="/var/lib/kubelet/pods/2b93f3e4-ea9b-428c-9fe3-7287ea100079/volumes"
Sep 19 04:55:20.698094 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:20.698063    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:21.493492 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:21.493456    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:22.473841 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:22.473790    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:33.331322 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.331199    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"]
Sep 19 04:55:33.331788 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.331455    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5" podUID="1ab80788-d0fc-4a29-9221-2dbbe09cad92" containerName="maas-api" containerID="cri-o://1ed16802e55cbcaaa77458ce25c6b7c909e6256424f2a4dca0a5e65c1be54fc6" gracePeriod=30
Sep 19 04:55:33.376466 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.376427    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:33.418636 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.418600    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"]
Sep 19 04:55:33.418886 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.418860    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw" podUID="b1298451-7498-4914-8033-983877899c0d" containerName="payload-processing" containerID="cri-o://0cebdca48d6f3a1a745ad840be0dceea660027d64c7cc642b7b2a343502c0efa" gracePeriod=30
Sep 19 04:55:33.480284 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.480246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:33.582202 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.582102    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:33.683211 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.683173    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:33.694323 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.694303    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:55:33.718085 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.718052    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"
Sep 19 04:55:33.726684 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.726579    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4grsr\" (UniqueName: \"kubernetes.io/projected/1ab80788-d0fc-4a29-9221-2dbbe09cad92-kube-api-access-4grsr\") pod \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") "
Sep 19 04:55:33.726684 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.726651    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ab80788-d0fc-4a29-9221-2dbbe09cad92-openshift-service-ca\") pod \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") "
Sep 19 04:55:33.726921 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.726690    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1298451-7498-4914-8033-983877899c0d-plugins-config-volume\") pod \"b1298451-7498-4914-8033-983877899c0d\" (UID: \"b1298451-7498-4914-8033-983877899c0d\") "
Sep 19 04:55:33.726921 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.726718    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-metrics-certs\") pod \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") "
Sep 19 04:55:33.726921 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.726789    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-maas-api-tls\") pod \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\" (UID: \"1ab80788-d0fc-4a29-9221-2dbbe09cad92\") "
Sep 19 04:55:33.726921 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.726861    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9c6c\" (UniqueName: \"kubernetes.io/projected/b1298451-7498-4914-8033-983877899c0d-kube-api-access-l9c6c\") pod \"b1298451-7498-4914-8033-983877899c0d\" (UID: \"b1298451-7498-4914-8033-983877899c0d\") "
Sep 19 04:55:33.727149 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.727124    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ab80788-d0fc-4a29-9221-2dbbe09cad92-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ab80788-d0fc-4a29-9221-2dbbe09cad92" (UID: "1ab80788-d0fc-4a29-9221-2dbbe09cad92"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:55:33.727201 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.727176    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1298451-7498-4914-8033-983877899c0d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b1298451-7498-4914-8033-983877899c0d" (UID: "b1298451-7498-4914-8033-983877899c0d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:55:33.729107 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.729077    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1ab80788-d0fc-4a29-9221-2dbbe09cad92" (UID: "1ab80788-d0fc-4a29-9221-2dbbe09cad92"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:55:33.729251 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.729183    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1298451-7498-4914-8033-983877899c0d-kube-api-access-l9c6c" (OuterVolumeSpecName: "kube-api-access-l9c6c") pod "b1298451-7498-4914-8033-983877899c0d" (UID: "b1298451-7498-4914-8033-983877899c0d"). InnerVolumeSpecName "kube-api-access-l9c6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:55:33.729474 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.729455    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ab80788-d0fc-4a29-9221-2dbbe09cad92" (UID: "1ab80788-d0fc-4a29-9221-2dbbe09cad92"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:55:33.729552 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.729480    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ab80788-d0fc-4a29-9221-2dbbe09cad92-kube-api-access-4grsr" (OuterVolumeSpecName: "kube-api-access-4grsr") pod "1ab80788-d0fc-4a29-9221-2dbbe09cad92" (UID: "1ab80788-d0fc-4a29-9221-2dbbe09cad92"). InnerVolumeSpecName "kube-api-access-4grsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:55:33.758501 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.758457    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:33.828627 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.828572    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4grsr\" (UniqueName: \"kubernetes.io/projected/1ab80788-d0fc-4a29-9221-2dbbe09cad92-kube-api-access-4grsr\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:33.828627 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.828619    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ab80788-d0fc-4a29-9221-2dbbe09cad92-openshift-service-ca\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:33.828627 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.828634    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b1298451-7498-4914-8033-983877899c0d-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:33.828909 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.828646    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-metrics-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:33.828909 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.828658    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ab80788-d0fc-4a29-9221-2dbbe09cad92-maas-api-tls\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:33.828909 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:33.828669    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9c6c\" (UniqueName: \"kubernetes.io/projected/b1298451-7498-4914-8033-983877899c0d-kube-api-access-l9c6c\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:55:34.109986 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.109918    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:34.382905 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.382868    2569 generic.go:356] "Generic (PLEG): container finished" podID="b1298451-7498-4914-8033-983877899c0d" containerID="0cebdca48d6f3a1a745ad840be0dceea660027d64c7cc642b7b2a343502c0efa" exitCode=0
Sep 19 04:55:34.383341 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.382921    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"
Sep 19 04:55:34.383341 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.382939    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw" event={"ID":"b1298451-7498-4914-8033-983877899c0d","Type":"ContainerDied","Data":"0cebdca48d6f3a1a745ad840be0dceea660027d64c7cc642b7b2a343502c0efa"}
Sep 19 04:55:34.383341 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.382992    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw" event={"ID":"b1298451-7498-4914-8033-983877899c0d","Type":"ContainerDied","Data":"8973827e8925c11041cc8cfaf089283139a4952963bb505fbd3dc615affcc6fa"}
Sep 19 04:55:34.383341 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.383024    2569 scope.go:117] "RemoveContainer" containerID="0cebdca48d6f3a1a745ad840be0dceea660027d64c7cc642b7b2a343502c0efa"
Sep 19 04:55:34.384470 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.384447    2569 generic.go:356] "Generic (PLEG): container finished" podID="1ab80788-d0fc-4a29-9221-2dbbe09cad92" containerID="1ed16802e55cbcaaa77458ce25c6b7c909e6256424f2a4dca0a5e65c1be54fc6" exitCode=0
Sep 19 04:55:34.384568 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.384495    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"
Sep 19 04:55:34.384568 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.384552    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5" event={"ID":"1ab80788-d0fc-4a29-9221-2dbbe09cad92","Type":"ContainerDied","Data":"1ed16802e55cbcaaa77458ce25c6b7c909e6256424f2a4dca0a5e65c1be54fc6"}
Sep 19 04:55:34.384666 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.384607    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5" event={"ID":"1ab80788-d0fc-4a29-9221-2dbbe09cad92","Type":"ContainerDied","Data":"0f6907abc1631379fd1a87e57b557738e8a23bc44f82071e7909b45fa98b10a8"}
Sep 19 04:55:34.393188 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.393170    2569 scope.go:117] "RemoveContainer" containerID="0cebdca48d6f3a1a745ad840be0dceea660027d64c7cc642b7b2a343502c0efa"
Sep 19 04:55:34.393487 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:55:34.393464    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cebdca48d6f3a1a745ad840be0dceea660027d64c7cc642b7b2a343502c0efa\": container with ID starting with 0cebdca48d6f3a1a745ad840be0dceea660027d64c7cc642b7b2a343502c0efa not found: ID does not exist" containerID="0cebdca48d6f3a1a745ad840be0dceea660027d64c7cc642b7b2a343502c0efa"
Sep 19 04:55:34.393587 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.393494    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cebdca48d6f3a1a745ad840be0dceea660027d64c7cc642b7b2a343502c0efa"} err="failed to get container status \"0cebdca48d6f3a1a745ad840be0dceea660027d64c7cc642b7b2a343502c0efa\": rpc error: code = NotFound desc = could not find container \"0cebdca48d6f3a1a745ad840be0dceea660027d64c7cc642b7b2a343502c0efa\": container with ID starting with 0cebdca48d6f3a1a745ad840be0dceea660027d64c7cc642b7b2a343502c0efa not found: ID does not exist"
Sep 19 04:55:34.393587 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.393511    2569 scope.go:117] "RemoveContainer" containerID="1ed16802e55cbcaaa77458ce25c6b7c909e6256424f2a4dca0a5e65c1be54fc6"
Sep 19 04:55:34.401486 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.401472    2569 scope.go:117] "RemoveContainer" containerID="1ed16802e55cbcaaa77458ce25c6b7c909e6256424f2a4dca0a5e65c1be54fc6"
Sep 19 04:55:34.401722 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:55:34.401707    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ed16802e55cbcaaa77458ce25c6b7c909e6256424f2a4dca0a5e65c1be54fc6\": container with ID starting with 1ed16802e55cbcaaa77458ce25c6b7c909e6256424f2a4dca0a5e65c1be54fc6 not found: ID does not exist" containerID="1ed16802e55cbcaaa77458ce25c6b7c909e6256424f2a4dca0a5e65c1be54fc6"
Sep 19 04:55:34.401781 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.401730    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ed16802e55cbcaaa77458ce25c6b7c909e6256424f2a4dca0a5e65c1be54fc6"} err="failed to get container status \"1ed16802e55cbcaaa77458ce25c6b7c909e6256424f2a4dca0a5e65c1be54fc6\": rpc error: code = NotFound desc = could not find container \"1ed16802e55cbcaaa77458ce25c6b7c909e6256424f2a4dca0a5e65c1be54fc6\": container with ID starting with 1ed16802e55cbcaaa77458ce25c6b7c909e6256424f2a4dca0a5e65c1be54fc6 not found: ID does not exist"
Sep 19 04:55:34.406727 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.406704    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"]
Sep 19 04:55:34.411650 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.411629    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-cacd12-77dcfd5557-27zjw"]
Sep 19 04:55:34.426505 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.426477    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"]
Sep 19 04:55:34.428492 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.428472    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-cacd12-747df55b7f-khht5"]
Sep 19 04:55:34.539378 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.539348    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ab80788-d0fc-4a29-9221-2dbbe09cad92" path="/var/lib/kubelet/pods/1ab80788-d0fc-4a29-9221-2dbbe09cad92/volumes"
Sep 19 04:55:34.539712 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:34.539700    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1298451-7498-4914-8033-983877899c0d" path="/var/lib/kubelet/pods/b1298451-7498-4914-8033-983877899c0d/volumes"
Sep 19 04:55:35.223156 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:35.223093    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:35.747861 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:35.747825    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:36.587511 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:36.587464    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:55:39.183362 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:55:39.183331    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:17.175885 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:17.175851    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:17.924043 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:17.923990    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:24.518901 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:24.518860    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:24.602563 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:24.602517    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:24.733433 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:24.733406    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:25.266872 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:25.266837    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:26.340078 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:26.340022    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:27.215651 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:27.215619    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:28.381652 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:28.381601    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:29.141996 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:29.141953    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:35.793150 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:35.793116    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"]
Sep 19 04:56:35.793566 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:35.793330    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d" podUID="6a8416ba-4589-4c2b-8fca-79c83bcc7448" containerName="maas-api" containerID="cri-o://73456ff0db302206fc9c79134ef4b3b1bb2f0f39adbf291b677e8c89c30c8860" gracePeriod=30
Sep 19 04:56:35.831570 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:35.831533    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:35.924557 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:35.924500    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:36.016267 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.016230    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:36.047003 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.046945    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:56:36.125512 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.125463    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a8416ba-4589-4c2b-8fca-79c83bcc7448-metrics-certs\") pod \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") "
Sep 19 04:56:36.125689 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.125552    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a8416ba-4589-4c2b-8fca-79c83bcc7448-maas-api-tls\") pod \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") "
Sep 19 04:56:36.125689 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.125588    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2dg9\" (UniqueName: \"kubernetes.io/projected/6a8416ba-4589-4c2b-8fca-79c83bcc7448-kube-api-access-d2dg9\") pod \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") "
Sep 19 04:56:36.125689 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.125640    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a8416ba-4589-4c2b-8fca-79c83bcc7448-openshift-service-ca\") pod \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\" (UID: \"6a8416ba-4589-4c2b-8fca-79c83bcc7448\") "
Sep 19 04:56:36.126112 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.126084    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a8416ba-4589-4c2b-8fca-79c83bcc7448-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6a8416ba-4589-4c2b-8fca-79c83bcc7448" (UID: "6a8416ba-4589-4c2b-8fca-79c83bcc7448"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:56:36.127905 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.127878    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a8416ba-4589-4c2b-8fca-79c83bcc7448-kube-api-access-d2dg9" (OuterVolumeSpecName: "kube-api-access-d2dg9") pod "6a8416ba-4589-4c2b-8fca-79c83bcc7448" (UID: "6a8416ba-4589-4c2b-8fca-79c83bcc7448"). InnerVolumeSpecName "kube-api-access-d2dg9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:56:36.127905 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.127888    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a8416ba-4589-4c2b-8fca-79c83bcc7448-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6a8416ba-4589-4c2b-8fca-79c83bcc7448" (UID: "6a8416ba-4589-4c2b-8fca-79c83bcc7448"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:56:36.128035 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.127940    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6a8416ba-4589-4c2b-8fca-79c83bcc7448-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6a8416ba-4589-4c2b-8fca-79c83bcc7448" (UID: "6a8416ba-4589-4c2b-8fca-79c83bcc7448"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:56:36.227211 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.227163    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a8416ba-4589-4c2b-8fca-79c83bcc7448-openshift-service-ca\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:56:36.227211 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.227207    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a8416ba-4589-4c2b-8fca-79c83bcc7448-metrics-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:56:36.227211 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.227216    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6a8416ba-4589-4c2b-8fca-79c83bcc7448-maas-api-tls\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:56:36.227211 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.227224    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2dg9\" (UniqueName: \"kubernetes.io/projected/6a8416ba-4589-4c2b-8fca-79c83bcc7448-kube-api-access-d2dg9\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:56:36.235315 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.235282    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:36.337935 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.337850    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:36.575787 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.575735    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:36.711119 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.711086    2569 generic.go:356] "Generic (PLEG): container finished" podID="6a8416ba-4589-4c2b-8fca-79c83bcc7448" containerID="73456ff0db302206fc9c79134ef4b3b1bb2f0f39adbf291b677e8c89c30c8860" exitCode=0
Sep 19 04:56:36.711298 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.711150    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"
Sep 19 04:56:36.711298 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.711154    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d" event={"ID":"6a8416ba-4589-4c2b-8fca-79c83bcc7448","Type":"ContainerDied","Data":"73456ff0db302206fc9c79134ef4b3b1bb2f0f39adbf291b677e8c89c30c8860"}
Sep 19 04:56:36.711298 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.711204    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d" event={"ID":"6a8416ba-4589-4c2b-8fca-79c83bcc7448","Type":"ContainerDied","Data":"ad18efe7c560f7dcfb5bb7ef163c5f4fef5f232261bac6da13a9b514849f3b94"}
Sep 19 04:56:36.711298 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.711230    2569 scope.go:117] "RemoveContainer" containerID="73456ff0db302206fc9c79134ef4b3b1bb2f0f39adbf291b677e8c89c30c8860"
Sep 19 04:56:36.716087 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.716052    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:36.720795 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.720776    2569 scope.go:117] "RemoveContainer" containerID="73456ff0db302206fc9c79134ef4b3b1bb2f0f39adbf291b677e8c89c30c8860"
Sep 19 04:56:36.721075 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:56:36.721054    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73456ff0db302206fc9c79134ef4b3b1bb2f0f39adbf291b677e8c89c30c8860\": container with ID starting with 73456ff0db302206fc9c79134ef4b3b1bb2f0f39adbf291b677e8c89c30c8860 not found: ID does not exist" containerID="73456ff0db302206fc9c79134ef4b3b1bb2f0f39adbf291b677e8c89c30c8860"
Sep 19 04:56:36.721144 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.721087    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73456ff0db302206fc9c79134ef4b3b1bb2f0f39adbf291b677e8c89c30c8860"} err="failed to get container status \"73456ff0db302206fc9c79134ef4b3b1bb2f0f39adbf291b677e8c89c30c8860\": rpc error: code = NotFound desc = could not find container \"73456ff0db302206fc9c79134ef4b3b1bb2f0f39adbf291b677e8c89c30c8860\": container with ID starting with 73456ff0db302206fc9c79134ef4b3b1bb2f0f39adbf291b677e8c89c30c8860 not found: ID does not exist"
Sep 19 04:56:36.753518 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.753491    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"]
Sep 19 04:56:36.762910 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:36.762886    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-618e62-75c594c6bd-v8q9d"]
Sep 19 04:56:37.624984 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:37.624944    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:38.380535 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:38.380488    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:38.539235 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:38.539200    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a8416ba-4589-4c2b-8fca-79c83bcc7448" path="/var/lib/kubelet/pods/6a8416ba-4589-4c2b-8fca-79c83bcc7448/volumes"
Sep 19 04:56:42.031616 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:42.031579    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:43.013720 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:43.013679    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:43.114585 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:43.114544    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:43.306733 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:43.306644    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:43.981127 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:43.981090    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:44.895758 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:44.895698    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:45.675416 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:45.675381    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:46.567496 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:46.567465    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:54.247330 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.247290    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-561bb1-29829885-pdxpj"]
Sep 19 04:56:54.250616 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.250585    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-561bb1-29829885-pdxpj"]
Sep 19 04:56:54.254921 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.254892    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:54.281686 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.281652    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"]
Sep 19 04:56:54.281954 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.281923    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4" podUID="99330ae9-a490-431c-ac75-cd65ad6828e8" containerName="payload-processing" containerID="cri-o://19004507de1245a7b4c215b26046e4a6fd3ab037dba4cdbfe85c34db173e6be5" gracePeriod=30
Sep 19 04:56:54.328824 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.328783    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:54.431454 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.431414    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:54.506134 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.506042    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:54.534069 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.534046    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"
Sep 19 04:56:54.538549 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.538527    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d5dba10-3aca-4ba0-90c4-d857137a973e" path="/var/lib/kubelet/pods/8d5dba10-3aca-4ba0-90c4-d857137a973e/volumes"
Sep 19 04:56:54.590268 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.590236    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99330ae9-a490-431c-ac75-cd65ad6828e8-plugins-config-volume\") pod \"99330ae9-a490-431c-ac75-cd65ad6828e8\" (UID: \"99330ae9-a490-431c-ac75-cd65ad6828e8\") "
Sep 19 04:56:54.590450 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.590282    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmlbd\" (UniqueName: \"kubernetes.io/projected/99330ae9-a490-431c-ac75-cd65ad6828e8-kube-api-access-rmlbd\") pod \"99330ae9-a490-431c-ac75-cd65ad6828e8\" (UID: \"99330ae9-a490-431c-ac75-cd65ad6828e8\") "
Sep 19 04:56:54.590589 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.590568    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99330ae9-a490-431c-ac75-cd65ad6828e8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "99330ae9-a490-431c-ac75-cd65ad6828e8" (UID: "99330ae9-a490-431c-ac75-cd65ad6828e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:56:54.592555 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.592536    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99330ae9-a490-431c-ac75-cd65ad6828e8-kube-api-access-rmlbd" (OuterVolumeSpecName: "kube-api-access-rmlbd") pod "99330ae9-a490-431c-ac75-cd65ad6828e8" (UID: "99330ae9-a490-431c-ac75-cd65ad6828e8"). InnerVolumeSpecName "kube-api-access-rmlbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:56:54.691222 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.691183    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99330ae9-a490-431c-ac75-cd65ad6828e8-plugins-config-volume\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:56:54.691222 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.691216    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmlbd\" (UniqueName: \"kubernetes.io/projected/99330ae9-a490-431c-ac75-cd65ad6828e8-kube-api-access-rmlbd\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:56:54.802229 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.802140    2569 generic.go:356] "Generic (PLEG): container finished" podID="99330ae9-a490-431c-ac75-cd65ad6828e8" containerID="19004507de1245a7b4c215b26046e4a6fd3ab037dba4cdbfe85c34db173e6be5" exitCode=0
Sep 19 04:56:54.802229 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.802191    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"
Sep 19 04:56:54.802466 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.802228    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4" event={"ID":"99330ae9-a490-431c-ac75-cd65ad6828e8","Type":"ContainerDied","Data":"19004507de1245a7b4c215b26046e4a6fd3ab037dba4cdbfe85c34db173e6be5"}
Sep 19 04:56:54.802466 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.802287    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4" event={"ID":"99330ae9-a490-431c-ac75-cd65ad6828e8","Type":"ContainerDied","Data":"94a5d010dd9fe2c83e96a5e30f682e396e4b62ab911dddb516a1317a0edc2737"}
Sep 19 04:56:54.802466 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.802312    2569 scope.go:117] "RemoveContainer" containerID="19004507de1245a7b4c215b26046e4a6fd3ab037dba4cdbfe85c34db173e6be5"
Sep 19 04:56:54.812152 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.812135    2569 scope.go:117] "RemoveContainer" containerID="19004507de1245a7b4c215b26046e4a6fd3ab037dba4cdbfe85c34db173e6be5"
Sep 19 04:56:54.812469 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:56:54.812449    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19004507de1245a7b4c215b26046e4a6fd3ab037dba4cdbfe85c34db173e6be5\": container with ID starting with 19004507de1245a7b4c215b26046e4a6fd3ab037dba4cdbfe85c34db173e6be5 not found: ID does not exist" containerID="19004507de1245a7b4c215b26046e4a6fd3ab037dba4cdbfe85c34db173e6be5"
Sep 19 04:56:54.812518 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.812479    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19004507de1245a7b4c215b26046e4a6fd3ab037dba4cdbfe85c34db173e6be5"} err="failed to get container status \"19004507de1245a7b4c215b26046e4a6fd3ab037dba4cdbfe85c34db173e6be5\": rpc error: code = NotFound desc = could not find container \"19004507de1245a7b4c215b26046e4a6fd3ab037dba4cdbfe85c34db173e6be5\": container with ID starting with 19004507de1245a7b4c215b26046e4a6fd3ab037dba4cdbfe85c34db173e6be5 not found: ID does not exist"
Sep 19 04:56:54.824246 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.824222    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"]
Sep 19 04:56:54.828931 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.828910    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-561bb1-59fb79ff6f-jtmz4"]
Sep 19 04:56:54.841894 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.841870    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:54.942541 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:54.942503    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:55.572015 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:55.571977    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:56:56.538688 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:56:56.538658    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99330ae9-a490-431c-ac75-cd65ad6828e8" path="/var/lib/kubelet/pods/99330ae9-a490-431c-ac75-cd65ad6828e8/volumes"
Sep 19 04:57:01.212408 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:01.212370    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:57:01.311528 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:01.311491    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:57:01.485128 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:01.485027    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:57:02.898812 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:02.898775    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:57:03.680207 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:03.680168    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:57:12.396068 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.396037    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"]
Sep 19 04:57:12.396517 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.396275    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9" podUID="c5fb2454-bff1-41f6-ae19-115d815cc71a" containerName="maas-api" containerID="cri-o://d3c88ca2e3ac716bb09e4dbf0bb814937dccda0a458347ecd4a62436f021a63b" gracePeriod=30
Sep 19 04:57:12.427326 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.427274    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:57:12.519683 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.519641    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:57:12.619722 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.619686    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:57:12.645738 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.645716    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:57:12.719109 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.719025    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:57:12.768101 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.768074    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffpqn\" (UniqueName: \"kubernetes.io/projected/c5fb2454-bff1-41f6-ae19-115d815cc71a-kube-api-access-ffpqn\") pod \"c5fb2454-bff1-41f6-ae19-115d815cc71a\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") "
Sep 19 04:57:12.768250 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.768153    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-metrics-certs\") pod \"c5fb2454-bff1-41f6-ae19-115d815cc71a\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") "
Sep 19 04:57:12.768337 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.768316    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5fb2454-bff1-41f6-ae19-115d815cc71a-openshift-service-ca\") pod \"c5fb2454-bff1-41f6-ae19-115d815cc71a\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") "
Sep 19 04:57:12.768396 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.768364    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-maas-api-tls\") pod \"c5fb2454-bff1-41f6-ae19-115d815cc71a\" (UID: \"c5fb2454-bff1-41f6-ae19-115d815cc71a\") "
Sep 19 04:57:12.768776 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.768713    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5fb2454-bff1-41f6-ae19-115d815cc71a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c5fb2454-bff1-41f6-ae19-115d815cc71a" (UID: "c5fb2454-bff1-41f6-ae19-115d815cc71a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:57:12.770497 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.770472    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c5fb2454-bff1-41f6-ae19-115d815cc71a" (UID: "c5fb2454-bff1-41f6-ae19-115d815cc71a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:57:12.771046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.771024    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c5fb2454-bff1-41f6-ae19-115d815cc71a" (UID: "c5fb2454-bff1-41f6-ae19-115d815cc71a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:57:12.771046 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.771036    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5fb2454-bff1-41f6-ae19-115d815cc71a-kube-api-access-ffpqn" (OuterVolumeSpecName: "kube-api-access-ffpqn") pod "c5fb2454-bff1-41f6-ae19-115d815cc71a" (UID: "c5fb2454-bff1-41f6-ae19-115d815cc71a"). InnerVolumeSpecName "kube-api-access-ffpqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:57:12.869216 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.869178    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffpqn\" (UniqueName: \"kubernetes.io/projected/c5fb2454-bff1-41f6-ae19-115d815cc71a-kube-api-access-ffpqn\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:57:12.869216 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.869210    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-metrics-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:57:12.869216 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.869222    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5fb2454-bff1-41f6-ae19-115d815cc71a-openshift-service-ca\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:57:12.869457 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.869235    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5fb2454-bff1-41f6-ae19-115d815cc71a-maas-api-tls\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 04:57:12.889860 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.889820    2569 generic.go:356] "Generic (PLEG): container finished" podID="c5fb2454-bff1-41f6-ae19-115d815cc71a" containerID="d3c88ca2e3ac716bb09e4dbf0bb814937dccda0a458347ecd4a62436f021a63b" exitCode=0
Sep 19 04:57:12.890013 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.889871    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"
Sep 19 04:57:12.890013 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.889875    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9" event={"ID":"c5fb2454-bff1-41f6-ae19-115d815cc71a","Type":"ContainerDied","Data":"d3c88ca2e3ac716bb09e4dbf0bb814937dccda0a458347ecd4a62436f021a63b"}
Sep 19 04:57:12.890013 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.889925    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9" event={"ID":"c5fb2454-bff1-41f6-ae19-115d815cc71a","Type":"ContainerDied","Data":"0a95c40f47baf00108a38941a7c98a9ec99f0673940656c2bcd38143ecfb63c3"}
Sep 19 04:57:12.890013 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.889956    2569 scope.go:117] "RemoveContainer" containerID="d3c88ca2e3ac716bb09e4dbf0bb814937dccda0a458347ecd4a62436f021a63b"
Sep 19 04:57:12.900468 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.900449    2569 scope.go:117] "RemoveContainer" containerID="d3c88ca2e3ac716bb09e4dbf0bb814937dccda0a458347ecd4a62436f021a63b"
Sep 19 04:57:12.900774 ip-10-0-130-52 kubenswrapper[2569]: E0919 04:57:12.900734    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3c88ca2e3ac716bb09e4dbf0bb814937dccda0a458347ecd4a62436f021a63b\": container with ID starting with d3c88ca2e3ac716bb09e4dbf0bb814937dccda0a458347ecd4a62436f021a63b not found: ID does not exist" containerID="d3c88ca2e3ac716bb09e4dbf0bb814937dccda0a458347ecd4a62436f021a63b"
Sep 19 04:57:12.900844 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.900787    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c88ca2e3ac716bb09e4dbf0bb814937dccda0a458347ecd4a62436f021a63b"} err="failed to get container status \"d3c88ca2e3ac716bb09e4dbf0bb814937dccda0a458347ecd4a62436f021a63b\": rpc error: code = NotFound desc = could not find container \"d3c88ca2e3ac716bb09e4dbf0bb814937dccda0a458347ecd4a62436f021a63b\": container with ID starting with d3c88ca2e3ac716bb09e4dbf0bb814937dccda0a458347ecd4a62436f021a63b not found: ID does not exist"
Sep 19 04:57:12.912053 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.912031    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"]
Sep 19 04:57:12.917897 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:12.917875    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-8bbcca-6cdd586854-9x8j9"]
Sep 19 04:57:13.073804 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:13.073662    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:57:13.174645 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:13.174605    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:57:14.539902 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:14.539866    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5fb2454-bff1-41f6-ae19-115d815cc71a" path="/var/lib/kubelet/pods/c5fb2454-bff1-41f6-ae19-115d815cc71a/volumes"
Sep 19 04:57:19.576560 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:19.576515    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:57:19.680919 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:19.680882    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:57:19.911545 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:19.911509    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:57:40.901510 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:57:40.901480    2569 scope.go:117] "RemoveContainer" containerID="d856d86abfd9f934a39568475f1d69198cd93da0adbeb215df173bd2ce50136c"
Sep 19 04:58:03.320546 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:58:03.320508    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:58:03.387066 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:58:03.387029    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:58:45.159395 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:58:45.159282    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:58:47.270394 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:58:47.270354    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 04:59:27.843343 ip-10-0-130-52 kubenswrapper[2569]: I0919 04:59:27.843275    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 05:00:02.760637 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:00:02.760551    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 05:00:06.098640 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:00:06.098594    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 05:02:15.901299 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:02:15.901225    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 05:02:27.038541 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:02:27.038504    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 05:02:36.838798 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:02:36.838762    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 05:03:02.131077 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:02.130974    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 05:03:07.335539 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:07.335505    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 05:03:27.518333 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:27.518293    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 05:03:30.885394 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885347    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"]
Sep 19 05:03:30.885812 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885708    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" containerName="istio-proxy"
Sep 19 05:03:30.885812 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885720    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" containerName="istio-proxy"
Sep 19 05:03:30.885812 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885730    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a8416ba-4589-4c2b-8fca-79c83bcc7448" containerName="maas-api"
Sep 19 05:03:30.885812 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885735    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a8416ba-4589-4c2b-8fca-79c83bcc7448" containerName="maas-api"
Sep 19 05:03:30.885812 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885763    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5fb2454-bff1-41f6-ae19-115d815cc71a" containerName="maas-api"
Sep 19 05:03:30.885812 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885769    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5fb2454-bff1-41f6-ae19-115d815cc71a" containerName="maas-api"
Sep 19 05:03:30.885812 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885777    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99330ae9-a490-431c-ac75-cd65ad6828e8" containerName="payload-processing"
Sep 19 05:03:30.885812 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885782    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="99330ae9-a490-431c-ac75-cd65ad6828e8" containerName="payload-processing"
Sep 19 05:03:30.885812 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885789    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1298451-7498-4914-8033-983877899c0d" containerName="payload-processing"
Sep 19 05:03:30.885812 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885794    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1298451-7498-4914-8033-983877899c0d" containerName="payload-processing"
Sep 19 05:03:30.885812 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885806    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ab80788-d0fc-4a29-9221-2dbbe09cad92" containerName="maas-api"
Sep 19 05:03:30.885812 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885810    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ab80788-d0fc-4a29-9221-2dbbe09cad92" containerName="maas-api"
Sep 19 05:03:30.885812 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885817    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c" containerName="payload-pre-processing"
Sep 19 05:03:30.886318 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885822    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c" containerName="payload-pre-processing"
Sep 19 05:03:30.886318 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885889    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ab80788-d0fc-4a29-9221-2dbbe09cad92" containerName="maas-api"
Sep 19 05:03:30.886318 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885896    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" containerName="istio-proxy"
Sep 19 05:03:30.886318 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885903    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5fb2454-bff1-41f6-ae19-115d815cc71a" containerName="maas-api"
Sep 19 05:03:30.886318 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885910    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b31b46e8-bd2f-4d0c-9c4d-9dc3adbb8b4c" containerName="payload-pre-processing"
Sep 19 05:03:30.886318 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885915    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" containerName="istio-proxy"
Sep 19 05:03:30.886318 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885920    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a8416ba-4589-4c2b-8fca-79c83bcc7448" containerName="maas-api"
Sep 19 05:03:30.886318 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885926    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="99330ae9-a490-431c-ac75-cd65ad6828e8" containerName="payload-processing"
Sep 19 05:03:30.886318 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.885934    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1298451-7498-4914-8033-983877899c0d" containerName="payload-processing"
Sep 19 05:03:30.888941 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.888912    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:30.903668 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.903641    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"]
Sep 19 05:03:30.954312 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.954278    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55294e92-1528-4bf6-8b1e-845242c1d0d7-maas-api-tls\") pod \"maas-api-d47c7cd7c-frsj5\" (UID: \"55294e92-1528-4bf6-8b1e-845242c1d0d7\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:30.954493 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.954335    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhp89\" (UniqueName: \"kubernetes.io/projected/55294e92-1528-4bf6-8b1e-845242c1d0d7-kube-api-access-mhp89\") pod \"maas-api-d47c7cd7c-frsj5\" (UID: \"55294e92-1528-4bf6-8b1e-845242c1d0d7\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:30.954493 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.954434    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55294e92-1528-4bf6-8b1e-845242c1d0d7-metrics-certs\") pod \"maas-api-d47c7cd7c-frsj5\" (UID: \"55294e92-1528-4bf6-8b1e-845242c1d0d7\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:30.954599 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:30.954551    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55294e92-1528-4bf6-8b1e-845242c1d0d7-openshift-service-ca\") pod \"maas-api-d47c7cd7c-frsj5\" (UID: \"55294e92-1528-4bf6-8b1e-845242c1d0d7\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:31.055615 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:31.055572    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55294e92-1528-4bf6-8b1e-845242c1d0d7-openshift-service-ca\") pod \"maas-api-d47c7cd7c-frsj5\" (UID: \"55294e92-1528-4bf6-8b1e-845242c1d0d7\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:31.055615 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:31.055624    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55294e92-1528-4bf6-8b1e-845242c1d0d7-maas-api-tls\") pod \"maas-api-d47c7cd7c-frsj5\" (UID: \"55294e92-1528-4bf6-8b1e-845242c1d0d7\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:31.055910 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:31.055660    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhp89\" (UniqueName: \"kubernetes.io/projected/55294e92-1528-4bf6-8b1e-845242c1d0d7-kube-api-access-mhp89\") pod \"maas-api-d47c7cd7c-frsj5\" (UID: \"55294e92-1528-4bf6-8b1e-845242c1d0d7\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:31.055910 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:31.055706    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55294e92-1528-4bf6-8b1e-845242c1d0d7-metrics-certs\") pod \"maas-api-d47c7cd7c-frsj5\" (UID: \"55294e92-1528-4bf6-8b1e-845242c1d0d7\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:31.056371 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:31.056350    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55294e92-1528-4bf6-8b1e-845242c1d0d7-openshift-service-ca\") pod \"maas-api-d47c7cd7c-frsj5\" (UID: \"55294e92-1528-4bf6-8b1e-845242c1d0d7\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:31.058358 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:31.058327    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55294e92-1528-4bf6-8b1e-845242c1d0d7-maas-api-tls\") pod \"maas-api-d47c7cd7c-frsj5\" (UID: \"55294e92-1528-4bf6-8b1e-845242c1d0d7\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:31.058483 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:31.058367    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55294e92-1528-4bf6-8b1e-845242c1d0d7-metrics-certs\") pod \"maas-api-d47c7cd7c-frsj5\" (UID: \"55294e92-1528-4bf6-8b1e-845242c1d0d7\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:31.065267 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:31.065247    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhp89\" (UniqueName: \"kubernetes.io/projected/55294e92-1528-4bf6-8b1e-845242c1d0d7-kube-api-access-mhp89\") pod \"maas-api-d47c7cd7c-frsj5\" (UID: \"55294e92-1528-4bf6-8b1e-845242c1d0d7\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:31.200266 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:31.200161    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:31.476879 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:31.476852    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"]
Sep 19 05:03:31.479037 ip-10-0-130-52 kubenswrapper[2569]: W0919 05:03:31.479010    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55294e92_1528_4bf6_8b1e_845242c1d0d7.slice/crio-4c214ddba9c40c5faf28d8cc2f746a15433c9802ee9192e9b34bc6193f326a95 WatchSource:0}: Error finding container 4c214ddba9c40c5faf28d8cc2f746a15433c9802ee9192e9b34bc6193f326a95: Status 404 returned error can't find the container with id 4c214ddba9c40c5faf28d8cc2f746a15433c9802ee9192e9b34bc6193f326a95
Sep 19 05:03:31.480465 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:31.480440    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 05:03:31.718894 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:31.718850    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5" event={"ID":"55294e92-1528-4bf6-8b1e-845242c1d0d7","Type":"ContainerStarted","Data":"4c214ddba9c40c5faf28d8cc2f746a15433c9802ee9192e9b34bc6193f326a95"}
Sep 19 05:03:32.725089 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:32.725053    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5" event={"ID":"55294e92-1528-4bf6-8b1e-845242c1d0d7","Type":"ContainerStarted","Data":"44a9c55245b310b8254d2ede537bdac2b573c62019db427a2b30d303864cb40a"}
Sep 19 05:03:32.725530 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:32.725161    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:32.749342 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:32.749293    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5" podStartSLOduration=2.363350137 podStartE2EDuration="2.749277703s" totalImagesPullingTime="385.927566ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 05:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 05:03:32.748020435 +0000 UTC m=+2992.726216839" watchObservedRunningTime="2026-09-19 05:03:32.749277703 +0000 UTC m=+2992.727474093"
Sep 19 05:03:38.735532 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:38.735500    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-frsj5"
Sep 19 05:03:38.784003 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:38.783970    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"]
Sep 19 05:03:38.784200 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:38.784156    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q" podUID="8044e0c9-dc99-49ed-b64b-b81b64e7b53b" containerName="maas-api" containerID="cri-o://033897e8cf2132cb13af709007a3aa5d316b36f7d4b7ff76ea93496ad22293c9" gracePeriod=30
Sep 19 05:03:40.025056 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.025025    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 05:03:40.139961 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.139927    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thxp2\" (UniqueName: \"kubernetes.io/projected/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-kube-api-access-thxp2\") pod \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") "
Sep 19 05:03:40.140148 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.139994    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-openshift-service-ca\") pod \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") "
Sep 19 05:03:40.140148 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.140046    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-maas-api-tls\") pod \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") "
Sep 19 05:03:40.140148 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.140071    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-metrics-certs\") pod \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\" (UID: \"8044e0c9-dc99-49ed-b64b-b81b64e7b53b\") "
Sep 19 05:03:40.140412 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.140379    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8044e0c9-dc99-49ed-b64b-b81b64e7b53b" (UID: "8044e0c9-dc99-49ed-b64b-b81b64e7b53b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 05:03:40.142373 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.142348    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8044e0c9-dc99-49ed-b64b-b81b64e7b53b" (UID: "8044e0c9-dc99-49ed-b64b-b81b64e7b53b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 05:03:40.142482 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.142404    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8044e0c9-dc99-49ed-b64b-b81b64e7b53b" (UID: "8044e0c9-dc99-49ed-b64b-b81b64e7b53b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 05:03:40.142482 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.142423    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-kube-api-access-thxp2" (OuterVolumeSpecName: "kube-api-access-thxp2") pod "8044e0c9-dc99-49ed-b64b-b81b64e7b53b" (UID: "8044e0c9-dc99-49ed-b64b-b81b64e7b53b"). InnerVolumeSpecName "kube-api-access-thxp2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 05:03:40.241121 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.241072    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thxp2\" (UniqueName: \"kubernetes.io/projected/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-kube-api-access-thxp2\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 05:03:40.241121 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.241114    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-openshift-service-ca\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 05:03:40.241121 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.241124    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-maas-api-tls\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 05:03:40.241121 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.241133    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8044e0c9-dc99-49ed-b64b-b81b64e7b53b-metrics-certs\") on node \"ip-10-0-130-52.ec2.internal\" DevicePath \"\""
Sep 19 05:03:40.765302 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.765270    2569 generic.go:356] "Generic (PLEG): container finished" podID="8044e0c9-dc99-49ed-b64b-b81b64e7b53b" containerID="033897e8cf2132cb13af709007a3aa5d316b36f7d4b7ff76ea93496ad22293c9" exitCode=0
Sep 19 05:03:40.765488 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.765330    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"
Sep 19 05:03:40.765488 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.765353    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q" event={"ID":"8044e0c9-dc99-49ed-b64b-b81b64e7b53b","Type":"ContainerDied","Data":"033897e8cf2132cb13af709007a3aa5d316b36f7d4b7ff76ea93496ad22293c9"}
Sep 19 05:03:40.765488 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.765404    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q" event={"ID":"8044e0c9-dc99-49ed-b64b-b81b64e7b53b","Type":"ContainerDied","Data":"dc7ca9b4bdc0f63fd35af469ff07d5ae7b4914b409197e9beb2451be1e51c4cf"}
Sep 19 05:03:40.765488 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.765425    2569 scope.go:117] "RemoveContainer" containerID="033897e8cf2132cb13af709007a3aa5d316b36f7d4b7ff76ea93496ad22293c9"
Sep 19 05:03:40.774511 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.774495    2569 scope.go:117] "RemoveContainer" containerID="033897e8cf2132cb13af709007a3aa5d316b36f7d4b7ff76ea93496ad22293c9"
Sep 19 05:03:40.774817 ip-10-0-130-52 kubenswrapper[2569]: E0919 05:03:40.774796    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"033897e8cf2132cb13af709007a3aa5d316b36f7d4b7ff76ea93496ad22293c9\": container with ID starting with 033897e8cf2132cb13af709007a3aa5d316b36f7d4b7ff76ea93496ad22293c9 not found: ID does not exist" containerID="033897e8cf2132cb13af709007a3aa5d316b36f7d4b7ff76ea93496ad22293c9"
Sep 19 05:03:40.774874 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.774825    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"033897e8cf2132cb13af709007a3aa5d316b36f7d4b7ff76ea93496ad22293c9"} err="failed to get container status \"033897e8cf2132cb13af709007a3aa5d316b36f7d4b7ff76ea93496ad22293c9\": rpc error: code = NotFound desc = could not find container \"033897e8cf2132cb13af709007a3aa5d316b36f7d4b7ff76ea93496ad22293c9\": container with ID starting with 033897e8cf2132cb13af709007a3aa5d316b36f7d4b7ff76ea93496ad22293c9 not found: ID does not exist"
Sep 19 05:03:40.783590 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.783568    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"]
Sep 19 05:03:40.787655 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:40.787628    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-68cb6dd889-mkp4q"]
Sep 19 05:03:42.538534 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:42.538496    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8044e0c9-dc99-49ed-b64b-b81b64e7b53b" path="/var/lib/kubelet/pods/8044e0c9-dc99-49ed-b64b-b81b64e7b53b/volumes"
Sep 19 05:03:44.734557 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:03:44.734516    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 05:04:23.770329 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:23.770297    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7db885c774-tlnqv_fd8a7025-a9bc-4827-a89e-a9994cdc0288/manager/0.log"
Sep 19 05:04:24.110628 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:24.110556    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-d47c7cd7c-frsj5_55294e92-1528-4bf6-8b1e-845242c1d0d7/maas-api/0.log"
Sep 19 05:04:26.719321 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:26.719291    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6644598669-gvdvd_f6d96e68-1f9b-4607-8b11-a12822c777e7/kube-auth-proxy/0.log"
Sep 19 05:04:28.012298 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:28.012266    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-698db7d589-qqqxg_0b06bbaf-22b8-497b-a20e-f0271782bf18/main/0.log"
Sep 19 05:04:28.468321 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:28.468294    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5757f658bb-ds7b5_5dd41c47-e07d-4cbf-8468-0fc493c0bea5/main/0.log"
Sep 19 05:04:34.128427 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:34.128329    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 05:04:34.229321 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:34.229289    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log" limit=1024
Sep 19 05:04:37.253449 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:37.253420    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9msr4_9969efc8-3073-4e0d-a4ef-cd1c6bb87409/global-pull-secret-syncer/0.log"
Sep 19 05:04:37.392888 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:37.392856    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nlbdx_a48add2c-d95d-4119-8461-b322d6e6b9ee/konnectivity-agent/0.log"
Sep 19 05:04:37.551199 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:37.551117    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-52.ec2.internal_62ca4fb25798dbdda7b410bc15fd658c/haproxy/0.log"
Sep 19 05:04:44.688341 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:44.688308    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-nz85f_56c0a386-20f4-4ad1-8b1e-9040d461cf1f/cluster-monitoring-operator/0.log"
Sep 19 05:04:44.718540 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:44.718508    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-wkbrh_91acc5d8-f9ae-46b4-849e-956c1b633b42/kube-state-metrics/0.log"
Sep 19 05:04:44.740188 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:44.740164    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-wkbrh_91acc5d8-f9ae-46b4-849e-956c1b633b42/kube-rbac-proxy-main/0.log"
Sep 19 05:04:44.766938 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:44.766864    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-wkbrh_91acc5d8-f9ae-46b4-849e-956c1b633b42/kube-rbac-proxy-self/0.log"
Sep 19 05:04:44.861358 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:44.861320    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8x6mv_ef666e8f-6ef2-46ed-b997-3724db846512/node-exporter/0.log"
Sep 19 05:04:44.886821 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:44.886795    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8x6mv_ef666e8f-6ef2-46ed-b997-3724db846512/kube-rbac-proxy/0.log"
Sep 19 05:04:44.916557 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:44.916530    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8x6mv_ef666e8f-6ef2-46ed-b997-3724db846512/init-textfile/0.log"
Sep 19 05:04:45.126159 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:45.126087    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-9rxxp_5af773fa-b943-4f5a-9c14-ba0bf6e8aa07/kube-rbac-proxy-main/0.log"
Sep 19 05:04:45.151414 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:45.151392    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-9rxxp_5af773fa-b943-4f5a-9c14-ba0bf6e8aa07/kube-rbac-proxy-self/0.log"
Sep 19 05:04:45.177641 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:45.177612    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-86c5bc79d6-9rxxp_5af773fa-b943-4f5a-9c14-ba0bf6e8aa07/openshift-state-metrics/0.log"
Sep 19 05:04:45.216654 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:45.216626    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_067a46b1-bcd6-4b8f-b676-c10a28c4102d/prometheus/0.log"
Sep 19 05:04:45.239714 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:45.239684    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_067a46b1-bcd6-4b8f-b676-c10a28c4102d/config-reloader/0.log"
Sep 19 05:04:45.262610 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:45.262588    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_067a46b1-bcd6-4b8f-b676-c10a28c4102d/thanos-sidecar/0.log"
Sep 19 05:04:45.287781 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:45.287736    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_067a46b1-bcd6-4b8f-b676-c10a28c4102d/kube-rbac-proxy-web/0.log"
Sep 19 05:04:45.314517 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:45.314492    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_067a46b1-bcd6-4b8f-b676-c10a28c4102d/kube-rbac-proxy/0.log"
Sep 19 05:04:45.345333 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:45.345309    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_067a46b1-bcd6-4b8f-b676-c10a28c4102d/kube-rbac-proxy-thanos/0.log"
Sep 19 05:04:45.402766 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:45.402733    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_067a46b1-bcd6-4b8f-b676-c10a28c4102d/init-config-reloader/0.log"
Sep 19 05:04:45.505171 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:45.505147    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5c6747dc7b-hqfrk_91e0a3bc-8cf2-450f-8ee6-6ec648efec4b/prometheus-operator-admission-webhook/0.log"
Sep 19 05:04:47.284089 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.284051    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"]
Sep 19 05:04:47.284482 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.284398    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" containerName="istio-proxy"
Sep 19 05:04:47.284482 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.284409    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b93f3e4-ea9b-428c-9fe3-7287ea100079" containerName="istio-proxy"
Sep 19 05:04:47.284482 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.284435    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8044e0c9-dc99-49ed-b64b-b81b64e7b53b" containerName="maas-api"
Sep 19 05:04:47.284482 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.284440    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8044e0c9-dc99-49ed-b64b-b81b64e7b53b" containerName="maas-api"
Sep 19 05:04:47.284621 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.284495    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8044e0c9-dc99-49ed-b64b-b81b64e7b53b" containerName="maas-api"
Sep 19 05:04:47.287795 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.287772    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.290356 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.290318    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zp5t8\"/\"kube-root-ca.crt\""
Sep 19 05:04:47.290356 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.290342    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zp5t8\"/\"openshift-service-ca.crt\""
Sep 19 05:04:47.290519 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.290329    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zp5t8\"/\"default-dockercfg-b5t6l\""
Sep 19 05:04:47.301837 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.301810    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"]
Sep 19 05:04:47.350164 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.350128    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-lib-modules\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.350355 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.350173    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-proc\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.350355 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.350262    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-sys\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.350355 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.350331    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-podres\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.350483 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.350386    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8ljb\" (UniqueName: \"kubernetes.io/projected/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-kube-api-access-n8ljb\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.451142 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.451111    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-podres\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.451314 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.451164    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8ljb\" (UniqueName: \"kubernetes.io/projected/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-kube-api-access-n8ljb\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.451314 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.451233    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-lib-modules\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.451314 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.451260    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-proc\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.451314 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.451297    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-sys\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.451314 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.451300    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-podres\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.451532 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.451359    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-lib-modules\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.451532 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.451395    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-proc\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.451532 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.451403    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-sys\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.460456 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.460432    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8ljb\" (UniqueName: \"kubernetes.io/projected/c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d-kube-api-access-n8ljb\") pod \"perf-node-gather-daemonset-q6tdl\" (UID: \"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.597972 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.597882    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:47.870818 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:47.870787    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"]
Sep 19 05:04:47.873452 ip-10-0-130-52 kubenswrapper[2569]: W0919 05:04:47.873421    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc5f7fe9f_fa1f_4b70_b8af_230fe3d91e6d.slice/crio-35b5e18dd5993a16b9e02a0dbdcbbea5387c39826a226f927196735bc00329e5 WatchSource:0}: Error finding container 35b5e18dd5993a16b9e02a0dbdcbbea5387c39826a226f927196735bc00329e5: Status 404 returned error can't find the container with id 35b5e18dd5993a16b9e02a0dbdcbbea5387c39826a226f927196735bc00329e5
Sep 19 05:04:48.082075 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:48.082039    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl" event={"ID":"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d","Type":"ContainerStarted","Data":"440132dd216e263faf612e950ea9691ff522c0c6ae38411e0ce5cf4004625469"}
Sep 19 05:04:48.082256 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:48.082091    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl" event={"ID":"c5f7fe9f-fa1f-4b70-b8af-230fe3d91e6d","Type":"ContainerStarted","Data":"35b5e18dd5993a16b9e02a0dbdcbbea5387c39826a226f927196735bc00329e5"}
Sep 19 05:04:48.082256 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:48.082133    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:48.107788 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:48.102336    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl" podStartSLOduration=1.102315159 podStartE2EDuration="1.102315159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 05:04:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 05:04:48.099835348 +0000 UTC m=+3068.078031732" watchObservedRunningTime="2026-09-19 05:04:48.102315159 +0000 UTC m=+3068.080511550"
Sep 19 05:04:49.050297 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:49.050268    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5c4db8bdf9-ztdhc_86afa60b-1dab-4b7a-9874-778f4b2aefcb/volume-data-source-validator/0.log"
Sep 19 05:04:50.119878 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:50.119851    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kscs4_d6e6655e-0f9b-4a74-8846-79c07b83f45a/dns/0.log"
Sep 19 05:04:50.147007 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:50.146983    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kscs4_d6e6655e-0f9b-4a74-8846-79c07b83f45a/kube-rbac-proxy/0.log"
Sep 19 05:04:50.305136 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:50.305110    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7hp9_70dadf06-e872-445e-9238-112acc1a782f/dns-node-resolver/0.log"
Sep 19 05:04:50.907050 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:50.907015    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6dd6b64c5d-5fzq7_26ad0ea5-7db9-4dc8-b574-a1c12434ee5d/registry/0.log"
Sep 19 05:04:50.928677 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:50.928621    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-25lfw_80adac8f-4c32-43bf-8ecc-e127f28b7b7a/node-ca/0.log"
Sep 19 05:04:52.518721 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:52.518687    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6644598669-gvdvd_f6d96e68-1f9b-4607-8b11-a12822c777e7/kube-auth-proxy/0.log"
Sep 19 05:04:53.692595 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:53.692570    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5clmr_0d160e30-9094-4610-bb26-38565d5a063c/serve-healthcheck-canary/0.log"
Sep 19 05:04:54.098730 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:54.098653    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-q6tdl"
Sep 19 05:04:54.354409 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:54.354204    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pll6q_a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f/kube-rbac-proxy/0.log"
Sep 19 05:04:54.372534 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:54.372504    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pll6q_a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f/exporter/0.log"
Sep 19 05:04:54.396355 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:54.396330    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pll6q_a3e2b98a-c67f-4b9e-9b3c-8a434de3be0f/extractor/0.log"
Sep 19 05:04:57.243731 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:57.243704    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-fc5f7b9db-jntql_3164a1ad-65fd-4997-8f7b-a70905ece297/manager/0.log"
Sep 19 05:04:57.270411 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:57.270386    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-fc5f7b9db-jntql_3164a1ad-65fd-4997-8f7b-a70905ece297/copy-manifests/0.log"
Sep 19 05:04:57.397103 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:57.397077    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6644598669-gvdvd_f6d96e68-1f9b-4607-8b11-a12822c777e7/kube-auth-proxy/0.log"
Sep 19 05:04:58.582202 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:58.582176    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-controller-manager-cb8bdffdf-cxjp9_b117ee71-62fb-4917-8f04-99ae8473a3da/manager/0.log"
Sep 19 05:04:58.611483 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:58.611414    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-56d489b4b8-89jnp_48b71620-d109-47a5-bc24-a1d6fcded750/jobset-operator/0.log"
Sep 19 05:04:59.623864 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:59.623834    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6644598669-gvdvd_f6d96e68-1f9b-4607-8b11-a12822c777e7/kube-auth-proxy/0.log"
Sep 19 05:04:59.992369 ip-10-0-130-52 kubenswrapper[2569]: I0919 05:04:59.992336    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7db885c774-tlnqv_fd8a7025-a9bc-4827-a89e-a9994cdc0288/manager/0.log"