Sep 16 12:38:36.320771 ip-10-0-128-195 systemd[1]: Starting Kubernetes Kubelet...
Sep 16 12:38:36.699505 ip-10-0-128-195 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:38:36.699505 ip-10-0-128-195 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 16 12:38:36.699505 ip-10-0-128-195 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:38:36.699505 ip-10-0-128-195 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 16 12:38:36.699505 ip-10-0-128-195 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 16 12:38:36.701193 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.701108    2549 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 16 12:38:36.704661 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704644    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:38:36.704661 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704660    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:38:36.704661 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704663    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704667    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704670    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704673    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704676    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704679    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704682    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704684    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704687    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704690    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704693    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704695    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704698    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704701    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704704    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704706    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704709    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704714    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704717    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:38:36.704770 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704721    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704724    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704727    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704729    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704732    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704734    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704738    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704741    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704743    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704746    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704748    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704751    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704753    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704756    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704758    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704762    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704765    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704768    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704770    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704774    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:38:36.705228 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704776    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704779    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704782    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704784    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704787    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704790    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704792    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704795    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704797    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704800    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704802    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704805    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704808    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704811    2549 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704813    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704816    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704818    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704821    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704824    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704827    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:38:36.705782 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704829    2549 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704832    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704834    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704837    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704840    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704842    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704848    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704852    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704855    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704858    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704861    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704864    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704866    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704869    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704872    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704874    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704877    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704879    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704882    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:38:36.706305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704884    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704887    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704890    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704892    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704895    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704897    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704900    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704902    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704905    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704908    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704911    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704915    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704919    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704922    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704925    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704928    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704931    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704933    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:38:36.706792 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.704936    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:38:36.708143 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708121    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:38:36.708143 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708138    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:38:36.708143 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708143    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708151    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708158    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708162    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708166    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708170    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708174    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708178    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708182    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708186    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708189    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708193    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708197    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708201    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708204    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708208    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708213    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708217    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708221    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:38:36.708347 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708225    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708229    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708233    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708237    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708241    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708245    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708249    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708253    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708257    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708261    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708265    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708269    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708274    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708278    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708283    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708288    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708292    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708297    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708301    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:38:36.709184 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708305    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708309    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708314    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708319    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708323    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708327    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708331    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708335    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708339    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708345    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708349    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708353    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708358    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708363    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708367    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708373    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708377    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708382    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708386    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708390    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:38:36.710134 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708394    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708398    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708402    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708406    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708413    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708419    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708424    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708428    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708433    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708438    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708442    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708446    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708450    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708454    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708458    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708464    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708468    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708473    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708494    2549 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:38:36.711021 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708498    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708502    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708506    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708510    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708517    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708521    2549 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708525    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708530    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708536    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708542    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708547    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708551    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708555    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708560    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708565    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708569    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708573    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708578    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708582    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.708592    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:38:36.711634 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709194    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709202    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709207    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709211    2549 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709215    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709220    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709224    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709228    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709232    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709238    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709243    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709248    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709252    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709257    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709264    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709270    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709276    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709281    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709285    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709290    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:38:36.712210 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709295    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709300    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709304    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709309    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709314    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709318    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709323    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709327    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709331    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709335    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709339    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709343    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709348    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709353    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709357    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709361    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709366    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709371    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709375    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:38:36.712764 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709379    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709383    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709387    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709392    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709396    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709400    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709404    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709409    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709413    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709417    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709422    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709426    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709433    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709439    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709444    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709449    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709454    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709459    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709465    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:38:36.713372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709469    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709490    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709496    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709501    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709505    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709510    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709514    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709518    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709523    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709527    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709531    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709535    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709539    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709544    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709548    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709553    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709558    2549 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709562    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709566    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709570    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:38:36.713922 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709574    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709579    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709583    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709588    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709593    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709597    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709601    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709605    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709610    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709614    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709619    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709623    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709627    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709631    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709636    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709640    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709644    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709648    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709653    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709659    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:38:36.714450 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.709664    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709766    2549 flags.go:64] FLAG: --address="0.0.0.0"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709815    2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709825    2549 flags.go:64] FLAG: --anonymous-auth="true"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709832    2549 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709838    2549 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709844    2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709850    2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709857    2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709862    2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709867    2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709872    2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709877    2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709882    2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709887    2549 flags.go:64] FLAG: --cgroup-root=""
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709892    2549 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709897    2549 flags.go:64] FLAG: --client-ca-file=""
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709903    2549 flags.go:64] FLAG: --cloud-provider="external"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709908    2549 flags.go:64] FLAG: --cluster-dns="[]"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709915    2549 flags.go:64] FLAG: --cluster-domain=""
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709920    2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709928    2549 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709933    2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709939    2549 flags.go:64] FLAG: --container-log-max-files="5"
Sep 16 12:38:36.715017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709945    2549 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709950    2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709955    2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709960    2549 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709965    2549 flags.go:64] FLAG: --contention-profiling="false"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709969    2549 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709974    2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709979    2549 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709985    2549 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709992    2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.709997    2549 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710002    2549 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710006    2549 flags.go:64] FLAG: --enable-load-reader="false"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710011    2549 flags.go:64] FLAG: --enable-server="true"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710016    2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710023    2549 flags.go:64] FLAG: --event-burst="100"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710028    2549 flags.go:64] FLAG: --event-qps="50"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710032    2549 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710037    2549 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710042    2549 flags.go:64] FLAG: --eviction-hard=""
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710048    2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710053    2549 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710058    2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710063    2549 flags.go:64] FLAG: --eviction-soft=""
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710068    2549 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 16 12:38:36.715668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710073    2549 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710079    2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710084    2549 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710088    2549 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710095    2549 flags.go:64] FLAG: --fail-swap-on="true"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710099    2549 flags.go:64] FLAG: --feature-gates=""
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710105    2549 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710111    2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710115    2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710120    2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710125    2549 flags.go:64] FLAG: --healthz-port="10248"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710130    2549 flags.go:64] FLAG: --help="false"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710135    2549 flags.go:64] FLAG: --hostname-override="ip-10-0-128-195.ec2.internal"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710139    2549 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710144    2549 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710153    2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710159    2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710164    2549 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710169    2549 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710174    2549 flags.go:64] FLAG: --image-service-endpoint=""
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710179    2549 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710183    2549 flags.go:64] FLAG: --kube-api-burst="100"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710188    2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710193    2549 flags.go:64] FLAG: --kube-api-qps="50"
Sep 16 12:38:36.716292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710198    2549 flags.go:64] FLAG: --kube-reserved=""
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710203    2549 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710207    2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710212    2549 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710218    2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710223    2549 flags.go:64] FLAG: --lock-file=""
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710228    2549 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710233    2549 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710238    2549 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710253    2549 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710259    2549 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710264    2549 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710272    2549 flags.go:64] FLAG: --logging-format="text"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710277    2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710283    2549 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710287    2549 flags.go:64] FLAG: --manifest-url=""
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710292    2549 flags.go:64] FLAG: --manifest-url-header=""
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710299    2549 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710304    2549 flags.go:64] FLAG: --max-open-files="1000000"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710311    2549 flags.go:64] FLAG: --max-pods="110"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710316    2549 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710321    2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710325    2549 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710333    2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710338    2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 16 12:38:36.716923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710343    2549 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710348    2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710360    2549 flags.go:64] FLAG: --node-status-max-images="50"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710365    2549 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710370    2549 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710374    2549 flags.go:64] FLAG: --pod-cidr=""
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710380    2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710389    2549 flags.go:64] FLAG: --pod-manifest-path=""
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710394    2549 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710399    2549 flags.go:64] FLAG: --pods-per-core="0"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710403    2549 flags.go:64] FLAG: --port="10250"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710408    2549 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710413    2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ae808da9107c90f4"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710419    2549 flags.go:64] FLAG: --qos-reserved=""
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710425    2549 flags.go:64] FLAG: --read-only-port="10255"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710429    2549 flags.go:64] FLAG: --register-node="true"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710434    2549 flags.go:64] FLAG: --register-with-taints=""
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710440    2549 flags.go:64] FLAG: --registry-burst="10"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710446    2549 flags.go:64] FLAG: --registry-qps="5"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710450    2549 flags.go:64] FLAG: --reserved-cpus=""
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710457    2549 flags.go:64] FLAG: --reserved-memory=""
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710463    2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710468    2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710473    2549 flags.go:64] FLAG: --rotate-certificates="false"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710495    2549 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 16 12:38:36.717633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710500    2549 flags.go:64] FLAG: --runonce="false"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710504    2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710509    2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710514    2549 flags.go:64] FLAG: --seccomp-default="false"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710518    2549 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710525    2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710529    2549 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710535    2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710540    2549 flags.go:64] FLAG: --storage-driver-password="root"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710545    2549 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710549    2549 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710554    2549 flags.go:64] FLAG: --storage-driver-user="root"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710559    2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710564    2549 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710568    2549 flags.go:64] FLAG: --system-cgroups=""
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710573    2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710583    2549 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710587    2549 flags.go:64] FLAG: --tls-cert-file=""
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710592    2549 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710599    2549 flags.go:64] FLAG: --tls-min-version=""
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710604    2549 flags.go:64] FLAG: --tls-private-key-file=""
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710608    2549 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710613    2549 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710618    2549 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710623    2549 flags.go:64] FLAG: --v="2"
Sep 16 12:38:36.718235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710629    2549 flags.go:64] FLAG: --version="false"
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710636    2549 flags.go:64] FLAG: --vmodule=""
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710644    2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.710649    2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710833    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710840    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710845    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710850    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710854    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710858    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710863    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710867    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710873    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710877    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710882    2549 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710886    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710890    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710894    2549 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710899    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710904    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:38:36.718903 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710910    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710915    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710922    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710928    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710933    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710937    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710941    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710945    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710949    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710953    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710958    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710962    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710966    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710970    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710977    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710981    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710985    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710989    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710994    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:38:36.719400 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.710998    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711002    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711006    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711010    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711014    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711020    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711024    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711027    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711031    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711035    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711039    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711043    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711047    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711051    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711055    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711059    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711064    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711068    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711072    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711077    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:38:36.719878 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711081    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711085    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711089    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711093    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711097    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711101    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711105    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711111    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711117    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711121    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711126    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711130    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711134    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711138    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711143    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711147    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711152    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711159    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711163    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711167    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:38:36.720372 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711171    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711175    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711179    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711183    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711187    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711194    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711200    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711205    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711209    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711213    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711218    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711222    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711226    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711230    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711234    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711238    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711242    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711247    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711251    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:38:36.720943 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711256    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:38:36.721405 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711260    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:38:36.721405 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711267    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:38:36.721405 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711271    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:38:36.721405 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.711276    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:38:36.721405 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.711955    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:38:36.721405 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.718810    2549 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 16 12:38:36.721405 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.718825    2549 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 16 12:38:36.721405 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.719975    2549 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 16 12:38:36.721405 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.719982    2549 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 16 12:38:36.721405 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720054    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:38:36.721405 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720059    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:38:36.721405 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720062    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:38:36.721405 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720065    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:38:36.721405 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720070    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720074    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720077    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720080    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720084    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720086    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720090    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720093    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720096    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720098    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720101    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720104    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720107    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720110    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720112    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720115    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720118    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720121    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720123    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720127    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:38:36.721777 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720130    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720132    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720135    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720138    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720142    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720148    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720151    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720154    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720156    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720159    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720162    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720164    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720167    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720170    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720172    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720175    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720178    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720180    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720183    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720186    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:38:36.722294 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720188    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720192    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720195    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720199    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720202    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720205    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720207    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720210    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720213    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720216    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720219    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720221    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720224    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720227    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720229    2549 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720232    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720236    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720238    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720242    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720244    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:38:36.722801 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720247    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720250    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720252    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720255    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720257    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720260    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720262    2549 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720265    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720267    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720270    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720272    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720275    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720277    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720280    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720282    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720285    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720287    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720291    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720294    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720298    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:38:36.723290 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720300    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720303    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720305    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720308    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720310    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720313    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720315    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720318    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720321    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720323    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720326    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720332    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720335    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720337    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720340    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:38:36.723788 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.720345    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720457    2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720462    2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720465    2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720468    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720471    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720488    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720492    2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720495    2549 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720500    2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720503    2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720506    2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720509    2549 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720512    2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720515    2549 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720517    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720520    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720523    2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720525    2549 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 16 12:38:36.724163 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720528    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720531    2549 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720534    2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720536    2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720539    2549 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720541    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720544    2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720547    2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720550    2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720553    2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720556    2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720559    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720562    2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720564    2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720567    2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720569    2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720572    2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720575    2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720577    2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720580    2549 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 16 12:38:36.724643 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720582    2549 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720585    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720598    2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720601    2549 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720604    2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720606    2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720609    2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720612    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720615    2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720617    2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720620    2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720623    2549 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720625    2549 feature_gate.go:328] unrecognized feature gate: Example
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720628    2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720630    2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720633    2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720635    2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720638    2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720641    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720644    2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 16 12:38:36.725119 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720646    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720649    2549 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720651    2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720655    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720657    2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720660    2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720662    2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720665    2549 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720668    2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720670    2549 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720673    2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720675    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720678    2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720680    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720683    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720686    2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720688    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720691    2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720693    2549 feature_gate.go:328] unrecognized feature gate: Example2
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720696    2549 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 16 12:38:36.725740 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720698    2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720701    2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720703    2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720705    2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720708    2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720711    2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720713    2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720716    2549 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720718    2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720720    2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720723    2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720726    2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720728    2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720731    2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720733    2549 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720736    2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720739    2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720741    2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720744    2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 16 12:38:36.726300 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720748    2549 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 16 12:38:36.726828 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:36.720751    2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 16 12:38:36.726828 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.720756    2549 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 16 12:38:36.726828 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.720875    2549 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 16 12:38:36.726828 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.723363    2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 16 12:38:36.726828 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.724086    2549 server.go:1019] "Starting client certificate rotation"
Sep 16 12:38:36.726828 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.724186    2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 12:38:36.726828 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.724224    2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 16 12:38:36.727008 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.726924    2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 12:38:36.728061 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.728043    2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 16 12:38:36.736873 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.736855    2549 log.go:25] "Validated CRI v1 runtime API"
Sep 16 12:38:36.743404 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.743380    2549 log.go:25] "Validated CRI v1 image API"
Sep 16 12:38:36.744261 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.744243    2549 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 16 12:38:36.748350 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.748327    2549 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7b90788c-d273-4d14-8bca-1c1a62a2b1e9:/dev/nvme0n1p3 e782e250-d0b1-4f95-8818-f90994c4d9fd:/dev/nvme0n1p4]
Sep 16 12:38:36.748430 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.748346    2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 16 12:38:36.754191 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.754094    2549 manager.go:216] Machine: {Timestamp:2026-09-16 12:38:36.752845185 +0000 UTC m=+0.317666268 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105698 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2808f7954e16b3f1a78892bd614b4f SystemUUID:ec2808f7-954e-16b3-f1a7-8892bd614b4f BootID:41136c0e-e1a6-463d-9682-69eea387adec Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c0:05:fe:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c0:05:fe:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:e8:4a:32:32:2b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 16 12:38:36.754191 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.754189    2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 16 12:38:36.754296 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.754263    2549 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 16 12:38:36.755566 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.755552    2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 12:38:36.757921 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.757893    2549 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 16 12:38:36.758092 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.757927    2549 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-195.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 16 12:38:36.758596 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.758586    2549 topology_manager.go:138] "Creating topology manager with none policy"
Sep 16 12:38:36.758628 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.758599    2549 container_manager_linux.go:309] "Creating device plugin manager"
Sep 16 12:38:36.758628 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.758606    2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 12:38:36.759191 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.759182    2549 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 16 12:38:36.759959 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.759950    2549 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 16 12:38:36.764185 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.764174    2549 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 12:38:36.764306 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.764296    2549 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 16 12:38:36.764350 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.764325    2549 kubelet.go:486] "Attempting to sync node with API server"
Sep 16 12:38:36.764350 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.764335    2549 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 16 12:38:36.764350 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.764348    2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 16 12:38:36.764463 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.764357    2549 kubelet.go:398] "Adding apiserver pod source"
Sep 16 12:38:36.764463 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.764365    2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 16 12:38:36.764774 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.764758    2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 12:38:36.764815 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.764788    2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 16 12:38:36.766713 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.766698    2549 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 16 12:38:36.768869 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.768855    2549 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 16 12:38:36.768931 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.768885    2549 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 16 12:38:36.770782 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.770767    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 16 12:38:36.770858 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.770786    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 16 12:38:36.770858 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.770793    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 16 12:38:36.770858 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.770798    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 16 12:38:36.770858 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.770806    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 16 12:38:36.770858 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.770812    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 16 12:38:36.770858 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.770826    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 16 12:38:36.770858 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.770831    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 16 12:38:36.770858 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.770838    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 16 12:38:36.770858 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.770843    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 16 12:38:36.770858 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.770860    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 16 12:38:36.771283 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.770866    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 16 12:38:36.771503 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.771492    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 16 12:38:36.771503 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.771503    2549 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 16 12:38:36.775045 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.775030    2549 server.go:1268] "Started kubelet"
Sep 16 12:38:36.775117 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.775075    2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 16 12:38:36.775195 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.775146    2549 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 16 12:38:36.775244 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.775232    2549 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 16 12:38:36.775792 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.775774    2549 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-195.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 16 12:38:36.775931 ip-10-0-128-195 systemd[1]: Started Kubernetes Kubelet.
Sep 16 12:38:36.778669 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:36.778633    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-195.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 16 12:38:36.778916 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.778897    2549 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 16 12:38:36.779918 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:36.779894    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 16 12:38:36.780283 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.780267    2549 server.go:310] "Adding debug handlers to kubelet server"
Sep 16 12:38:36.784761 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:36.784637    2549 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 16 12:38:36.785838 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.785818    2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l2wqm"
Sep 16 12:38:36.786059 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.786041    2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 16 12:38:36.786526 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.786512    2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 16 12:38:36.786620 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:36.786606    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-195.ec2.internal\" not found"
Sep 16 12:38:36.787053 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.787033    2549 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 16 12:38:36.787053 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.787036    2549 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 16 12:38:36.787181 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.787065    2549 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 16 12:38:36.787181 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.787115    2549 reconstruct.go:97] "Volume reconstruction finished"
Sep 16 12:38:36.787181 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.787125    2549 reconciler.go:29] "Reconciler: start to sync state"
Sep 16 12:38:36.787181 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:36.786207    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-195.ec2.internal.18d5cd7212cc9945  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-195.ec2.internal,UID:ip-10-0-128-195.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-195.ec2.internal,},FirstTimestamp:2026-09-16 12:38:36.775004485 +0000 UTC m=+0.339825572,LastTimestamp:2026-09-16 12:38:36.775004485 +0000 UTC m=+0.339825572,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-195.ec2.internal,}"
Sep 16 12:38:36.787365 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.787286    2549 factory.go:55] Registering systemd factory
Sep 16 12:38:36.787365 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.787298    2549 factory.go:223] Registration of the systemd container factory successfully
Sep 16 12:38:36.787500 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.787490    2549 factory.go:153] Registering CRI-O factory
Sep 16 12:38:36.787533 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.787503    2549 factory.go:223] Registration of the crio container factory successfully
Sep 16 12:38:36.787570 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.787545    2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 16 12:38:36.787570 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.787562    2549 factory.go:103] Registering Raw factory
Sep 16 12:38:36.787636 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.787578    2549 manager.go:1196] Started watching for new ooms in manager
Sep 16 12:38:36.787953 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.787941    2549 manager.go:349] Starting recovery of all containers
Sep 16 12:38:36.792309 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.792285    2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-l2wqm"
Sep 16 12:38:36.794553 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:36.794523    2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-195.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 16 12:38:36.794639 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:36.794610    2549 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 16 12:38:36.796297 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.796277    2549 manager.go:354] Recovery completed
Sep 16 12:38:36.801002 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.800989    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:38:36.802751 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.802736    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:38:36.802751 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.802762    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:38:36.802869 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.802775    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:38:36.804208 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.804186    2549 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 16 12:38:36.804208 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.804208    2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 16 12:38:36.804346 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.804226    2549 state_mem.go:36] "Initialized new in-memory state store"
Sep 16 12:38:36.804947 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.804921    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:38:36.805022 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:36.804846    2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-195.ec2.internal.18d5cd721473f6eb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-195.ec2.internal,UID:ip-10-0-128-195.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-195.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-195.ec2.internal,},FirstTimestamp:2026-09-16 12:38:36.802750187 +0000 UTC m=+0.367571270,LastTimestamp:2026-09-16 12:38:36.802750187 +0000 UTC m=+0.367571270,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-195.ec2.internal,}"
Sep 16 12:38:36.806561 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.806547    2549 policy_none.go:49] "None policy: Start"
Sep 16 12:38:36.806630 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.806563    2549 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 16 12:38:36.806630 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.806575    2549 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 16 12:38:36.807360 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.807338    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:38:36.807427 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.807379    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:38:36.807427 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.807393    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:38:36.808466 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.808452    2549 policy_none.go:47] "Start"
Sep 16 12:38:36.840002 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.839986    2549 manager.go:337] "Starting Device Plugin manager"
Sep 16 12:38:36.859102 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:36.840025    2549 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 16 12:38:36.859102 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.840038    2549 server.go:87] "Starting device plugin registration server"
Sep 16 12:38:36.859102 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.840363    2549 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 16 12:38:36.859102 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.840381    2549 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 16 12:38:36.859102 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.840472    2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 16 12:38:36.859102 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.840863    2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 16 12:38:36.859102 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.840876    2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 16 12:38:36.859102 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:36.841907    2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 16 12:38:36.859102 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:36.841954    2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-195.ec2.internal\" not found"
Sep 16 12:38:36.912508 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.912470    2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 16 12:38:36.913628 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.913605    2549 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 16 12:38:36.913701 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.913671    2549 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 16 12:38:36.913701 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.913698    2549 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 16 12:38:36.913796 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:36.913745    2549 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 16 12:38:36.916080 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.916064    2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:38:36.941263 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.941244    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:38:36.942078 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.942057    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:38:36.942162 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.942089    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:38:36.942162 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.942101    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:38:36.942162 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.942129    2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-195.ec2.internal"
Sep 16 12:38:36.950781 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:36.950710    2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-195.ec2.internal"
Sep 16 12:38:36.950781 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:36.950733    2549 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-195.ec2.internal\": node \"ip-10-0-128-195.ec2.internal\" not found"
Sep 16 12:38:36.977467 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:36.977443    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-195.ec2.internal\" not found"
Sep 16 12:38:37.014434 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.014404    2549 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-195.ec2.internal"]
Sep 16 12:38:37.014508 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.014495    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:38:37.015810 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.015785    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:38:37.015872 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.015819    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:38:37.015872 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.015831    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:38:37.017949 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.017937    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:38:37.018077 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.018063    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.018109 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.018094    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:38:37.018666 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.018648    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:38:37.018666 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.018669    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:38:37.018790 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.018680    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:38:37.018790 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.018698    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:38:37.018790 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.018718    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:38:37.018790 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.018732    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:38:37.020765 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.020749    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.020859 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.020774    2549 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 16 12:38:37.021448 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.021432    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasSufficientMemory"
Sep 16 12:38:37.021539 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.021455    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasNoDiskPressure"
Sep 16 12:38:37.021539 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.021469    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeHasSufficientPID"
Sep 16 12:38:37.040013 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:37.039993    2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-195.ec2.internal\" not found" node="ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.043856 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:37.043840    2549 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-195.ec2.internal\" not found" node="ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.078014 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:37.077994    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-195.ec2.internal\" not found"
Sep 16 12:38:37.089377 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.089361    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14aa34e294e3d61f5085b64dca7012c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal\" (UID: \"14aa34e294e3d61f5085b64dca7012c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.089464 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.089382    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14aa34e294e3d61f5085b64dca7012c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal\" (UID: \"14aa34e294e3d61f5085b64dca7012c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.089464 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.089400    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4cf5b75210ff49812e784216b4e945d0-config\") pod \"kube-apiserver-proxy-ip-10-0-128-195.ec2.internal\" (UID: \"4cf5b75210ff49812e784216b4e945d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.178260 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:37.178230    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-195.ec2.internal\" not found"
Sep 16 12:38:37.189519 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.189502    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14aa34e294e3d61f5085b64dca7012c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal\" (UID: \"14aa34e294e3d61f5085b64dca7012c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.189569 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.189544    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14aa34e294e3d61f5085b64dca7012c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal\" (UID: \"14aa34e294e3d61f5085b64dca7012c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.189569 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.189546    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/14aa34e294e3d61f5085b64dca7012c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal\" (UID: \"14aa34e294e3d61f5085b64dca7012c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.189633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.189571    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4cf5b75210ff49812e784216b4e945d0-config\") pod \"kube-apiserver-proxy-ip-10-0-128-195.ec2.internal\" (UID: \"4cf5b75210ff49812e784216b4e945d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.189633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.189598    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14aa34e294e3d61f5085b64dca7012c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal\" (UID: \"14aa34e294e3d61f5085b64dca7012c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.189633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.189613    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4cf5b75210ff49812e784216b4e945d0-config\") pod \"kube-apiserver-proxy-ip-10-0-128-195.ec2.internal\" (UID: \"4cf5b75210ff49812e784216b4e945d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.278938 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:37.278876    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-195.ec2.internal\" not found"
Sep 16 12:38:37.342397 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.342380    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.347201 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.347063    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.379676 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:37.379658    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-195.ec2.internal\" not found"
Sep 16 12:38:37.486050 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:37.486017    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-195.ec2.internal\" not found"
Sep 16 12:38:37.586274 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:37.586215    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-195.ec2.internal\" not found"
Sep 16 12:38:37.629311 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.629285    2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:38:37.689746 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:37.689716    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-195.ec2.internal\" not found"
Sep 16 12:38:37.725964 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.725941    2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 16 12:38:37.726347 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.726065    2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 12:38:37.726347 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.726102    2549 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 16 12:38:37.790419 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:37.790397    2549 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-195.ec2.internal\" not found"
Sep 16 12:38:37.797540 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.797511    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-15 12:33:37 +0000 UTC" deadline="2028-03-15 14:45:29.663072517 +0000 UTC"
Sep 16 12:38:37.797595 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.797539    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13106h6m51.865536257s"
Sep 16 12:38:37.824130 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.822734    2549 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:38:37.887540 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.887476    2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.898154 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.898136    2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 12:38:37.899078 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.899064    2549 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal"
Sep 16 12:38:37.910245 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.910227    2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 16 12:38:37.995647 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:37.995623    2549 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:38:38.075726 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:38.075693    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf5b75210ff49812e784216b4e945d0.slice/crio-b6f62cf41efeafc2d66d59c156c17e704ae9f450bab2209d35203b33192f0376 WatchSource:0}: Error finding container b6f62cf41efeafc2d66d59c156c17e704ae9f450bab2209d35203b33192f0376: Status 404 returned error can't find the container with id b6f62cf41efeafc2d66d59c156c17e704ae9f450bab2209d35203b33192f0376
Sep 16 12:38:38.076035 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:38.076018    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14aa34e294e3d61f5085b64dca7012c2.slice/crio-035208daa1a4e55a8988ec68e70ebfc07f7680544aeaeb52f72b9265588af27e WatchSource:0}: Error finding container 035208daa1a4e55a8988ec68e70ebfc07f7680544aeaeb52f72b9265588af27e: Status 404 returned error can't find the container with id 035208daa1a4e55a8988ec68e70ebfc07f7680544aeaeb52f72b9265588af27e
Sep 16 12:38:38.080908 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.080892    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:38:38.714190 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.714155    2549 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:38:38.765784 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.765752    2549 apiserver.go:52] "Watching apiserver"
Sep 16 12:38:38.774664 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.774637    2549 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 16 12:38:38.775141 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.775110    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-7sbll","openshift-network-diagnostics/network-check-target-vkd6h","openshift-network-operator/iptables-alerter-kht82","openshift-ovn-kubernetes/ovnkube-node-qbqph","kube-system/global-pull-secret-syncer-hkcrj","kube-system/konnectivity-agent-5sclw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw","openshift-cluster-node-tuning-operator/tuned-hvq7m","openshift-dns/node-resolver-6gq76","openshift-image-registry/node-ca-fxcfd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal","openshift-multus/multus-additional-cni-plugins-6h7wr","kube-system/kube-apiserver-proxy-ip-10-0-128-195.ec2.internal","openshift-multus/multus-vrmh9"]
Sep 16 12:38:38.777932 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.777908    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.781573 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.781237    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 16 12:38:38.781573 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.781434    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 16 12:38:38.782015 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.781858    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 16 12:38:38.782015 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.781874    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2scx4\""
Sep 16 12:38:38.782166 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.782140    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.784334 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.782840    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kht82"
Sep 16 12:38:38.785179 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.784643    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 16 12:38:38.785179 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.784994    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sllw2\""
Sep 16 12:38:38.785179 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.785000    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:38:38.786786 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.785479    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 16 12:38:38.786786 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.785734    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:38:38.786786 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.785916    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4jq2w\""
Sep 16 12:38:38.786786 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.786086    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 16 12:38:38.786786 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.786296    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.786786 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.786360    2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 16 12:38:38.789862 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.788381    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 16 12:38:38.789862 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.788598    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:38.789862 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:38.788672    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:38:38.789862 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.789140    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k86ff\""
Sep 16 12:38:38.789862 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.789312    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 16 12:38:38.789862 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.789382    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 16 12:38:38.789862 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.789542    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 16 12:38:38.789862 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.789857    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 16 12:38:38.792455 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.792430    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5sclw"
Sep 16 12:38:38.794948 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.794926    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 16 12:38:38.795246 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.795230    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 16 12:38:38.795450 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.795429    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4j7jj\""
Sep 16 12:38:38.795527 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.795475    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 16 12:38:38.797788 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.797763    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwlvq\" (UniqueName: \"kubernetes.io/projected/da232b43-2d52-41de-bfb1-135ec4f32b50-kube-api-access-hwlvq\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.797937 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.797804    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-host\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.797937 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.797831    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b99a737-c07c-4369-865c-7998a3f40d87-tmp\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.797937 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.797858    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2385c4c-3f02-44d9-a6d4-49cdc30cfc31-iptables-alerter-script\") pod \"iptables-alerter-kht82\" (UID: \"d2385c4c-3f02-44d9-a6d4-49cdc30cfc31\") " pod="openshift-network-operator/iptables-alerter-kht82"
Sep 16 12:38:38.797937 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.797887    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2385c4c-3f02-44d9-a6d4-49cdc30cfc31-host-slash\") pod \"iptables-alerter-kht82\" (UID: \"d2385c4c-3f02-44d9-a6d4-49cdc30cfc31\") " pod="openshift-network-operator/iptables-alerter-kht82"
Sep 16 12:38:38.797937 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.797916    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2rd4\" (UniqueName: \"kubernetes.io/projected/d2385c4c-3f02-44d9-a6d4-49cdc30cfc31-kube-api-access-f2rd4\") pod \"iptables-alerter-kht82\" (UID: \"d2385c4c-3f02-44d9-a6d4-49cdc30cfc31\") " pod="openshift-network-operator/iptables-alerter-kht82"
Sep 16 12:38:38.798212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.797942    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-var-lib-openvswitch\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.798212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.797977    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-log-socket\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.798212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798003    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02f43e10-d508-4244-8f0c-534b182fc11d-kubelet-config\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:38.798212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798027    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-run\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.798212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798052    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcrgk\" (UniqueName: \"kubernetes.io/projected/7b99a737-c07c-4369-865c-7998a3f40d87-kube-api-access-qcrgk\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.798212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798074    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-slash\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.798212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798095    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-run-systemd\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.798212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798118    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27fe9cd7-9462-4cec-8909-81800a7fa727-ovnkube-script-lib\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.798212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798145    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgfhx\" (UniqueName: \"kubernetes.io/projected/27fe9cd7-9462-4cec-8909-81800a7fa727-kube-api-access-fgfhx\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.798212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798186    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-sys-fs\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.798708 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798261    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-sysctl-conf\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.798708 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798295    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-run-netns\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.798708 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798324    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-run-openvswitch\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.798708 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798356    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.798708 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798391    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-device-dir\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.798708 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798600    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6gq76"
Sep 16 12:38:38.798708 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798648    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-var-lib-kubelet\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.798708 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798680    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-systemd-units\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.799087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798709    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-cni-netd\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.799087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798738    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-etc-selinux\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.799087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798762    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-modprobe-d\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.799087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798825    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-node-log\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.799087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798850    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-cni-bin\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.799087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798876    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.799087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798900    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-socket-dir\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.799087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798937    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-kubernetes\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.799087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798960    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-sysctl-d\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.799087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.798983    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-kubelet\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.799087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.799007    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.799087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.799031    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27fe9cd7-9462-4cec-8909-81800a7fa727-ovnkube-config\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.799749 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.799253    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27fe9cd7-9462-4cec-8909-81800a7fa727-ovn-node-metrics-cert\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.799749 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.799344    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-sysconfig\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.799749 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.799377    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-systemd\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.799749 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.799405    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-lib-modules\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.800448 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.800426    2549 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 16 12:38:38.800833 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.800815    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 16 12:38:38.800912 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.800876    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:38.801054 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:38.800967    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:38:38.801117 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.799430    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-run-ovn\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.801184 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.801167    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27fe9cd7-9462-4cec-8909-81800a7fa727-env-overrides\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.801317 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.801298    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02f43e10-d508-4244-8f0c-534b182fc11d-dbus\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:38.801379 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.801349    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-sys\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.801434 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.801386    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b99a737-c07c-4369-865c-7998a3f40d87-etc-tuned\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.801434 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.801418    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-etc-openvswitch\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.801544 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.801444    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:38.801544 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.801468    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-registration-dir\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.801670 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.801576    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f5pl2\""
Sep 16 12:38:38.801815 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.801795    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 16 12:38:38.803327 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.802815    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:38.803327 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:38.802883    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:38:38.805169 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.805145    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fxcfd"
Sep 16 12:38:38.807493 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.807465    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 16 12:38:38.807618 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.807579    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 16 12:38:38.807795 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.807778    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-29zxv\""
Sep 16 12:38:38.808362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.807832    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.808460 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.808400    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 16 12:38:38.810758 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.810699    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:38.811847 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.811816    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 16 12:38:38.812800 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.812578    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q7cjz\""
Sep 16 12:38:38.812800 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.812706    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 16 12:38:38.812800 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.812709    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 16 12:38:38.813333 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.813315    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 16 12:38:38.813601 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.813560    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4bz7g\""
Sep 16 12:38:38.813947 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.813743    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 16 12:38:38.814091 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.814044    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 16 12:38:38.826063 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.826038    2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pb55x"
Sep 16 12:38:38.837653 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.837629    2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pb55x"
Sep 16 12:38:38.888657 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.888617    2549 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 16 12:38:38.904253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.902894    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-lib-modules\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.904253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.902955    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-run-ovn\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.904253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.902992    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27fe9cd7-9462-4cec-8909-81800a7fa727-env-overrides\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.904253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.903023    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:38.904253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.903043    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f235d0a-befc-4858-9695-8ef8400e0091-system-cni-dir\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:38.904253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.903070    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-sys\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.904253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.903096    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b99a737-c07c-4369-865c-7998a3f40d87-etc-tuned\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.904253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.903117    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:38.904253 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:38.903257    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:38:38.904253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.903764    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-lib-modules\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.904253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.903838    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-run-ovn\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.904253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.904149    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-sys\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.904253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.904228    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f235d0a-befc-4858-9695-8ef8400e0091-cni-binary-copy\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:38.904253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.904283    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f235d0a-befc-4858-9695-8ef8400e0091-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:38.905040 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.904385    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27fe9cd7-9462-4cec-8909-81800a7fa727-env-overrides\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.905040 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.904806    2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906063    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efc3ffc1-701b-4061-a36c-562e45bc42b0-cni-binary-copy\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906113    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-run-netns\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906143    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b99a737-c07c-4369-865c-7998a3f40d87-tmp\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906176    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2rd4\" (UniqueName: \"kubernetes.io/projected/d2385c4c-3f02-44d9-a6d4-49cdc30cfc31-kube-api-access-f2rd4\") pod \"iptables-alerter-kht82\" (UID: \"d2385c4c-3f02-44d9-a6d4-49cdc30cfc31\") " pod="openshift-network-operator/iptables-alerter-kht82"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906207    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-var-lib-openvswitch\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906240    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-log-socket\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906266    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-sys-fs\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906339    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f235d0a-befc-4858-9695-8ef8400e0091-cnibin\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906369    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcrgk\" (UniqueName: \"kubernetes.io/projected/7b99a737-c07c-4369-865c-7998a3f40d87-kube-api-access-qcrgk\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906400    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-slash\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906427    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-run-systemd\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906455    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6704aa38-49e4-45d6-85c9-9bca777aafdc-agent-certs\") pod \"konnectivity-agent-5sclw\" (UID: \"6704aa38-49e4-45d6-85c9-9bca777aafdc\") " pod="kube-system/konnectivity-agent-5sclw"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906480    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffjfh\" (UniqueName: \"kubernetes.io/projected/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-kube-api-access-ffjfh\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906509    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdkpf\" (UniqueName: \"kubernetes.io/projected/b9bc16ce-d5ef-4d7b-9632-ab2849397953-kube-api-access-bdkpf\") pod \"node-ca-fxcfd\" (UID: \"b9bc16ce-d5ef-4d7b-9632-ab2849397953\") " pod="openshift-image-registry/node-ca-fxcfd"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906558    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-sysctl-conf\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.906580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906591    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-run-netns\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906621    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-run-openvswitch\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906647    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42955466-fe7b-4765-9db7-390d2d3e6917-hosts-file\") pod \"node-resolver-6gq76\" (UID: \"42955466-fe7b-4765-9db7-390d2d3e6917\") " pod="openshift-dns/node-resolver-6gq76"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906680    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-cnibin\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906716    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-var-lib-kubelet\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906748    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-systemd-units\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906778    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-etc-selinux\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906807    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f235d0a-befc-4858-9695-8ef8400e0091-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906841    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9bc16ce-d5ef-4d7b-9632-ab2849397953-host\") pod \"node-ca-fxcfd\" (UID: \"b9bc16ce-d5ef-4d7b-9632-ab2849397953\") " pod="openshift-image-registry/node-ca-fxcfd"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906874    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-multus-socket-dir-parent\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906904    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-var-lib-kubelet\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906936    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-cni-bin\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906966    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.906991    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-etc-kubernetes\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907025    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-kubernetes\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907083    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-sysctl-d\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.907362 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:38.907147    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret podName:02f43e10-d508-4244-8f0c-534b182fc11d nodeName:}" failed. No retries permitted until 2026-09-16 12:38:39.407124467 +0000 UTC m=+2.971945541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret") pod "global-pull-secret-syncer-hkcrj" (UID: "02f43e10-d508-4244-8f0c-534b182fc11d") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907217    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-run-systemd\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907235    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-run-netns\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907244    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-cni-bin\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907316    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-log-socket\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907367    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-slash\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907421    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-systemd-units\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907419    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27fe9cd7-9462-4cec-8909-81800a7fa727-ovnkube-config\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907463    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27fe9cd7-9462-4cec-8909-81800a7fa727-ovn-node-metrics-cert\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907480    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907532    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-run-openvswitch\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907595    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-etc-selinux\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907604    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-var-lib-openvswitch\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907667    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj2w7\" (UniqueName: \"kubernetes.io/projected/6f235d0a-befc-4858-9695-8ef8400e0091-kube-api-access-gj2w7\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907751    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-sysctl-conf\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907779    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-sysctl-d\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907815    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-kubernetes\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.908216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907836    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-var-lib-kubelet\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907884    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-multus-conf-dir\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907905    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-sys-fs\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.907966    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efc3ffc1-701b-4061-a36c-562e45bc42b0-multus-daemon-config\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908006    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02f43e10-d508-4244-8f0c-534b182fc11d-dbus\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908058    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-var-lib-cni-bin\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908093    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-etc-openvswitch\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908127    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-registration-dir\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908156    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwlvq\" (UniqueName: \"kubernetes.io/projected/da232b43-2d52-41de-bfb1-135ec4f32b50-kube-api-access-hwlvq\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908231    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9bc16ce-d5ef-4d7b-9632-ab2849397953-serviceca\") pod \"node-ca-fxcfd\" (UID: \"b9bc16ce-d5ef-4d7b-9632-ab2849397953\") " pod="openshift-image-registry/node-ca-fxcfd"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908265    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-hostroot\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908304    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27fe9cd7-9462-4cec-8909-81800a7fa727-ovnkube-config\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908419    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-etc-openvswitch\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908515    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-registration-dir\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908555    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-host\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908590    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2385c4c-3f02-44d9-a6d4-49cdc30cfc31-iptables-alerter-script\") pod \"iptables-alerter-kht82\" (UID: \"d2385c4c-3f02-44d9-a6d4-49cdc30cfc31\") " pod="openshift-network-operator/iptables-alerter-kht82"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908598    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/02f43e10-d508-4244-8f0c-534b182fc11d-dbus\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:38.908977 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908664    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2385c4c-3f02-44d9-a6d4-49cdc30cfc31-host-slash\") pod \"iptables-alerter-kht82\" (UID: \"d2385c4c-3f02-44d9-a6d4-49cdc30cfc31\") " pod="openshift-network-operator/iptables-alerter-kht82"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908703    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02f43e10-d508-4244-8f0c-534b182fc11d-kubelet-config\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908743    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f235d0a-befc-4858-9695-8ef8400e0091-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908782    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-system-cni-dir\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908791    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-host\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908816    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-run-k8s-cni-cncf-io\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908837    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2385c4c-3f02-44d9-a6d4-49cdc30cfc31-host-slash\") pod \"iptables-alerter-kht82\" (UID: \"d2385c4c-3f02-44d9-a6d4-49cdc30cfc31\") " pod="openshift-network-operator/iptables-alerter-kht82"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908889    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-run\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908904    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/02f43e10-d508-4244-8f0c-534b182fc11d-kubelet-config\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908929    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27fe9cd7-9462-4cec-8909-81800a7fa727-ovnkube-script-lib\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.908993    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgfhx\" (UniqueName: \"kubernetes.io/projected/27fe9cd7-9462-4cec-8909-81800a7fa727-kube-api-access-fgfhx\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909054    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-run\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909058    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909273    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d2385c4c-3f02-44d9-a6d4-49cdc30cfc31-iptables-alerter-script\") pod \"iptables-alerter-kht82\" (UID: \"d2385c4c-3f02-44d9-a6d4-49cdc30cfc31\") " pod="openshift-network-operator/iptables-alerter-kht82"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909434    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909488    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-device-dir\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909545    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6704aa38-49e4-45d6-85c9-9bca777aafdc-konnectivity-ca\") pod \"konnectivity-agent-5sclw\" (UID: \"6704aa38-49e4-45d6-85c9-9bca777aafdc\") " pod="kube-system/konnectivity-agent-5sclw"
Sep 16 12:38:38.909829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909596    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-cni-netd\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909657    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42955466-fe7b-4765-9db7-390d2d3e6917-tmp-dir\") pod \"node-resolver-6gq76\" (UID: \"42955466-fe7b-4765-9db7-390d2d3e6917\") " pod="openshift-dns/node-resolver-6gq76"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909689    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-run-multus-certs\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909723    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvrnn\" (UniqueName: \"kubernetes.io/projected/efc3ffc1-701b-4061-a36c-562e45bc42b0-kube-api-access-zvrnn\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909736    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27fe9cd7-9462-4cec-8909-81800a7fa727-ovnkube-script-lib\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909754    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-modprobe-d\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909828    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-node-log\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909864    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-socket-dir\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909905    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-kubelet\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909938    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909947    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b99a737-c07c-4369-865c-7998a3f40d87-etc-tuned\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.909972    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knssd\" (UniqueName: \"kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd\") pod \"network-check-target-vkd6h\" (UID: \"52446251-5116-4c0d-abc3-c70c4aad607c\") " pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910014    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4tlx\" (UniqueName: \"kubernetes.io/projected/42955466-fe7b-4765-9db7-390d2d3e6917-kube-api-access-q4tlx\") pod \"node-resolver-6gq76\" (UID: \"42955466-fe7b-4765-9db7-390d2d3e6917\") " pod="openshift-dns/node-resolver-6gq76"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910074    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-node-log\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910117    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-modprobe-d\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910115    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b99a737-c07c-4369-865c-7998a3f40d87-tmp\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910177    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-cni-netd\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.911055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910200    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-socket-dir\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.911761 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910222    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-multus-cni-dir\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.911761 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910258    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-run-ovn-kubernetes\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.911761 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910273    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-var-lib-cni-multus\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:38.911761 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910319    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-sysconfig\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.911761 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910320    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27fe9cd7-9462-4cec-8909-81800a7fa727-host-kubelet\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.911761 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910277    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/da232b43-2d52-41de-bfb1-135ec4f32b50-device-dir\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.911761 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910449    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-systemd\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.911761 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910576    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-sysconfig\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.911761 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.910584    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b99a737-c07c-4369-865c-7998a3f40d87-etc-systemd\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.912093 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.912042    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27fe9cd7-9462-4cec-8909-81800a7fa727-ovn-node-metrics-cert\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:38.919146 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.919097    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal" event={"ID":"14aa34e294e3d61f5085b64dca7012c2","Type":"ContainerStarted","Data":"035208daa1a4e55a8988ec68e70ebfc07f7680544aeaeb52f72b9265588af27e"}
Sep 16 12:38:38.920852 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.920783    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-195.ec2.internal" event={"ID":"4cf5b75210ff49812e784216b4e945d0","Type":"ContainerStarted","Data":"b6f62cf41efeafc2d66d59c156c17e704ae9f450bab2209d35203b33192f0376"}
Sep 16 12:38:38.921005 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.920983    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwlvq\" (UniqueName: \"kubernetes.io/projected/da232b43-2d52-41de-bfb1-135ec4f32b50-kube-api-access-hwlvq\") pod \"aws-ebs-csi-driver-node-prbmw\" (UID: \"da232b43-2d52-41de-bfb1-135ec4f32b50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:38.921500 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.921476    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2rd4\" (UniqueName: \"kubernetes.io/projected/d2385c4c-3f02-44d9-a6d4-49cdc30cfc31-kube-api-access-f2rd4\") pod \"iptables-alerter-kht82\" (UID: \"d2385c4c-3f02-44d9-a6d4-49cdc30cfc31\") " pod="openshift-network-operator/iptables-alerter-kht82"
Sep 16 12:38:38.921931 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.921908    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcrgk\" (UniqueName: \"kubernetes.io/projected/7b99a737-c07c-4369-865c-7998a3f40d87-kube-api-access-qcrgk\") pod \"tuned-hvq7m\" (UID: \"7b99a737-c07c-4369-865c-7998a3f40d87\") " pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:38.922799 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:38.922774    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgfhx\" (UniqueName: \"kubernetes.io/projected/27fe9cd7-9462-4cec-8909-81800a7fa727-kube-api-access-fgfhx\") pod \"ovnkube-node-qbqph\" (UID: \"27fe9cd7-9462-4cec-8909-81800a7fa727\") " pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:39.011813 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.011727    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42955466-fe7b-4765-9db7-390d2d3e6917-hosts-file\") pod \"node-resolver-6gq76\" (UID: \"42955466-fe7b-4765-9db7-390d2d3e6917\") " pod="openshift-dns/node-resolver-6gq76"
Sep 16 12:38:39.011813 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.011768    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-cnibin\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.011813 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.011794    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f235d0a-befc-4858-9695-8ef8400e0091-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.012064 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.011818    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9bc16ce-d5ef-4d7b-9632-ab2849397953-host\") pod \"node-ca-fxcfd\" (UID: \"b9bc16ce-d5ef-4d7b-9632-ab2849397953\") " pod="openshift-image-registry/node-ca-fxcfd"
Sep 16 12:38:39.012064 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.011843    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-multus-socket-dir-parent\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012064 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.011864    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-cnibin\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012064 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.011864    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-var-lib-kubelet\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012064 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.011906    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-var-lib-kubelet\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012064 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.011921    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-etc-kubernetes\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012064 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.011947    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj2w7\" (UniqueName: \"kubernetes.io/projected/6f235d0a-befc-4858-9695-8ef8400e0091-kube-api-access-gj2w7\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.012064 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.011965    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-multus-conf-dir\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012064 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.011984    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efc3ffc1-701b-4061-a36c-562e45bc42b0-multus-daemon-config\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012064 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012000    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-var-lib-cni-bin\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012064 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012021    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9bc16ce-d5ef-4d7b-9632-ab2849397953-serviceca\") pod \"node-ca-fxcfd\" (UID: \"b9bc16ce-d5ef-4d7b-9632-ab2849397953\") " pod="openshift-image-registry/node-ca-fxcfd"
Sep 16 12:38:39.012064 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012060    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-hostroot\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012090    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f235d0a-befc-4858-9695-8ef8400e0091-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012127    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-system-cni-dir\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012152    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-run-k8s-cni-cncf-io\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012185    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6704aa38-49e4-45d6-85c9-9bca777aafdc-konnectivity-ca\") pod \"konnectivity-agent-5sclw\" (UID: \"6704aa38-49e4-45d6-85c9-9bca777aafdc\") " pod="kube-system/konnectivity-agent-5sclw"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012211    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42955466-fe7b-4765-9db7-390d2d3e6917-tmp-dir\") pod \"node-resolver-6gq76\" (UID: \"42955466-fe7b-4765-9db7-390d2d3e6917\") " pod="openshift-dns/node-resolver-6gq76"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012236    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-run-multus-certs\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012262    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvrnn\" (UniqueName: \"kubernetes.io/projected/efc3ffc1-701b-4061-a36c-562e45bc42b0-kube-api-access-zvrnn\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012296    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knssd\" (UniqueName: \"kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd\") pod \"network-check-target-vkd6h\" (UID: \"52446251-5116-4c0d-abc3-c70c4aad607c\") " pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012321    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4tlx\" (UniqueName: \"kubernetes.io/projected/42955466-fe7b-4765-9db7-390d2d3e6917-kube-api-access-q4tlx\") pod \"node-resolver-6gq76\" (UID: \"42955466-fe7b-4765-9db7-390d2d3e6917\") " pod="openshift-dns/node-resolver-6gq76"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012346    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-multus-cni-dir\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012372    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-var-lib-cni-multus\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012410    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012437    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f235d0a-befc-4858-9695-8ef8400e0091-system-cni-dir\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012481    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f235d0a-befc-4858-9695-8ef8400e0091-cni-binary-copy\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012506    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f235d0a-befc-4858-9695-8ef8400e0091-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012506    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6f235d0a-befc-4858-9695-8ef8400e0091-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.012723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012529    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efc3ffc1-701b-4061-a36c-562e45bc42b0-cni-binary-copy\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.013590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012583    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-run-netns\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.013590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012588    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b9bc16ce-d5ef-4d7b-9632-ab2849397953-host\") pod \"node-ca-fxcfd\" (UID: \"b9bc16ce-d5ef-4d7b-9632-ab2849397953\") " pod="openshift-image-registry/node-ca-fxcfd"
Sep 16 12:38:39.013590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.011815    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/42955466-fe7b-4765-9db7-390d2d3e6917-hosts-file\") pod \"node-resolver-6gq76\" (UID: \"42955466-fe7b-4765-9db7-390d2d3e6917\") " pod="openshift-dns/node-resolver-6gq76"
Sep 16 12:38:39.013590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012615    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f235d0a-befc-4858-9695-8ef8400e0091-cnibin\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.013590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012649    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6704aa38-49e4-45d6-85c9-9bca777aafdc-agent-certs\") pod \"konnectivity-agent-5sclw\" (UID: \"6704aa38-49e4-45d6-85c9-9bca777aafdc\") " pod="kube-system/konnectivity-agent-5sclw"
Sep 16 12:38:39.013590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012660    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-multus-socket-dir-parent\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.013590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012674    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffjfh\" (UniqueName: \"kubernetes.io/projected/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-kube-api-access-ffjfh\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:39.013590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012701    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdkpf\" (UniqueName: \"kubernetes.io/projected/b9bc16ce-d5ef-4d7b-9632-ab2849397953-kube-api-access-bdkpf\") pod \"node-ca-fxcfd\" (UID: \"b9bc16ce-d5ef-4d7b-9632-ab2849397953\") " pod="openshift-image-registry/node-ca-fxcfd"
Sep 16 12:38:39.013590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012715    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-run-multus-certs\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.013590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.012780    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-multus-conf-dir\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.013590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.013247    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/efc3ffc1-701b-4061-a36c-562e45bc42b0-multus-daemon-config\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.013590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.013310    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-var-lib-cni-bin\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.013590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.013493    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-multus-cni-dir\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.013590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.013565    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-run-netns\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.014267 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.013685    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-system-cni-dir\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.014267 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.013713    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-etc-kubernetes\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.014267 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.013733    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b9bc16ce-d5ef-4d7b-9632-ab2849397953-serviceca\") pod \"node-ca-fxcfd\" (UID: \"b9bc16ce-d5ef-4d7b-9632-ab2849397953\") " pod="openshift-image-registry/node-ca-fxcfd"
Sep 16 12:38:39.014267 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.013739    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-hostroot\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.014267 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.013877    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6f235d0a-befc-4858-9695-8ef8400e0091-cnibin\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.014267 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.013925    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6f235d0a-befc-4858-9695-8ef8400e0091-system-cni-dir\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.014267 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:39.013960    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:38:39.014267 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:39.014027    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs podName:0cad7b5e-dab9-4fb5-94ab-4c7f31755c34 nodeName:}" failed. No retries permitted until 2026-09-16 12:38:39.51401082 +0000 UTC m=+3.078831926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs") pod "network-metrics-daemon-7sbll" (UID: "0cad7b5e-dab9-4fb5-94ab-4c7f31755c34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:38:39.014267 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.014079    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6f235d0a-befc-4858-9695-8ef8400e0091-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.014267 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.014139    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-var-lib-cni-multus\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.014267 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.014186    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/efc3ffc1-701b-4061-a36c-562e45bc42b0-host-run-k8s-cni-cncf-io\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.014848 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.014279    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6f235d0a-befc-4858-9695-8ef8400e0091-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.014848 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.014308    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/efc3ffc1-701b-4061-a36c-562e45bc42b0-cni-binary-copy\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.014848 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.014460    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/42955466-fe7b-4765-9db7-390d2d3e6917-tmp-dir\") pod \"node-resolver-6gq76\" (UID: \"42955466-fe7b-4765-9db7-390d2d3e6917\") " pod="openshift-dns/node-resolver-6gq76"
Sep 16 12:38:39.014848 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.014553    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6f235d0a-befc-4858-9695-8ef8400e0091-cni-binary-copy\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.014848 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.014561    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6704aa38-49e4-45d6-85c9-9bca777aafdc-konnectivity-ca\") pod \"konnectivity-agent-5sclw\" (UID: \"6704aa38-49e4-45d6-85c9-9bca777aafdc\") " pod="kube-system/konnectivity-agent-5sclw"
Sep 16 12:38:39.017686 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.017661    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6704aa38-49e4-45d6-85c9-9bca777aafdc-agent-certs\") pod \"konnectivity-agent-5sclw\" (UID: \"6704aa38-49e4-45d6-85c9-9bca777aafdc\") " pod="kube-system/konnectivity-agent-5sclw"
Sep 16 12:38:39.024743 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:39.024722    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:38:39.024743 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:39.024746    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:38:39.024925 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:39.024755    2549 projected.go:196] Error preparing data for projected volume kube-api-access-knssd for pod openshift-network-diagnostics/network-check-target-vkd6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:38:39.024925 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:39.024808    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd podName:52446251-5116-4c0d-abc3-c70c4aad607c nodeName:}" failed. No retries permitted until 2026-09-16 12:38:39.524792427 +0000 UTC m=+3.089613515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-knssd" (UniqueName: "kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd") pod "network-check-target-vkd6h" (UID: "52446251-5116-4c0d-abc3-c70c4aad607c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:38:39.026508 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.026148    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj2w7\" (UniqueName: \"kubernetes.io/projected/6f235d0a-befc-4858-9695-8ef8400e0091-kube-api-access-gj2w7\") pod \"multus-additional-cni-plugins-6h7wr\" (UID: \"6f235d0a-befc-4858-9695-8ef8400e0091\") " pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.026646 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.026599    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvrnn\" (UniqueName: \"kubernetes.io/projected/efc3ffc1-701b-4061-a36c-562e45bc42b0-kube-api-access-zvrnn\") pod \"multus-vrmh9\" (UID: \"efc3ffc1-701b-4061-a36c-562e45bc42b0\") " pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.027694 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.027664    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffjfh\" (UniqueName: \"kubernetes.io/projected/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-kube-api-access-ffjfh\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:39.029612 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.029589    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4tlx\" (UniqueName: \"kubernetes.io/projected/42955466-fe7b-4765-9db7-390d2d3e6917-kube-api-access-q4tlx\") pod \"node-resolver-6gq76\" (UID: \"42955466-fe7b-4765-9db7-390d2d3e6917\") " pod="openshift-dns/node-resolver-6gq76"
Sep 16 12:38:39.029694 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.029589    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdkpf\" (UniqueName: \"kubernetes.io/projected/b9bc16ce-d5ef-4d7b-9632-ab2849397953-kube-api-access-bdkpf\") pod \"node-ca-fxcfd\" (UID: \"b9bc16ce-d5ef-4d7b-9632-ab2849397953\") " pod="openshift-image-registry/node-ca-fxcfd"
Sep 16 12:38:39.095835 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.095792    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw"
Sep 16 12:38:39.106294 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.106267    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hvq7m"
Sep 16 12:38:39.116394 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.116369    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kht82"
Sep 16 12:38:39.124519 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.124479    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:38:39.133387 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.133365    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5sclw"
Sep 16 12:38:39.141236 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.141217    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6gq76"
Sep 16 12:38:39.149111 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.149090    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fxcfd"
Sep 16 12:38:39.158912 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.158887    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vrmh9"
Sep 16 12:38:39.165668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.165651    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6h7wr"
Sep 16 12:38:39.416386 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.416296    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:39.416561 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:39.416435    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:38:39.416561 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:39.416533    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret podName:02f43e10-d508-4244-8f0c-534b182fc11d nodeName:}" failed. No retries permitted until 2026-09-16 12:38:40.416495652 +0000 UTC m=+3.981316723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret") pod "global-pull-secret-syncer-hkcrj" (UID: "02f43e10-d508-4244-8f0c-534b182fc11d") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:38:39.517196 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.517155    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:39.517399 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:39.517337    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:38:39.517478 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:39.517423    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs podName:0cad7b5e-dab9-4fb5-94ab-4c7f31755c34 nodeName:}" failed. No retries permitted until 2026-09-16 12:38:40.517401369 +0000 UTC m=+4.082222441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs") pod "network-metrics-daemon-7sbll" (UID: "0cad7b5e-dab9-4fb5-94ab-4c7f31755c34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:38:39.604862 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.604820    2549 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 16 12:38:39.618123 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.618096    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knssd\" (UniqueName: \"kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd\") pod \"network-check-target-vkd6h\" (UID: \"52446251-5116-4c0d-abc3-c70c4aad607c\") " pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:39.618274 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:39.618250    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:38:39.618274 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:39.618269    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:38:39.618385 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:39.618282    2549 projected.go:196] Error preparing data for projected volume kube-api-access-knssd for pod openshift-network-diagnostics/network-check-target-vkd6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:38:39.618385 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:39.618343    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd podName:52446251-5116-4c0d-abc3-c70c4aad607c nodeName:}" failed. No retries permitted until 2026-09-16 12:38:40.61832372 +0000 UTC m=+4.183144792 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-knssd" (UniqueName: "kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd") pod "network-check-target-vkd6h" (UID: "52446251-5116-4c0d-abc3-c70c4aad607c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:38:39.841074 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.840987    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 12:33:39 +0000 UTC" deadline="2028-04-25 19:44:17.014864601 +0000 UTC"
Sep 16 12:38:39.841074 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:39.841019    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14095h5m37.173850839s"
Sep 16 12:38:40.189609 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:40.189454    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42955466_fe7b_4765_9db7_390d2d3e6917.slice/crio-1bb5483936a055fb11f4e0fc0f3dd8652cef7d380eb30f97739093488f4a4175 WatchSource:0}: Error finding container 1bb5483936a055fb11f4e0fc0f3dd8652cef7d380eb30f97739093488f4a4175: Status 404 returned error can't find the container with id 1bb5483936a055fb11f4e0fc0f3dd8652cef7d380eb30f97739093488f4a4175
Sep 16 12:38:40.190973 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:40.190951    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2385c4c_3f02_44d9_a6d4_49cdc30cfc31.slice/crio-7e8de64471fbb42e26bd7e83a22b2a1e61b4ec484ff4c8392737a7cb627d0277 WatchSource:0}: Error finding container 7e8de64471fbb42e26bd7e83a22b2a1e61b4ec484ff4c8392737a7cb627d0277: Status 404 returned error can't find the container with id 7e8de64471fbb42e26bd7e83a22b2a1e61b4ec484ff4c8392737a7cb627d0277
Sep 16 12:38:40.193899 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:40.193289    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f235d0a_befc_4858_9695_8ef8400e0091.slice/crio-b3e135c9dd8a7d8d8de9feb113e64bc0c8606911e8b14ca783b9c60561238f3d WatchSource:0}: Error finding container b3e135c9dd8a7d8d8de9feb113e64bc0c8606911e8b14ca783b9c60561238f3d: Status 404 returned error can't find the container with id b3e135c9dd8a7d8d8de9feb113e64bc0c8606911e8b14ca783b9c60561238f3d
Sep 16 12:38:40.204728 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:38:40.204694    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9bc16ce_d5ef_4d7b_9632_ab2849397953.slice/crio-642bf1a1e196b69bdf914a261e90bd785f0bd4bff0eb0de0b9e4f1ee8f207f06 WatchSource:0}: Error finding container 642bf1a1e196b69bdf914a261e90bd785f0bd4bff0eb0de0b9e4f1ee8f207f06: Status 404 returned error can't find the container with id 642bf1a1e196b69bdf914a261e90bd785f0bd4bff0eb0de0b9e4f1ee8f207f06
Sep 16 12:38:40.424086 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.424005    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:40.424217 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:40.424115    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:38:40.424217 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:40.424169    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret podName:02f43e10-d508-4244-8f0c-534b182fc11d nodeName:}" failed. No retries permitted until 2026-09-16 12:38:42.424155602 +0000 UTC m=+5.988976672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret") pod "global-pull-secret-syncer-hkcrj" (UID: "02f43e10-d508-4244-8f0c-534b182fc11d") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:38:40.524962 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.524934    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:40.525091 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:40.525073    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:38:40.525141 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:40.525132    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs podName:0cad7b5e-dab9-4fb5-94ab-4c7f31755c34 nodeName:}" failed. No retries permitted until 2026-09-16 12:38:42.525116298 +0000 UTC m=+6.089937385 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs") pod "network-metrics-daemon-7sbll" (UID: "0cad7b5e-dab9-4fb5-94ab-4c7f31755c34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:38:40.626020 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.625986    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knssd\" (UniqueName: \"kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd\") pod \"network-check-target-vkd6h\" (UID: \"52446251-5116-4c0d-abc3-c70c4aad607c\") " pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:40.626190 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:40.626168    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:38:40.626269 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:40.626194    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:38:40.626269 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:40.626204    2549 projected.go:196] Error preparing data for projected volume kube-api-access-knssd for pod openshift-network-diagnostics/network-check-target-vkd6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:38:40.626269 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:40.626266    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd podName:52446251-5116-4c0d-abc3-c70c4aad607c nodeName:}" failed. No retries permitted until 2026-09-16 12:38:42.626246484 +0000 UTC m=+6.191067569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-knssd" (UniqueName: "kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd") pod "network-check-target-vkd6h" (UID: "52446251-5116-4c0d-abc3-c70c4aad607c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:38:40.842355 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.842202    2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-15 12:33:39 +0000 UTC" deadline="2028-03-09 12:29:58.711298605 +0000 UTC"
Sep 16 12:38:40.842355 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.842265    2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12959h51m17.869037507s"
Sep 16 12:38:40.916516 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.915621    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:40.916516 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:40.915765    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:38:40.916516 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.916190    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:40.916516 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:40.916303    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:38:40.916516 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.916331    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:40.916516 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:40.916429    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:38:40.935289 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.935259    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6gq76" event={"ID":"42955466-fe7b-4765-9db7-390d2d3e6917","Type":"ContainerStarted","Data":"1bb5483936a055fb11f4e0fc0f3dd8652cef7d380eb30f97739093488f4a4175"}
Sep 16 12:38:40.947211 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.947057    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-195.ec2.internal" event={"ID":"4cf5b75210ff49812e784216b4e945d0","Type":"ContainerStarted","Data":"41a2af1519b613e55c49af0ad4e1872538efdd628eb2f86e2dfeac0411700192"}
Sep 16 12:38:40.952892 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.952849    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hvq7m" event={"ID":"7b99a737-c07c-4369-865c-7998a3f40d87","Type":"ContainerStarted","Data":"c34bf516e1b5c7fb14b861c6acb5431b3bb80247a3e990725057dfd811f25d39"}
Sep 16 12:38:40.974082 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.958800    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fxcfd" event={"ID":"b9bc16ce-d5ef-4d7b-9632-ab2849397953","Type":"ContainerStarted","Data":"642bf1a1e196b69bdf914a261e90bd785f0bd4bff0eb0de0b9e4f1ee8f207f06"}
Sep 16 12:38:40.974082 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.960540    2549 generic.go:356] "Generic (PLEG): container finished" podID="14aa34e294e3d61f5085b64dca7012c2" containerID="8559047a7944e93be46c8891bddded39271af619d92dbea4f65b544f7c89157b" exitCode=0
Sep 16 12:38:40.974082 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.960616    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal" event={"ID":"14aa34e294e3d61f5085b64dca7012c2","Type":"ContainerDied","Data":"8559047a7944e93be46c8891bddded39271af619d92dbea4f65b544f7c89157b"}
Sep 16 12:38:40.974082 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.962067    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph" event={"ID":"27fe9cd7-9462-4cec-8909-81800a7fa727","Type":"ContainerStarted","Data":"2173da3283b124cd86606aa1f230c9dfe4bb1b7f25260d6801b91b7981335be4"}
Sep 16 12:38:40.974082 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.963012    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5sclw" event={"ID":"6704aa38-49e4-45d6-85c9-9bca777aafdc","Type":"ContainerStarted","Data":"2b8980da025ee281ba97a6f9f0306249c69a0c84ed84761307f457ca9f4b2b36"}
Sep 16 12:38:40.974082 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.964471    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vrmh9" event={"ID":"efc3ffc1-701b-4061-a36c-562e45bc42b0","Type":"ContainerStarted","Data":"af2c372f7814740e87a13ee0ec3a226d1179052879cd78ab7eb552036a34e0ff"}
Sep 16 12:38:40.974082 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.972071    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-195.ec2.internal" podStartSLOduration=2.97205963 podStartE2EDuration="2.97205963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:38:40.971998044 +0000 UTC m=+4.536819140" watchObservedRunningTime="2026-09-16 12:38:40.97205963 +0000 UTC m=+4.536880724"
Sep 16 12:38:40.985657 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:40.985369    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw" event={"ID":"da232b43-2d52-41de-bfb1-135ec4f32b50","Type":"ContainerStarted","Data":"912540c178bd10612e21fbe8dfc6b04a621b4b559902d2467560adde7189e79d"}
Sep 16 12:38:41.014458 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:41.014373    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6h7wr" event={"ID":"6f235d0a-befc-4858-9695-8ef8400e0091","Type":"ContainerStarted","Data":"b3e135c9dd8a7d8d8de9feb113e64bc0c8606911e8b14ca783b9c60561238f3d"}
Sep 16 12:38:41.033864 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:41.033831    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kht82" event={"ID":"d2385c4c-3f02-44d9-a6d4-49cdc30cfc31","Type":"ContainerStarted","Data":"7e8de64471fbb42e26bd7e83a22b2a1e61b4ec484ff4c8392737a7cb627d0277"}
Sep 16 12:38:42.062438 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:42.062110    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal" event={"ID":"14aa34e294e3d61f5085b64dca7012c2","Type":"ContainerStarted","Data":"a81f391015e62c11de69629485ca0d1ac910d20a32ff325b888287dcb6aacfe9"}
Sep 16 12:38:42.081643 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:42.081585    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-195.ec2.internal" podStartSLOduration=4.081546105 podStartE2EDuration="4.081546105s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:38:42.08145568 +0000 UTC m=+5.646276776" watchObservedRunningTime="2026-09-16 12:38:42.081546105 +0000 UTC m=+5.646367202"
Sep 16 12:38:42.440730 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:42.440402    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:42.440730 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:42.440618    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:38:42.440730 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:42.440685    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret podName:02f43e10-d508-4244-8f0c-534b182fc11d nodeName:}" failed. No retries permitted until 2026-09-16 12:38:46.440665371 +0000 UTC m=+10.005486458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret") pod "global-pull-secret-syncer-hkcrj" (UID: "02f43e10-d508-4244-8f0c-534b182fc11d") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:38:42.541488 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:42.541447    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:42.541688 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:42.541648    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:38:42.541757 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:42.541719    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs podName:0cad7b5e-dab9-4fb5-94ab-4c7f31755c34 nodeName:}" failed. No retries permitted until 2026-09-16 12:38:46.541697971 +0000 UTC m=+10.106519046 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs") pod "network-metrics-daemon-7sbll" (UID: "0cad7b5e-dab9-4fb5-94ab-4c7f31755c34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:38:42.642986 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:42.642268    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knssd\" (UniqueName: \"kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd\") pod \"network-check-target-vkd6h\" (UID: \"52446251-5116-4c0d-abc3-c70c4aad607c\") " pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:42.642986 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:42.642483    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:38:42.642986 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:42.642509    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:38:42.642986 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:42.642540    2549 projected.go:196] Error preparing data for projected volume kube-api-access-knssd for pod openshift-network-diagnostics/network-check-target-vkd6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:38:42.642986 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:42.642601    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd podName:52446251-5116-4c0d-abc3-c70c4aad607c nodeName:}" failed. No retries permitted until 2026-09-16 12:38:46.642582607 +0000 UTC m=+10.207403693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-knssd" (UniqueName: "kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd") pod "network-check-target-vkd6h" (UID: "52446251-5116-4c0d-abc3-c70c4aad607c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:38:42.917250 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:42.917090    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:42.917250 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:42.917222    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:38:42.917697 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:42.917643    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:42.917816 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:42.917761    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:38:42.917883 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:42.917823    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:42.917934 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:42.917897    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:38:44.916266 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:44.915771    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:44.916266 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:44.915915    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:38:44.916266 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:44.915935    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:44.916266 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:44.916053    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:38:44.916266 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:44.915777    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:44.916266 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:44.916180    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:38:46.475935 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:46.475894    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:46.476450 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:46.476082    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:38:46.476450 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:46.476142    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret podName:02f43e10-d508-4244-8f0c-534b182fc11d nodeName:}" failed. No retries permitted until 2026-09-16 12:38:54.476123873 +0000 UTC m=+18.040944952 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret") pod "global-pull-secret-syncer-hkcrj" (UID: "02f43e10-d508-4244-8f0c-534b182fc11d") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:38:46.576932 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:46.576885    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:46.577122 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:46.577105    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:38:46.577208 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:46.577187    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs podName:0cad7b5e-dab9-4fb5-94ab-4c7f31755c34 nodeName:}" failed. No retries permitted until 2026-09-16 12:38:54.577168576 +0000 UTC m=+18.141989661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs") pod "network-metrics-daemon-7sbll" (UID: "0cad7b5e-dab9-4fb5-94ab-4c7f31755c34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:38:46.678760 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:46.678087    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knssd\" (UniqueName: \"kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd\") pod \"network-check-target-vkd6h\" (UID: \"52446251-5116-4c0d-abc3-c70c4aad607c\") " pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:46.678760 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:46.678298    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:38:46.678760 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:46.678323    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:38:46.678760 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:46.678336    2549 projected.go:196] Error preparing data for projected volume kube-api-access-knssd for pod openshift-network-diagnostics/network-check-target-vkd6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:38:46.678760 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:46.678394    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd podName:52446251-5116-4c0d-abc3-c70c4aad607c nodeName:}" failed. No retries permitted until 2026-09-16 12:38:54.678375591 +0000 UTC m=+18.243196679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-knssd" (UniqueName: "kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd") pod "network-check-target-vkd6h" (UID: "52446251-5116-4c0d-abc3-c70c4aad607c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:38:46.915621 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:46.915584    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:46.915814 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:46.915711    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:38:46.916132 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:46.916108    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:46.916264 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:46.916242    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:38:46.916342 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:46.916317    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:46.916402 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:46.916390    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:38:48.915246 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:48.914766    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:48.915246 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:48.914893    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:38:48.915807 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:48.915291    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:48.915807 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:48.915304    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:48.915807 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:48.915404    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:38:48.915807 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:48.915526    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:38:50.914419 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:50.914391    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:50.914750 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:50.914398    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:50.914750 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:50.914503    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:38:50.914750 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:50.914543    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:50.914750 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:50.914638    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:38:50.914878 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:50.914750    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:38:52.914839 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:52.914803    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:52.914839 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:52.914836    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:52.915273 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:52.914807    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:52.915273 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:52.914924    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:38:52.915273 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:52.915042    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:38:52.915273 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:52.915111    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:38:54.538318 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:54.538286    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:54.538672 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:54.538419    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:38:54.538672 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:54.538497    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret podName:02f43e10-d508-4244-8f0c-534b182fc11d nodeName:}" failed. No retries permitted until 2026-09-16 12:39:10.53846448 +0000 UTC m=+34.103285563 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret") pod "global-pull-secret-syncer-hkcrj" (UID: "02f43e10-d508-4244-8f0c-534b182fc11d") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:38:54.639429 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:54.639392    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:54.639586 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:54.639548    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:38:54.639653 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:54.639609    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs podName:0cad7b5e-dab9-4fb5-94ab-4c7f31755c34 nodeName:}" failed. No retries permitted until 2026-09-16 12:39:10.639592792 +0000 UTC m=+34.204413874 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs") pod "network-metrics-daemon-7sbll" (UID: "0cad7b5e-dab9-4fb5-94ab-4c7f31755c34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:38:54.740208 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:54.740170    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knssd\" (UniqueName: \"kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd\") pod \"network-check-target-vkd6h\" (UID: \"52446251-5116-4c0d-abc3-c70c4aad607c\") " pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:54.740351 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:54.740323    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:38:54.740351 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:54.740342    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:38:54.740351 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:54.740351    2549 projected.go:196] Error preparing data for projected volume kube-api-access-knssd for pod openshift-network-diagnostics/network-check-target-vkd6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:38:54.740471 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:54.740397    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd podName:52446251-5116-4c0d-abc3-c70c4aad607c nodeName:}" failed. No retries permitted until 2026-09-16 12:39:10.740385514 +0000 UTC m=+34.305206588 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-knssd" (UniqueName: "kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd") pod "network-check-target-vkd6h" (UID: "52446251-5116-4c0d-abc3-c70c4aad607c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:38:54.914919 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:54.914886    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:54.915076 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:54.914923    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:54.915076 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:54.914894    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:54.915076 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:54.915010    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:38:54.915220 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:54.915117    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:38:54.915220 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:54.915192    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:38:56.914545 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:56.914515    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:56.914970 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:56.914623    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:38:56.914970 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:56.914706    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:56.914970 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:56.914811    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:38:56.914970 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:56.914852    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:56.914970 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:56.914924    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:38:58.915081 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:58.914827    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:38:58.915780 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:58.914827    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:38:58.915780 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:58.914881    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:38:58.915780 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:58.915248    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:38:58.915780 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:58.915313    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:38:58.915780 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:38:58.915379    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:38:59.098699 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.098669    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph" event={"ID":"27fe9cd7-9462-4cec-8909-81800a7fa727","Type":"ContainerStarted","Data":"3f6a2aba40852fb675428a8514ab3c40afc11b5abe8474952734e28f48328d27"}
Sep 16 12:38:59.098852 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.098736    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph" event={"ID":"27fe9cd7-9462-4cec-8909-81800a7fa727","Type":"ContainerStarted","Data":"695879c28661eb3db050614b5d3c210a2cd203ca57e147627cb79368a9601414"}
Sep 16 12:38:59.098852 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.098769    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph" event={"ID":"27fe9cd7-9462-4cec-8909-81800a7fa727","Type":"ContainerStarted","Data":"3d89e0aa2d1c59e14a6d8fefb3e096508951b211217eb03afaae27c5b097b8ff"}
Sep 16 12:38:59.098852 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.098803    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph" event={"ID":"27fe9cd7-9462-4cec-8909-81800a7fa727","Type":"ContainerStarted","Data":"aae335de4e4f28b143bb153c1b7e29955d22c162592a8700812488515ad61a16"}
Sep 16 12:38:59.098852 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.098832    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph" event={"ID":"27fe9cd7-9462-4cec-8909-81800a7fa727","Type":"ContainerStarted","Data":"31c89b7b043ee8dd41455d36b16f09c52639e89d9e40bee439b28f94f4bef293"}
Sep 16 12:38:59.099008 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.098868    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph" event={"ID":"27fe9cd7-9462-4cec-8909-81800a7fa727","Type":"ContainerStarted","Data":"54073cc939b5b35c5278e5442c889a759092ac3305b515a6023883c21abc966d"}
Sep 16 12:38:59.100045 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.100022    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5sclw" event={"ID":"6704aa38-49e4-45d6-85c9-9bca777aafdc","Type":"ContainerStarted","Data":"1c0a3125d257610ebd084f14beb9c963f28616da4e352ad51df1c994197ecb61"}
Sep 16 12:38:59.104053 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.104030    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vrmh9" event={"ID":"efc3ffc1-701b-4061-a36c-562e45bc42b0","Type":"ContainerStarted","Data":"ff79b644ae319f65f3f6bd9b75b161395555267e29abe11b30d05228f0e8d514"}
Sep 16 12:38:59.105523 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.105502    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw" event={"ID":"da232b43-2d52-41de-bfb1-135ec4f32b50","Type":"ContainerStarted","Data":"e88bfee207cafd5f3d9945b60490d52cca77a182b958f9db4792c4da8626ca40"}
Sep 16 12:38:59.106879 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.106856    2549 generic.go:356] "Generic (PLEG): container finished" podID="6f235d0a-befc-4858-9695-8ef8400e0091" containerID="9513cfd45a591914ba4a5e193c17db159a075ae3bde8bcdd8fc14b026e994449" exitCode=0
Sep 16 12:38:59.106960 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.106938    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6h7wr" event={"ID":"6f235d0a-befc-4858-9695-8ef8400e0091","Type":"ContainerDied","Data":"9513cfd45a591914ba4a5e193c17db159a075ae3bde8bcdd8fc14b026e994449"}
Sep 16 12:38:59.108332 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.108313    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6gq76" event={"ID":"42955466-fe7b-4765-9db7-390d2d3e6917","Type":"ContainerStarted","Data":"6977463af58f4b81f926d215c2ea317298a91b16e7d61d8148b7745fa1d7f355"}
Sep 16 12:38:59.109827 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.109806    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hvq7m" event={"ID":"7b99a737-c07c-4369-865c-7998a3f40d87","Type":"ContainerStarted","Data":"d4ecd4241a916dc191e23e7d7410f99557acf0a2d8a80a0aaddf3c73bafd801e"}
Sep 16 12:38:59.111152 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.111130    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fxcfd" event={"ID":"b9bc16ce-d5ef-4d7b-9632-ab2849397953","Type":"ContainerStarted","Data":"a5bac53c3ce922f31a7c6f3e4c53366e36a689baf42c84231ace127e1e71f286"}
Sep 16 12:38:59.122750 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.122715    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5sclw" podStartSLOduration=7.807807936 podStartE2EDuration="22.122703477s" totalImagesPullingTime="14.314895541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:38:59.122506446 +0000 UTC m=+22.687327528" watchObservedRunningTime="2026-09-16 12:38:59.122703477 +0000 UTC m=+22.687524567"
Sep 16 12:38:59.164619 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.164431    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hvq7m" podStartSLOduration=4.210628021 podStartE2EDuration="22.164417856s" totalImagesPullingTime="17.953789835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:38:59.147653053 +0000 UTC m=+22.712474145" watchObservedRunningTime="2026-09-16 12:38:59.164417856 +0000 UTC m=+22.729238946"
Sep 16 12:38:59.164724 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.164666    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6gq76" podStartSLOduration=4.191460745 podStartE2EDuration="22.164660683s" totalImagesPullingTime="17.973199938s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:38:59.16430635 +0000 UTC m=+22.729127441" watchObservedRunningTime="2026-09-16 12:38:59.164660683 +0000 UTC m=+22.729481773"
Sep 16 12:38:59.210102 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.210019    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fxcfd" podStartSLOduration=4.253516599 podStartE2EDuration="22.210007181s" totalImagesPullingTime="17.956490582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:38:59.181441546 +0000 UTC m=+22.746262638" watchObservedRunningTime="2026-09-16 12:38:59.210007181 +0000 UTC m=+22.774828275"
Sep 16 12:38:59.227785 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.227747    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vrmh9" podStartSLOduration=4.212728076 podStartE2EDuration="22.227736302s" totalImagesPullingTime="18.015008226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:38:59.227494278 +0000 UTC m=+22.792315366" watchObservedRunningTime="2026-09-16 12:38:59.227736302 +0000 UTC m=+22.792557393"
Sep 16 12:38:59.277427 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.277398    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:59.349131 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.349101    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:59.448950 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.448923    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:59.511976 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.511895    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:38:59.650980 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.650958    2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 16 12:38:59.852901 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.852775    2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-16T12:38:59.650976075Z","UUID":"abf3f11b-c4b6-49a8-b558-d9c721e8fbd3","Handler":null,"Name":"","Endpoint":""}
Sep 16 12:38:59.854219 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.854203    2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 16 12:38:59.854301 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:38:59.854231    2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 16 12:39:00.115861 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:00.115784    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw" event={"ID":"da232b43-2d52-41de-bfb1-135ec4f32b50","Type":"ContainerStarted","Data":"44ef1ebd167ccabe62df68857db2cc155e429e10ef7973d1a55c10b1e3450ab5"}
Sep 16 12:39:00.118196 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:00.118150    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kht82" event={"ID":"d2385c4c-3f02-44d9-a6d4-49cdc30cfc31","Type":"ContainerStarted","Data":"9e57fc9b70942c274936d35ff3f4d0228bf0c7c5b6e85c3f0a87f4cb07caef88"}
Sep 16 12:39:00.138730 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:00.138686    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kht82" podStartSLOduration=5.170786693 podStartE2EDuration="23.138669704s" totalImagesPullingTime="17.967883011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:39:00.138189726 +0000 UTC m=+23.703010818" watchObservedRunningTime="2026-09-16 12:39:00.138669704 +0000 UTC m=+23.703490795"
Sep 16 12:39:00.269193 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:00.269153    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:00.325071 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:00.325008    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:00.913916 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:00.913893    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:39:00.914020 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:00.913894    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:39:00.914020 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:00.914001    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:39:00.914136 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:00.914114    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:39:00.914192 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:00.914178    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:39:00.914272 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:00.914255    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:39:01.045245 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:01.045206    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5sclw"
Sep 16 12:39:01.045791 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:01.045770    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5sclw"
Sep 16 12:39:01.123398 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:01.123322    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph" event={"ID":"27fe9cd7-9462-4cec-8909-81800a7fa727","Type":"ContainerStarted","Data":"14b35079f00fc86d790b932908a6c4f100fa1af7b88f73e211d4ac847d8016bb"}
Sep 16 12:39:01.125269 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:01.125238    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw" event={"ID":"da232b43-2d52-41de-bfb1-135ec4f32b50","Type":"ContainerStarted","Data":"2c5d316de207e85061f03d630a7f35175ae941619d468acf8c77320ecee8b8af"}
Sep 16 12:39:01.150828 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:01.150790    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-prbmw" podStartSLOduration=4.14103456 podStartE2EDuration="24.150777649s" totalImagesPullingTime="20.009743089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:38:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:39:01.150079715 +0000 UTC m=+24.714900807" watchObservedRunningTime="2026-09-16 12:39:01.150777649 +0000 UTC m=+24.715598736"
Sep 16 12:39:02.127140 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:02.127112    2549 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 16 12:39:02.914789 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:02.914752    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:39:02.914961 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:02.914758    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:39:02.914961 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:02.914866    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:39:02.914961 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:02.914876    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:39:02.915086 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:02.914966    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:39:02.915133 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:02.915089    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:39:03.157135 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:03.157102    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5sclw"
Sep 16 12:39:03.157637 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:03.157208    2549 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 16 12:39:03.157693 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:03.157656    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5sclw"
Sep 16 12:39:03.440050 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:03.439871    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:04.914697 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:04.914672    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:39:04.915506 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:04.914672    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:39:04.915506 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:04.914784    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:39:04.915506 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:04.914875    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:39:04.915506 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:04.914930    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:39:04.915506 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:04.915007    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:39:05.137314 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:05.137277    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph" event={"ID":"27fe9cd7-9462-4cec-8909-81800a7fa727","Type":"ContainerStarted","Data":"a31b1babb0e5935fb49078a44008bb2235a7b28ca9c7d558da9fd05d6925bb08"}
Sep 16 12:39:05.137527 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:05.137509    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:39:05.139152 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:05.139126    2549 generic.go:356] "Generic (PLEG): container finished" podID="6f235d0a-befc-4858-9695-8ef8400e0091" containerID="8153337e3b9f93327dbf96a123384217f2f84bc19c9ef8e766a4f14ad293a93f" exitCode=0
Sep 16 12:39:05.139266 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:05.139159    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6h7wr" event={"ID":"6f235d0a-befc-4858-9695-8ef8400e0091","Type":"ContainerDied","Data":"8153337e3b9f93327dbf96a123384217f2f84bc19c9ef8e766a4f14ad293a93f"}
Sep 16 12:39:05.152759 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:05.152740    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:39:05.170325 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:05.170262    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph" podStartSLOduration=10.155424736 podStartE2EDuration="28.170249636s" totalImagesPullingTime="18.0148249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:39:05.168823948 +0000 UTC m=+28.733645038" watchObservedRunningTime="2026-09-16 12:39:05.170249636 +0000 UTC m=+28.735070727"
Sep 16 12:39:06.142768 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:06.142529    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:39:06.143237 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:06.142882    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:39:06.158784 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:06.158761    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:39:06.461095 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:06.461062    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hkcrj"]
Sep 16 12:39:06.461229 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:06.461220    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:39:06.461326 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:06.461308    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:39:06.466200 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:06.466157    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vkd6h"]
Sep 16 12:39:06.466342 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:06.466277    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:39:06.466409 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:06.466390    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:39:06.466775 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:06.466753    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7sbll"]
Sep 16 12:39:06.466912 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:06.466850    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:39:06.466979 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:06.466939    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:39:07.146032 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:07.146004    2549 generic.go:356] "Generic (PLEG): container finished" podID="6f235d0a-befc-4858-9695-8ef8400e0091" containerID="5d420788efe5f8f03c31a3d5c26e9670dbac1c59698f247da33d99d0099c5d33" exitCode=0
Sep 16 12:39:07.146438 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:07.146090    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6h7wr" event={"ID":"6f235d0a-befc-4858-9695-8ef8400e0091","Type":"ContainerDied","Data":"5d420788efe5f8f03c31a3d5c26e9670dbac1c59698f247da33d99d0099c5d33"}
Sep 16 12:39:07.914678 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:07.914649    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:39:07.914817 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:07.914755    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:39:07.914898 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:07.914813    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:39:07.914949 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:07.914929    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:39:08.151089 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:08.151062    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6h7wr" event={"ID":"6f235d0a-befc-4858-9695-8ef8400e0091","Type":"ContainerStarted","Data":"45322a1b1fd4828029eb98b248e5f0e7febb1e13cb3e2e5e44c9fff49361b20a"}
Sep 16 12:39:08.914856 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:08.914692    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:39:08.915000 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:08.914927    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:39:09.154765 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:09.154732    2549 generic.go:356] "Generic (PLEG): container finished" podID="6f235d0a-befc-4858-9695-8ef8400e0091" containerID="45322a1b1fd4828029eb98b248e5f0e7febb1e13cb3e2e5e44c9fff49361b20a" exitCode=0
Sep 16 12:39:09.155104 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:09.154785    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6h7wr" event={"ID":"6f235d0a-befc-4858-9695-8ef8400e0091","Type":"ContainerDied","Data":"45322a1b1fd4828029eb98b248e5f0e7febb1e13cb3e2e5e44c9fff49361b20a"}
Sep 16 12:39:09.913885 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:09.913857    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:39:09.914041 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:09.913963    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:39:09.914041 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:09.914018    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:39:09.914158 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:09.914139    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:39:10.562530 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:10.562496    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:39:10.562901 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:10.562609    2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 16 12:39:10.562901 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:10.562656    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret podName:02f43e10-d508-4244-8f0c-534b182fc11d nodeName:}" failed. No retries permitted until 2026-09-16 12:39:42.562643096 +0000 UTC m=+66.127464165 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret") pod "global-pull-secret-syncer-hkcrj" (UID: "02f43e10-d508-4244-8f0c-534b182fc11d") : object "kube-system"/"original-pull-secret" not registered
Sep 16 12:39:10.663191 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:10.663159    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:39:10.663364 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:10.663284    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:39:10.663364 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:10.663338    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs podName:0cad7b5e-dab9-4fb5-94ab-4c7f31755c34 nodeName:}" failed. No retries permitted until 2026-09-16 12:39:42.663322978 +0000 UTC m=+66.228144046 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs") pod "network-metrics-daemon-7sbll" (UID: "0cad7b5e-dab9-4fb5-94ab-4c7f31755c34") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 16 12:39:10.764451 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:10.764419    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knssd\" (UniqueName: \"kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd\") pod \"network-check-target-vkd6h\" (UID: \"52446251-5116-4c0d-abc3-c70c4aad607c\") " pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:39:10.764645 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:10.764590    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 16 12:39:10.764645 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:10.764617    2549 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 16 12:39:10.764645 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:10.764629    2549 projected.go:196] Error preparing data for projected volume kube-api-access-knssd for pod openshift-network-diagnostics/network-check-target-vkd6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:39:10.764779 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:10.764688    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd podName:52446251-5116-4c0d-abc3-c70c4aad607c nodeName:}" failed. No retries permitted until 2026-09-16 12:39:42.764671916 +0000 UTC m=+66.329492990 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-knssd" (UniqueName: "kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd") pod "network-check-target-vkd6h" (UID: "52446251-5116-4c0d-abc3-c70c4aad607c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 16 12:39:10.914232 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:10.914205    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:39:10.914403 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:10.914338    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vkd6h" podUID="52446251-5116-4c0d-abc3-c70c4aad607c"
Sep 16 12:39:11.913988 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:11.913953    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:39:11.914405 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:11.913990    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:39:11.914405 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:11.914098    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:39:11.914405 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:11.914218    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hkcrj" podUID="02f43e10-d508-4244-8f0c-534b182fc11d"
Sep 16 12:39:12.175234 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.175199    2549 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-195.ec2.internal" event="NodeReady"
Sep 16 12:39:12.175544 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.175340    2549 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 16 12:39:12.224066 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.224039    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rgxdk"]
Sep 16 12:39:12.236291 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.236267    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lgchs"]
Sep 16 12:39:12.236459 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.236439    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:12.238615 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.238590    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 16 12:39:12.238615 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.238607    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fgm9v\""
Sep 16 12:39:12.238804 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.238695    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 16 12:39:12.243957 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.243921    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rgxdk"]
Sep 16 12:39:12.244035 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.244021    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lgchs"
Sep 16 12:39:12.246367 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.246349    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 16 12:39:12.246459 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.246420    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g4k4m\""
Sep 16 12:39:12.246459 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.246420    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 16 12:39:12.246649 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.246633    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 16 12:39:12.250265 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.250244    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lgchs"]
Sep 16 12:39:12.330212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.330175    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87449cff8-9qc2c"]
Sep 16 12:39:12.364923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.364888    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:12.366017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.366000    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"]
Sep 16 12:39:12.366132 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.366110    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87449cff8-9qc2c"
Sep 16 12:39:12.368381 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.368360    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-flwlf\""
Sep 16 12:39:12.368511 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.368449    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 16 12:39:12.368511 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.368487    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 16 12:39:12.368688 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.368514    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 16 12:39:12.368778 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.368753    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 16 12:39:12.374973 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.374951    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1016f0df-c95f-49f1-bec3-251e0637e4fa-cert\") pod \"ingress-canary-lgchs\" (UID: \"1016f0df-c95f-49f1-bec3-251e0637e4fa\") " pod="openshift-ingress-canary/ingress-canary-lgchs"
Sep 16 12:39:12.375058 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.374986    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qxsv\" (UniqueName: \"kubernetes.io/projected/1016f0df-c95f-49f1-bec3-251e0637e4fa-kube-api-access-9qxsv\") pod \"ingress-canary-lgchs\" (UID: \"1016f0df-c95f-49f1-bec3-251e0637e4fa\") " pod="openshift-ingress-canary/ingress-canary-lgchs"
Sep 16 12:39:12.375058 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.375042    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:12.375147 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.375118    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2840f8d-0b93-4727-a7f3-fd9eef53c609-config-volume\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:12.375180 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.375145    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2840f8d-0b93-4727-a7f3-fd9eef53c609-tmp-dir\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:12.375180 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.375169    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvf6n\" (UniqueName: \"kubernetes.io/projected/e2840f8d-0b93-4727-a7f3-fd9eef53c609-kube-api-access-wvf6n\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:12.380209 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.380191    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87449cff8-9qc2c"]
Sep 16 12:39:12.380289 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.380220    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"]
Sep 16 12:39:12.380325 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.380297    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.382775 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.382753    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 16 12:39:12.382874 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.382802    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 16 12:39:12.382921 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.382896    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 16 12:39:12.383158 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.383142    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 16 12:39:12.464766 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.464675    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:12.475645 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.475620    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:12.475782 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.475661    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6a8136d4-ed69-47ce-be91-3aa3d7daf643-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.475782 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.475732    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2840f8d-0b93-4727-a7f3-fd9eef53c609-config-volume\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:12.475782 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.475765    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ths7h\" (UniqueName: \"kubernetes.io/projected/20203fde-9141-4bcd-8aa1-674b33d42447-kube-api-access-ths7h\") pod \"managed-serviceaccount-addon-agent-87449cff8-9qc2c\" (UID: \"20203fde-9141-4bcd-8aa1-674b33d42447\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87449cff8-9qc2c"
Sep 16 12:39:12.475912 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:12.475778    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:39:12.475912 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:12.475849    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls podName:e2840f8d-0b93-4727-a7f3-fd9eef53c609 nodeName:}" failed. No retries permitted until 2026-09-16 12:39:12.975828775 +0000 UTC m=+36.540649891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls") pod "dns-default-rgxdk" (UID: "e2840f8d-0b93-4727-a7f3-fd9eef53c609") : secret "dns-default-metrics-tls" not found
Sep 16 12:39:12.475912 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.475873    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2840f8d-0b93-4727-a7f3-fd9eef53c609-tmp-dir\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:12.475912 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.475903    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvf6n\" (UniqueName: \"kubernetes.io/projected/e2840f8d-0b93-4727-a7f3-fd9eef53c609-kube-api-access-wvf6n\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:12.476075 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.475948    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms2tl\" (UniqueName: \"kubernetes.io/projected/6a8136d4-ed69-47ce-be91-3aa3d7daf643-kube-api-access-ms2tl\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.476075 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.475988    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a8136d4-ed69-47ce-be91-3aa3d7daf643-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.476075 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.476014    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1016f0df-c95f-49f1-bec3-251e0637e4fa-cert\") pod \"ingress-canary-lgchs\" (UID: \"1016f0df-c95f-49f1-bec3-251e0637e4fa\") " pod="openshift-ingress-canary/ingress-canary-lgchs"
Sep 16 12:39:12.476075 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.476038    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qxsv\" (UniqueName: \"kubernetes.io/projected/1016f0df-c95f-49f1-bec3-251e0637e4fa-kube-api-access-9qxsv\") pod \"ingress-canary-lgchs\" (UID: \"1016f0df-c95f-49f1-bec3-251e0637e4fa\") " pod="openshift-ingress-canary/ingress-canary-lgchs"
Sep 16 12:39:12.476075 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.476064    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20203fde-9141-4bcd-8aa1-674b33d42447-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-87449cff8-9qc2c\" (UID: \"20203fde-9141-4bcd-8aa1-674b33d42447\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87449cff8-9qc2c"
Sep 16 12:39:12.476256 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.476090    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6a8136d4-ed69-47ce-be91-3aa3d7daf643-ca\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.476256 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.476113    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6a8136d4-ed69-47ce-be91-3aa3d7daf643-hub\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.476256 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.476136    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a8136d4-ed69-47ce-be91-3aa3d7daf643-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.476256 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.476167    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2840f8d-0b93-4727-a7f3-fd9eef53c609-tmp-dir\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:12.476436 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.476323    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e2840f8d-0b93-4727-a7f3-fd9eef53c609-config-volume\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:12.480650 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.480618    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1016f0df-c95f-49f1-bec3-251e0637e4fa-cert\") pod \"ingress-canary-lgchs\" (UID: \"1016f0df-c95f-49f1-bec3-251e0637e4fa\") " pod="openshift-ingress-canary/ingress-canary-lgchs"
Sep 16 12:39:12.484472 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.484450    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvf6n\" (UniqueName: \"kubernetes.io/projected/e2840f8d-0b93-4727-a7f3-fd9eef53c609-kube-api-access-wvf6n\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:12.484717 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.484684    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qxsv\" (UniqueName: \"kubernetes.io/projected/1016f0df-c95f-49f1-bec3-251e0637e4fa-kube-api-access-9qxsv\") pod \"ingress-canary-lgchs\" (UID: \"1016f0df-c95f-49f1-bec3-251e0637e4fa\") " pod="openshift-ingress-canary/ingress-canary-lgchs"
Sep 16 12:39:12.553745 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.553702    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lgchs"
Sep 16 12:39:12.577095 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.577060    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ths7h\" (UniqueName: \"kubernetes.io/projected/20203fde-9141-4bcd-8aa1-674b33d42447-kube-api-access-ths7h\") pod \"managed-serviceaccount-addon-agent-87449cff8-9qc2c\" (UID: \"20203fde-9141-4bcd-8aa1-674b33d42447\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87449cff8-9qc2c"
Sep 16 12:39:12.577238 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.577118    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms2tl\" (UniqueName: \"kubernetes.io/projected/6a8136d4-ed69-47ce-be91-3aa3d7daf643-kube-api-access-ms2tl\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.577238 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.577162    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a8136d4-ed69-47ce-be91-3aa3d7daf643-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.577238 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.577190    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20203fde-9141-4bcd-8aa1-674b33d42447-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-87449cff8-9qc2c\" (UID: \"20203fde-9141-4bcd-8aa1-674b33d42447\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87449cff8-9qc2c"
Sep 16 12:39:12.577238 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.577213    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6a8136d4-ed69-47ce-be91-3aa3d7daf643-ca\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.577238 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.577229    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6a8136d4-ed69-47ce-be91-3aa3d7daf643-hub\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.577454 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.577244    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a8136d4-ed69-47ce-be91-3aa3d7daf643-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.577454 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.577271    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6a8136d4-ed69-47ce-be91-3aa3d7daf643-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.578406 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.578290    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a8136d4-ed69-47ce-be91-3aa3d7daf643-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.580669 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.580639    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a8136d4-ed69-47ce-be91-3aa3d7daf643-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.580778 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.580645    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/20203fde-9141-4bcd-8aa1-674b33d42447-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-87449cff8-9qc2c\" (UID: \"20203fde-9141-4bcd-8aa1-674b33d42447\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87449cff8-9qc2c"
Sep 16 12:39:12.580887 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.580829    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6a8136d4-ed69-47ce-be91-3aa3d7daf643-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.581057 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.581041    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6a8136d4-ed69-47ce-be91-3aa3d7daf643-ca\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.582886 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.582865    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6a8136d4-ed69-47ce-be91-3aa3d7daf643-hub\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.586319 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.586301    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms2tl\" (UniqueName: \"kubernetes.io/projected/6a8136d4-ed69-47ce-be91-3aa3d7daf643-kube-api-access-ms2tl\") pod \"cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq\" (UID: \"6a8136d4-ed69-47ce-be91-3aa3d7daf643\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.586626 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.586603    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ths7h\" (UniqueName: \"kubernetes.io/projected/20203fde-9141-4bcd-8aa1-674b33d42447-kube-api-access-ths7h\") pod \"managed-serviceaccount-addon-agent-87449cff8-9qc2c\" (UID: \"20203fde-9141-4bcd-8aa1-674b33d42447\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87449cff8-9qc2c"
Sep 16 12:39:12.688175 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.688143    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87449cff8-9qc2c"
Sep 16 12:39:12.695302 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.695278    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:39:12.914274 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.914236    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:39:12.917310 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.917288    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 12:39:12.917426 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.917324    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 12:39:12.917654 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.917634    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x7vdr\""
Sep 16 12:39:12.980516 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:12.980432    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:12.980664 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:12.980603    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:39:12.980724 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:12.980678    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls podName:e2840f8d-0b93-4727-a7f3-fd9eef53c609 nodeName:}" failed. No retries permitted until 2026-09-16 12:39:13.980656629 +0000 UTC m=+37.545477716 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls") pod "dns-default-rgxdk" (UID: "e2840f8d-0b93-4727-a7f3-fd9eef53c609") : secret "dns-default-metrics-tls" not found
Sep 16 12:39:13.914199 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:13.914148    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:39:13.914199 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:13.914186    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:39:13.917100 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:13.916921    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 12:39:13.917749 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:13.917727    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 12:39:13.917847 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:13.917730    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b66st\""
Sep 16 12:39:13.988143 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:13.988117    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:13.988252 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:13.988213    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:39:13.988291 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:13.988263    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls podName:e2840f8d-0b93-4727-a7f3-fd9eef53c609 nodeName:}" failed. No retries permitted until 2026-09-16 12:39:15.988250608 +0000 UTC m=+39.553071677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls") pod "dns-default-rgxdk" (UID: "e2840f8d-0b93-4727-a7f3-fd9eef53c609") : secret "dns-default-metrics-tls" not found
Sep 16 12:39:14.088861 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:14.088836    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87449cff8-9qc2c"]
Sep 16 12:39:14.092357 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:14.092333    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lgchs"]
Sep 16 12:39:14.093551 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:14.093047    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"]
Sep 16 12:39:14.093551 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:39:14.093493    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20203fde_9141_4bcd_8aa1_674b33d42447.slice/crio-fe7d50f9bcae4ef9ba314dabcb133b14064830d41913ed93666d8ad8549e9358 WatchSource:0}: Error finding container fe7d50f9bcae4ef9ba314dabcb133b14064830d41913ed93666d8ad8549e9358: Status 404 returned error can't find the container with id fe7d50f9bcae4ef9ba314dabcb133b14064830d41913ed93666d8ad8549e9358
Sep 16 12:39:14.097106 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:39:14.097078    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1016f0df_c95f_49f1_bec3_251e0637e4fa.slice/crio-b4331932c6175c54cbb4aae5c8f0c95f333566eb02272705be46c3920ff55237 WatchSource:0}: Error finding container b4331932c6175c54cbb4aae5c8f0c95f333566eb02272705be46c3920ff55237: Status 404 returned error can't find the container with id b4331932c6175c54cbb4aae5c8f0c95f333566eb02272705be46c3920ff55237
Sep 16 12:39:14.098233 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:39:14.098211    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a8136d4_ed69_47ce_be91_3aa3d7daf643.slice/crio-9a6e0116dad23fb62248017ba19129fa35112cf42ab7e04271ca02ea408cbd18 WatchSource:0}: Error finding container 9a6e0116dad23fb62248017ba19129fa35112cf42ab7e04271ca02ea408cbd18: Status 404 returned error can't find the container with id 9a6e0116dad23fb62248017ba19129fa35112cf42ab7e04271ca02ea408cbd18
Sep 16 12:39:14.170149 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:14.170116    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6h7wr" event={"ID":"6f235d0a-befc-4858-9695-8ef8400e0091","Type":"ContainerStarted","Data":"d0ce8e04fe28a0b88f7907e5a14570b080e3a9baddf9b0a3d4ee0e6c2f4e98ab"}
Sep 16 12:39:14.171316 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:14.171291    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lgchs" event={"ID":"1016f0df-c95f-49f1-bec3-251e0637e4fa","Type":"ContainerStarted","Data":"b4331932c6175c54cbb4aae5c8f0c95f333566eb02272705be46c3920ff55237"}
Sep 16 12:39:14.172501 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:14.172472    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87449cff8-9qc2c" event={"ID":"20203fde-9141-4bcd-8aa1-674b33d42447","Type":"ContainerStarted","Data":"fe7d50f9bcae4ef9ba314dabcb133b14064830d41913ed93666d8ad8549e9358"}
Sep 16 12:39:14.173646 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:14.173625    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq" event={"ID":"6a8136d4-ed69-47ce-be91-3aa3d7daf643","Type":"ContainerStarted","Data":"9a6e0116dad23fb62248017ba19129fa35112cf42ab7e04271ca02ea408cbd18"}
Sep 16 12:39:15.181216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:15.181174    2549 generic.go:356] "Generic (PLEG): container finished" podID="6f235d0a-befc-4858-9695-8ef8400e0091" containerID="d0ce8e04fe28a0b88f7907e5a14570b080e3a9baddf9b0a3d4ee0e6c2f4e98ab" exitCode=0
Sep 16 12:39:15.181678 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:15.181232    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6h7wr" event={"ID":"6f235d0a-befc-4858-9695-8ef8400e0091","Type":"ContainerDied","Data":"d0ce8e04fe28a0b88f7907e5a14570b080e3a9baddf9b0a3d4ee0e6c2f4e98ab"}
Sep 16 12:39:15.610999 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:15.610887    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:15.711814 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:15.711762    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:16.002858 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:16.002813    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:16.003044 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:16.003026    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:39:16.003114 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:16.003102    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls podName:e2840f8d-0b93-4727-a7f3-fd9eef53c609 nodeName:}" failed. No retries permitted until 2026-09-16 12:39:20.003086203 +0000 UTC m=+43.567907274 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls") pod "dns-default-rgxdk" (UID: "e2840f8d-0b93-4727-a7f3-fd9eef53c609") : secret "dns-default-metrics-tls" not found
Sep 16 12:39:16.152434 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:16.152396    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:16.188811 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:16.188771    2549 generic.go:356] "Generic (PLEG): container finished" podID="6f235d0a-befc-4858-9695-8ef8400e0091" containerID="3b1db5dbbdcc2d28797917f0fc468ff87e6c4f2e03bfc00da3a14c13e2a58cb8" exitCode=0
Sep 16 12:39:16.189192 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:16.188838    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6h7wr" event={"ID":"6f235d0a-befc-4858-9695-8ef8400e0091","Type":"ContainerDied","Data":"3b1db5dbbdcc2d28797917f0fc468ff87e6c4f2e03bfc00da3a14c13e2a58cb8"}
Sep 16 12:39:17.869616 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:17.869530    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:17.965529 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:17.965496    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:18.066299 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:18.066265    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:19.199266 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:19.199239    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lgchs" event={"ID":"1016f0df-c95f-49f1-bec3-251e0637e4fa","Type":"ContainerStarted","Data":"259e74101dc4de32968915eb2966d7f9c9ff2bd182624d836448ad369c249911"}
Sep 16 12:39:19.201115 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:19.201091    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq" event={"ID":"6a8136d4-ed69-47ce-be91-3aa3d7daf643","Type":"ContainerStarted","Data":"7b0f19aa3de30e67b5f6470e50ceb5a9400c30c716ac963831fe71f807293094"}
Sep 16 12:39:19.205163 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:19.204972    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6h7wr" event={"ID":"6f235d0a-befc-4858-9695-8ef8400e0091","Type":"ContainerStarted","Data":"c2d031cd8f68f03300793d19c2eeb53833c03e18d75410a28fafc1405103d30e"}
Sep 16 12:39:19.231547 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:19.231494    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6h7wr" podStartSLOduration=11.723577066 podStartE2EDuration="42.231454726s" totalImagesPullingTime="30.50787766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:38:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:39:19.229785578 +0000 UTC m=+42.794606668" watchObservedRunningTime="2026-09-16 12:39:19.231454726 +0000 UTC m=+42.796275821"
Sep 16 12:39:19.352435 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:19.352412    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:19.452973 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:19.452944    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:20.031032 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:20.030992    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:20.031175 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:20.031149    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:39:20.031225 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:20.031216    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls podName:e2840f8d-0b93-4727-a7f3-fd9eef53c609 nodeName:}" failed. No retries permitted until 2026-09-16 12:39:28.031198336 +0000 UTC m=+51.596019430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls") pod "dns-default-rgxdk" (UID: "e2840f8d-0b93-4727-a7f3-fd9eef53c609") : secret "dns-default-metrics-tls" not found
Sep 16 12:39:20.209321 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:20.209288    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq" event={"ID":"6a8136d4-ed69-47ce-be91-3aa3d7daf643","Type":"ContainerStarted","Data":"a820f5ba47ed0386e02cda96c0860ccc263b92e62dd7d9f990a28cb1565f6b09"}
Sep 16 12:39:20.209781 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:20.209336    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq" event={"ID":"6a8136d4-ed69-47ce-be91-3aa3d7daf643","Type":"ContainerStarted","Data":"8e56285a39cf17f88773234b7a3d9e26779b1fdbcb9879e9c0b36eea6d88770e"}
Sep 16 12:39:20.231575 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:20.231534    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq" podStartSLOduration=3.257523861 podStartE2EDuration="8.231521037s" totalImagesPullingTime="4.973997176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:39:20.23016977 +0000 UTC m=+43.794990863" watchObservedRunningTime="2026-09-16 12:39:20.231521037 +0000 UTC m=+43.796342127"
Sep 16 12:39:20.249188 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:20.249149    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lgchs" podStartSLOduration=3.290300704 podStartE2EDuration="8.249135397s" totalImagesPullingTime="4.958834693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:39:20.248918766 +0000 UTC m=+43.813739857" watchObservedRunningTime="2026-09-16 12:39:20.249135397 +0000 UTC m=+43.813956481"
Sep 16 12:39:28.085697 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:28.085641    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:28.086159 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:28.085802    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:39:28.086159 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:28.085881    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls podName:e2840f8d-0b93-4727-a7f3-fd9eef53c609 nodeName:}" failed. No retries permitted until 2026-09-16 12:39:44.085865073 +0000 UTC m=+67.650686143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls") pod "dns-default-rgxdk" (UID: "e2840f8d-0b93-4727-a7f3-fd9eef53c609") : secret "dns-default-metrics-tls" not found
Sep 16 12:39:28.230263 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:28.230222    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87449cff8-9qc2c" event={"ID":"20203fde-9141-4bcd-8aa1-674b33d42447","Type":"ContainerStarted","Data":"d7dc2a9f1b3a6a1fbd29b5e4c2c96cd95996882f8c8964595ce9653723a5106b"}
Sep 16 12:39:28.249361 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:28.249312    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-87449cff8-9qc2c" podStartSLOduration=3.076412019 podStartE2EDuration="16.249298393s" totalImagesPullingTime="13.172886374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:39:28.248231058 +0000 UTC m=+51.813052143" watchObservedRunningTime="2026-09-16 12:39:28.249298393 +0000 UTC m=+51.814119539"
Sep 16 12:39:38.161130 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:38.161103    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qbqph"
Sep 16 12:39:38.337441 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:38.337409    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:38.393103 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:38.393079    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:39:42.592128 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:42.592071    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:39:42.598222 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:42.598202    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 16 12:39:42.606198 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:42.606145    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/02f43e10-d508-4244-8f0c-534b182fc11d-original-pull-secret\") pod \"global-pull-secret-syncer-hkcrj\" (UID: \"02f43e10-d508-4244-8f0c-534b182fc11d\") " pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:39:42.693345 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:42.693318    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:39:42.695903 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:42.695882    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 16 12:39:42.703875 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:42.703843    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 12:39:42.703967 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:42.703920    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs podName:0cad7b5e-dab9-4fb5-94ab-4c7f31755c34 nodeName:}" failed. No retries permitted until 2026-09-16 12:40:46.703904327 +0000 UTC m=+130.268725401 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs") pod "network-metrics-daemon-7sbll" (UID: "0cad7b5e-dab9-4fb5-94ab-4c7f31755c34") : secret "metrics-daemon-secret" not found
Sep 16 12:39:42.728506 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:42.728472    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hkcrj"
Sep 16 12:39:42.794134 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:42.794106    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knssd\" (UniqueName: \"kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd\") pod \"network-check-target-vkd6h\" (UID: \"52446251-5116-4c0d-abc3-c70c4aad607c\") " pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:39:42.797181 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:42.797156    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 16 12:39:42.807056 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:42.807038    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 16 12:39:42.818184 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:42.818164    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knssd\" (UniqueName: \"kubernetes.io/projected/52446251-5116-4c0d-abc3-c70c4aad607c-kube-api-access-knssd\") pod \"network-check-target-vkd6h\" (UID: \"52446251-5116-4c0d-abc3-c70c4aad607c\") " pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:39:42.935828 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:42.935806    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-x7vdr\""
Sep 16 12:39:42.943724 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:42.943708    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:39:42.998567 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:42.998269    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hkcrj"]
Sep 16 12:39:43.212729 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:43.212707    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vkd6h"]
Sep 16 12:39:43.214988 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:39:43.214961    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52446251_5116_4c0d_abc3_c70c4aad607c.slice/crio-e898bfcf4b01f82f7eec3ce77225a3d6929cb033e335d165e02731c72a6cad88 WatchSource:0}: Error finding container e898bfcf4b01f82f7eec3ce77225a3d6929cb033e335d165e02731c72a6cad88: Status 404 returned error can't find the container with id e898bfcf4b01f82f7eec3ce77225a3d6929cb033e335d165e02731c72a6cad88
Sep 16 12:39:43.265733 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:43.265701    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hkcrj" event={"ID":"02f43e10-d508-4244-8f0c-534b182fc11d","Type":"ContainerStarted","Data":"675f13c3cad8167f23e5b0b4465826c3492185e5b0695bed000c5dab5c9dee50"}
Sep 16 12:39:43.266757 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:43.266736    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vkd6h" event={"ID":"52446251-5116-4c0d-abc3-c70c4aad607c","Type":"ContainerStarted","Data":"e898bfcf4b01f82f7eec3ce77225a3d6929cb033e335d165e02731c72a6cad88"}
Sep 16 12:39:44.103126 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:44.103084    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:39:44.103595 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:44.103257    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:39:44.103595 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:39:44.103329    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls podName:e2840f8d-0b93-4727-a7f3-fd9eef53c609 nodeName:}" failed. No retries permitted until 2026-09-16 12:40:16.103310542 +0000 UTC m=+99.668131617 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls") pod "dns-default-rgxdk" (UID: "e2840f8d-0b93-4727-a7f3-fd9eef53c609") : secret "dns-default-metrics-tls" not found
Sep 16 12:39:48.283501 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:48.283393    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vkd6h" event={"ID":"52446251-5116-4c0d-abc3-c70c4aad607c","Type":"ContainerStarted","Data":"883c5738ac8b2858ad170a3124cdfbb3209a39430e2f320ad7dc5ac66af04d12"}
Sep 16 12:39:48.283891 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:48.283532    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:39:48.285015 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:48.284988    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hkcrj" event={"ID":"02f43e10-d508-4244-8f0c-534b182fc11d","Type":"ContainerStarted","Data":"1474fef784eac75a45697a8771affa78fcf6439a53aef8909ac638224b82fcde"}
Sep 16 12:39:48.301031 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:48.300925    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vkd6h" podStartSLOduration=66.572292795 podStartE2EDuration="1m11.300913199s" totalImagesPullingTime="4.728620404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:39:48.300672044 +0000 UTC m=+71.865493136" watchObservedRunningTime="2026-09-16 12:39:48.300913199 +0000 UTC m=+71.865734289"
Sep 16 12:39:48.318150 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:39:48.318106    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hkcrj" podStartSLOduration=66.373519884 podStartE2EDuration="1m11.318090015s" totalImagesPullingTime="4.944570131s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:39:48.317345893 +0000 UTC m=+71.882166984" watchObservedRunningTime="2026-09-16 12:39:48.318090015 +0000 UTC m=+71.882911112"
Sep 16 12:40:16.114907 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:16.114871    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:40:16.115248 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:16.115012    2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 16 12:40:16.115248 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:16.115083    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls podName:e2840f8d-0b93-4727-a7f3-fd9eef53c609 nodeName:}" failed. No retries permitted until 2026-09-16 12:41:20.11506575 +0000 UTC m=+163.679886839 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls") pod "dns-default-rgxdk" (UID: "e2840f8d-0b93-4727-a7f3-fd9eef53c609") : secret "dns-default-metrics-tls" not found
Sep 16 12:40:19.290823 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:19.290788    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vkd6h"
Sep 16 12:40:36.420546 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:36.420513    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:39.080980 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:39.080941    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:40.717020 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:40.716988    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:40.790350 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:40.790323    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:40.884543 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:40.884513    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:40.952666 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:40.952635    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:41.138518 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.138434    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jqgw8"]
Sep 16 12:40:41.140361 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.140345    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.142570 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.142546    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 16 12:40:41.142688 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.142612    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 16 12:40:41.143426 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.143406    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9z4xc\""
Sep 16 12:40:41.143500 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.143434    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 16 12:40:41.143500 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.143437    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 16 12:40:41.150065 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.150040    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:41.153569 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.153549    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jqgw8"]
Sep 16 12:40:41.218752 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.218719    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:41.279233 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.279203    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.279356 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.279242    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/868430e8-ab0a-447e-af10-1f0b5da8c360-crio-socket\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.279356 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.279339    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/868430e8-ab0a-447e-af10-1f0b5da8c360-data-volume\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.279430 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.279372    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.279430 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.279389    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcjt4\" (UniqueName: \"kubernetes.io/projected/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-api-access-fcjt4\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.342198 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.342172    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:41.380657 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.380629    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/868430e8-ab0a-447e-af10-1f0b5da8c360-crio-socket\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.380742 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.380694    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/868430e8-ab0a-447e-af10-1f0b5da8c360-data-volume\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.380742 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.380732    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.380829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.380750    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/868430e8-ab0a-447e-af10-1f0b5da8c360-crio-socket\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.380829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.380757    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcjt4\" (UniqueName: \"kubernetes.io/projected/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-api-access-fcjt4\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.380829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.380811    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.380936 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:41.380858    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:40:41.380936 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:41.380871    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:40:41.380936 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:41.380928    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls podName:868430e8-ab0a-447e-af10-1f0b5da8c360 nodeName:}" failed. No retries permitted until 2026-09-16 12:40:41.880912635 +0000 UTC m=+125.445733704 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqgw8" (UID: "868430e8-ab0a-447e-af10-1f0b5da8c360") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:40:41.381061 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:41.380942    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm podName:868430e8-ab0a-447e-af10-1f0b5da8c360 nodeName:}" failed. No retries permitted until 2026-09-16 12:40:41.880935209 +0000 UTC m=+125.445756278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqgw8" (UID: "868430e8-ab0a-447e-af10-1f0b5da8c360") : configmap "kube-rbac-proxy" not found
Sep 16 12:40:41.381061 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.380942    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/868430e8-ab0a-447e-af10-1f0b5da8c360-data-volume\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.389591 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.389540    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcjt4\" (UniqueName: \"kubernetes.io/projected/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-api-access-fcjt4\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.443151 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.443122    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:41.616146 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.616115    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:41.719854 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.719808    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:41.885080 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.885045    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.885324 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:41.885090    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:41.885324 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:41.885180    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:40:41.885324 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:41.885184    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:40:41.885324 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:41.885248    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm podName:868430e8-ab0a-447e-af10-1f0b5da8c360 nodeName:}" failed. No retries permitted until 2026-09-16 12:40:42.885231525 +0000 UTC m=+126.450052596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqgw8" (UID: "868430e8-ab0a-447e-af10-1f0b5da8c360") : configmap "kube-rbac-proxy" not found
Sep 16 12:40:41.885324 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:41.885261    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls podName:868430e8-ab0a-447e-af10-1f0b5da8c360 nodeName:}" failed. No retries permitted until 2026-09-16 12:40:42.885255808 +0000 UTC m=+126.450076877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqgw8" (UID: "868430e8-ab0a-447e-af10-1f0b5da8c360") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:40:42.892313 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:42.892281    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:42.892731 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:42.892344    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:42.892731 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:42.892392    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:40:42.892731 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:42.892433    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:40:42.892731 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:42.892457    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm podName:868430e8-ab0a-447e-af10-1f0b5da8c360 nodeName:}" failed. No retries permitted until 2026-09-16 12:40:44.892443355 +0000 UTC m=+128.457264424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqgw8" (UID: "868430e8-ab0a-447e-af10-1f0b5da8c360") : configmap "kube-rbac-proxy" not found
Sep 16 12:40:42.892731 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:42.892522    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls podName:868430e8-ab0a-447e-af10-1f0b5da8c360 nodeName:}" failed. No retries permitted until 2026-09-16 12:40:44.892468504 +0000 UTC m=+128.457289574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqgw8" (UID: "868430e8-ab0a-447e-af10-1f0b5da8c360") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:40:43.231109 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.231071    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-8mrqn"]
Sep 16 12:40:43.233103 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.233080    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-8mrqn"
Sep 16 12:40:43.235515 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.235493    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 16 12:40:43.235603 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.235577    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 16 12:40:43.236240 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.236221    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gtl6b\""
Sep 16 12:40:43.236305 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.236263    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 16 12:40:43.236348 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.236329    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 16 12:40:43.242689 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.242669    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-8mrqn"]
Sep 16 12:40:43.295465 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.295444    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/644d2417-0d74-42da-9788-d705ab20ec74-signing-key\") pod \"service-ca-568869fdc5-8mrqn\" (UID: \"644d2417-0d74-42da-9788-d705ab20ec74\") " pod="openshift-service-ca/service-ca-568869fdc5-8mrqn"
Sep 16 12:40:43.295564 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.295489    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/644d2417-0d74-42da-9788-d705ab20ec74-signing-cabundle\") pod \"service-ca-568869fdc5-8mrqn\" (UID: \"644d2417-0d74-42da-9788-d705ab20ec74\") " pod="openshift-service-ca/service-ca-568869fdc5-8mrqn"
Sep 16 12:40:43.295603 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.295567    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmcmv\" (UniqueName: \"kubernetes.io/projected/644d2417-0d74-42da-9788-d705ab20ec74-kube-api-access-zmcmv\") pod \"service-ca-568869fdc5-8mrqn\" (UID: \"644d2417-0d74-42da-9788-d705ab20ec74\") " pod="openshift-service-ca/service-ca-568869fdc5-8mrqn"
Sep 16 12:40:43.396603 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.396580    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/644d2417-0d74-42da-9788-d705ab20ec74-signing-key\") pod \"service-ca-568869fdc5-8mrqn\" (UID: \"644d2417-0d74-42da-9788-d705ab20ec74\") " pod="openshift-service-ca/service-ca-568869fdc5-8mrqn"
Sep 16 12:40:43.396697 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.396609    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/644d2417-0d74-42da-9788-d705ab20ec74-signing-cabundle\") pod \"service-ca-568869fdc5-8mrqn\" (UID: \"644d2417-0d74-42da-9788-d705ab20ec74\") " pod="openshift-service-ca/service-ca-568869fdc5-8mrqn"
Sep 16 12:40:43.396697 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.396642    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmcmv\" (UniqueName: \"kubernetes.io/projected/644d2417-0d74-42da-9788-d705ab20ec74-kube-api-access-zmcmv\") pod \"service-ca-568869fdc5-8mrqn\" (UID: \"644d2417-0d74-42da-9788-d705ab20ec74\") " pod="openshift-service-ca/service-ca-568869fdc5-8mrqn"
Sep 16 12:40:43.397212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.397185    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/644d2417-0d74-42da-9788-d705ab20ec74-signing-cabundle\") pod \"service-ca-568869fdc5-8mrqn\" (UID: \"644d2417-0d74-42da-9788-d705ab20ec74\") " pod="openshift-service-ca/service-ca-568869fdc5-8mrqn"
Sep 16 12:40:43.398973 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.398947    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/644d2417-0d74-42da-9788-d705ab20ec74-signing-key\") pod \"service-ca-568869fdc5-8mrqn\" (UID: \"644d2417-0d74-42da-9788-d705ab20ec74\") " pod="openshift-service-ca/service-ca-568869fdc5-8mrqn"
Sep 16 12:40:43.406516 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.406470    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmcmv\" (UniqueName: \"kubernetes.io/projected/644d2417-0d74-42da-9788-d705ab20ec74-kube-api-access-zmcmv\") pod \"service-ca-568869fdc5-8mrqn\" (UID: \"644d2417-0d74-42da-9788-d705ab20ec74\") " pod="openshift-service-ca/service-ca-568869fdc5-8mrqn"
Sep 16 12:40:43.542321 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.542264    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-8mrqn"
Sep 16 12:40:43.645719 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.645681    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:43.709110 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.709078    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:43.786653 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.786630    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6gq76_42955466-fe7b-4765-9db7-390d2d3e6917/dns-node-resolver/0.log"
Sep 16 12:40:43.810504 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:43.810425    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-8mrqn"]
Sep 16 12:40:43.813818 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:40:43.813792    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644d2417_0d74_42da_9788_d705ab20ec74.slice/crio-9655647e6b368c92ff44f932423954089e20f5198187163b2a795672277af488 WatchSource:0}: Error finding container 9655647e6b368c92ff44f932423954089e20f5198187163b2a795672277af488: Status 404 returned error can't find the container with id 9655647e6b368c92ff44f932423954089e20f5198187163b2a795672277af488
Sep 16 12:40:44.414720 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:44.414686    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:44.443461 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:44.443424    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-8mrqn" event={"ID":"644d2417-0d74-42da-9788-d705ab20ec74","Type":"ContainerStarted","Data":"9655647e6b368c92ff44f932423954089e20f5198187163b2a795672277af488"}
Sep 16 12:40:44.908119 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:44.908094    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:44.908262 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:44.908164    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:44.908262 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:44.908228    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:40:44.908262 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:44.908255    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:40:44.908368 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:44.908299    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm podName:868430e8-ab0a-447e-af10-1f0b5da8c360 nodeName:}" failed. No retries permitted until 2026-09-16 12:40:48.908283173 +0000 UTC m=+132.473104261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqgw8" (UID: "868430e8-ab0a-447e-af10-1f0b5da8c360") : configmap "kube-rbac-proxy" not found
Sep 16 12:40:44.908368 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:44.908315    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls podName:868430e8-ab0a-447e-af10-1f0b5da8c360 nodeName:}" failed. No retries permitted until 2026-09-16 12:40:48.908308268 +0000 UTC m=+132.473129337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqgw8" (UID: "868430e8-ab0a-447e-af10-1f0b5da8c360") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:40:44.985678 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:44.985645    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fxcfd_b9bc16ce-d5ef-4d7b-9632-ab2849397953/node-ca/0.log"
Sep 16 12:40:45.447655 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:45.447628    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-8mrqn" event={"ID":"644d2417-0d74-42da-9788-d705ab20ec74","Type":"ContainerStarted","Data":"9fd22420616bd1e4153bf45dfc15ce841a40bea2769b70b83d9bf6f47f08e334"}
Sep 16 12:40:45.464752 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:45.464397    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-8mrqn" podStartSLOduration=0.887352179 podStartE2EDuration="2.464377046s" totalImagesPullingTime="1.577024867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:40:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:40:45.464048665 +0000 UTC m=+129.028869756" watchObservedRunningTime="2026-09-16 12:40:45.464377046 +0000 UTC m=+129.029198140"
Sep 16 12:40:45.787764 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:45.787734    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lgchs_1016f0df-c95f-49f1-bec3-251e0637e4fa/serve-healthcheck-canary/0.log"
Sep 16 12:40:46.723070 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:46.723033    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:40:46.723469 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:46.723135    2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 16 12:40:46.723469 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:46.723185    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs podName:0cad7b5e-dab9-4fb5-94ab-4c7f31755c34 nodeName:}" failed. No retries permitted until 2026-09-16 12:42:48.723172491 +0000 UTC m=+252.287993559 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs") pod "network-metrics-daemon-7sbll" (UID: "0cad7b5e-dab9-4fb5-94ab-4c7f31755c34") : secret "metrics-daemon-secret" not found
Sep 16 12:40:47.249178 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:47.249137    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:47.491495 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:47.491449    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:47.591724 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:47.591627    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:47.691892 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:47.691843    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:47.793311 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:47.793278    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:47.906182 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:47.906156    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:48.001556 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:48.001529    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:48.939855 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:48.939825    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:48.940244 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:48.939867    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:48.940244 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:48.939951    2549 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 16 12:40:48.940244 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:48.939974    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:40:48.940244 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:48.940000    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm podName:868430e8-ab0a-447e-af10-1f0b5da8c360 nodeName:}" failed. No retries permitted until 2026-09-16 12:40:56.939988405 +0000 UTC m=+140.504809474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqgw8" (UID: "868430e8-ab0a-447e-af10-1f0b5da8c360") : configmap "kube-rbac-proxy" not found
Sep 16 12:40:48.940244 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:48.940024    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls podName:868430e8-ab0a-447e-af10-1f0b5da8c360 nodeName:}" failed. No retries permitted until 2026-09-16 12:40:56.940011532 +0000 UTC m=+140.504832618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqgw8" (UID: "868430e8-ab0a-447e-af10-1f0b5da8c360") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:40:49.143052 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:49.143023    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:49.341102 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:49.341028    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:50.015457 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:50.015424    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:50.089067 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:50.089039    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:50.967814 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:50.967784    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:51.134924 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:51.134892    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:51.235287 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:51.235217    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:51.344471 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:51.344439    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:51.541697 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:51.541620    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:51.752807 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:51.752774    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:52.426966 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:52.426915    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:52.498805 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:52.498779    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:52.941182 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:52.941151    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:53.139298 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:53.139260    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:53.539110 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:53.539072    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:53.730453 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:53.730413    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:53.830717 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:53.830643    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:53.978067 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:53.978036    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:54.337110 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:54.337079    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:54.935111 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:54.935081    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:55.140329 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:55.140297    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:55.540617 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:55.540588    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:55.641700 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:55.641671    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:55.741390 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:55.741354    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:56.138969 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:56.138940    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:56.736519 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:56.736470    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:57.000795 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:57.000718    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:57.000795 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:57.000757    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:57.000964 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:57.000851    2549 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 16 12:40:57.000964 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:40:57.000920    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls podName:868430e8-ab0a-447e-af10-1f0b5da8c360 nodeName:}" failed. No retries permitted until 2026-09-16 12:41:13.000902695 +0000 UTC m=+156.565723781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqgw8" (UID: "868430e8-ab0a-447e-af10-1f0b5da8c360") : secret "insights-runtime-extractor-tls" not found
Sep 16 12:40:57.001185 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:57.001167    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/868430e8-ab0a-447e-af10-1f0b5da8c360-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:40:57.136185 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:57.136149    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:57.557351 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:57.557319    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:57.737548 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:57.737509    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:57.942744 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:57.942714    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:58.884354 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:58.884319    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:58.985368 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:58.985335    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:59.180934 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:59.180907    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:59.366061 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:59.366027    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:59.432178 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:59.432105    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:59.765972 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:59.765884    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:40:59.837592 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:40:59.837558    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:00.187607 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:00.187576    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:00.574643 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:00.574572    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:00.774156 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:00.774128    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:00.904193 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:00.904116    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:01.004605 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:01.004568    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:01.987967 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:01.987925    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:02.089954 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:02.089923    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:05.491067 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:05.491034    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:05.591864 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:05.591833    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:08.016075 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:08.016045    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:08.086348 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:08.086321    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:10.484296 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:10.484262    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:10.592962 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:10.592932    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:10.689780 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:10.689742    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:10.894704 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:10.894624    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:12.003110 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:12.003082    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:12.234547 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:12.234517    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:12.335652 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:12.335592    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:12.436961 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:12.436939    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:13.015117 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:13.015084    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:41:13.017241 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:13.017221    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/868430e8-ab0a-447e-af10-1f0b5da8c360-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqgw8\" (UID: \"868430e8-ab0a-447e-af10-1f0b5da8c360\") " pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:41:13.249279 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:13.249247    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jqgw8"
Sep 16 12:41:13.517347 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:13.517301    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jqgw8"]
Sep 16 12:41:13.521382 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:41:13.521360    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868430e8_ab0a_447e_af10_1f0b5da8c360.slice/crio-49e6c1a52a98ae3fd1577078abb0ec22fb7b5fddec14b57dc93429cd87f47e66 WatchSource:0}: Error finding container 49e6c1a52a98ae3fd1577078abb0ec22fb7b5fddec14b57dc93429cd87f47e66: Status 404 returned error can't find the container with id 49e6c1a52a98ae3fd1577078abb0ec22fb7b5fddec14b57dc93429cd87f47e66
Sep 16 12:41:13.532172 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:13.532147    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jqgw8" event={"ID":"868430e8-ab0a-447e-af10-1f0b5da8c360","Type":"ContainerStarted","Data":"49e6c1a52a98ae3fd1577078abb0ec22fb7b5fddec14b57dc93429cd87f47e66"}
Sep 16 12:41:13.595830 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:13.595802    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:13.699312 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:13.699265    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:13.762905 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:13.762875    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:14.045591 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:14.045557    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:14.537968 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:14.537931    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jqgw8" event={"ID":"868430e8-ab0a-447e-af10-1f0b5da8c360","Type":"ContainerStarted","Data":"9c741fc850e97b7e526cfd90608bd30fef5b9c75ee7dfde816a99e0989c9428a"}
Sep 16 12:41:14.538136 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:14.537989    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jqgw8" event={"ID":"868430e8-ab0a-447e-af10-1f0b5da8c360","Type":"ContainerStarted","Data":"29dccb025def0c45d07003df982e29dcbfebf3fc6bf304f3ffe1b1c3084a0f13"}
Sep 16 12:41:15.246913 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:41:15.246875    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rgxdk" podUID="e2840f8d-0b93-4727-a7f3-fd9eef53c609"
Sep 16 12:41:15.397177 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:15.397146    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:15.546428 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:15.546359    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jqgw8" event={"ID":"868430e8-ab0a-447e-af10-1f0b5da8c360","Type":"ContainerStarted","Data":"0623217e7d634dc877ce46f3d80794f4dc7532172b2c03aab2fc8235f232c8e3"}
Sep 16 12:41:15.546428 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:15.546417    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:41:15.569293 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:15.569252    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jqgw8" podStartSLOduration=32.761663251 podStartE2EDuration="34.569237335s" totalImagesPullingTime="1.807574084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 12:40:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:41:15.567857674 +0000 UTC m=+159.132678766" watchObservedRunningTime="2026-09-16 12:41:15.569237335 +0000 UTC m=+159.134058461"
Sep 16 12:41:16.924972 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:41:16.924939    2549 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7sbll" podUID="0cad7b5e-dab9-4fb5-94ab-4c7f31755c34"
Sep 16 12:41:17.433239 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:17.433212    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:17.507015 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:17.506988    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:18.396258 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:18.396226    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:18.495975 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:18.495946    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:18.989948 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:18.989915    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d65db55cb-fprtv"]
Sep 16 12:41:18.992968 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:18.992952    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:18.995408 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:18.995387    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 12:41:18.995408 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:18.995393    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 12:41:18.996351 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:18.996270    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 12:41:18.996351 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:18.996312    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 12:41:18.996351 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:18.996323    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 12:41:18.996596 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:18.996360    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 12:41:18.996596 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:18.996391    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jjnxd\""
Sep 16 12:41:18.996596 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:18.996313    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 12:41:19.000588 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.000571    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 12:41:19.005033 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.005014    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d65db55cb-fprtv"]
Sep 16 12:41:19.060438 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.060410    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kzsf\" (UniqueName: \"kubernetes.io/projected/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-kube-api-access-8kzsf\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.060555 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.060441    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-serving-cert\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.060555 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.060459    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-oauth-serving-cert\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.060555 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.060521    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-oauth-config\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.060674 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.060570    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-trusted-ca-bundle\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.060674 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.060597    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-service-ca\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.060674 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.060644    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-config\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.160885 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.160860    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-oauth-config\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.160996 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.160892    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-trusted-ca-bundle\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.160996 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.160925    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-service-ca\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.161098 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.161073    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-config\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.161151 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.161123    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kzsf\" (UniqueName: \"kubernetes.io/projected/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-kube-api-access-8kzsf\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.161207 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.161162    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-serving-cert\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.161207 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.161189    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-oauth-serving-cert\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.161693 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.161670    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-service-ca\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.161815 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.161778    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-config\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.161898 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.161876    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-trusted-ca-bundle\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.162116 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.162094    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-oauth-serving-cert\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.163615 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.163592    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-serving-cert\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.163710 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.163597    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-oauth-config\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.168762 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.168739    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kzsf\" (UniqueName: \"kubernetes.io/projected/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-kube-api-access-8kzsf\") pod \"console-d65db55cb-fprtv\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") " pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.302328 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.302247    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:19.576980 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.576858    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d65db55cb-fprtv"]
Sep 16 12:41:19.579522 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:41:19.579491    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e43f7d5_9c57_4113_9554_40ca0f1a59e0.slice/crio-0c6e90702b8276c0e36e9c78ece13713dbe64ba9cafc1864da13544823c34071 WatchSource:0}: Error finding container 0c6e90702b8276c0e36e9c78ece13713dbe64ba9cafc1864da13544823c34071: Status 404 returned error can't find the container with id 0c6e90702b8276c0e36e9c78ece13713dbe64ba9cafc1864da13544823c34071
Sep 16 12:41:19.729858 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.729824    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:19.805344 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:19.805316    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:20.169354 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:20.169323    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:41:20.171828 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:20.171802    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e2840f8d-0b93-4727-a7f3-fd9eef53c609-metrics-tls\") pod \"dns-default-rgxdk\" (UID: \"e2840f8d-0b93-4727-a7f3-fd9eef53c609\") " pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:41:20.350059 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:20.350024    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fgm9v\""
Sep 16 12:41:20.357355 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:20.357325    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:41:20.561038 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:20.560944    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d65db55cb-fprtv" event={"ID":"0e43f7d5-9c57-4113-9554-40ca0f1a59e0","Type":"ContainerStarted","Data":"0c6e90702b8276c0e36e9c78ece13713dbe64ba9cafc1864da13544823c34071"}
Sep 16 12:41:20.638205 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:20.638175    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rgxdk"]
Sep 16 12:41:20.641730 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:41:20.641700    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2840f8d_0b93_4727_a7f3_fd9eef53c609.slice/crio-71406199608feab3e82eaf76178148906c295131c1e782a234cd62531bdfc26f WatchSource:0}: Error finding container 71406199608feab3e82eaf76178148906c295131c1e782a234cd62531bdfc26f: Status 404 returned error can't find the container with id 71406199608feab3e82eaf76178148906c295131c1e782a234cd62531bdfc26f
Sep 16 12:41:20.796967 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:20.796919    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:20.896972 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:20.896892    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:21.566153 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:21.566120    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rgxdk" event={"ID":"e2840f8d-0b93-4727-a7f3-fd9eef53c609","Type":"ContainerStarted","Data":"71406199608feab3e82eaf76178148906c295131c1e782a234cd62531bdfc26f"}
Sep 16 12:41:22.571044 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:22.571005    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d65db55cb-fprtv" event={"ID":"0e43f7d5-9c57-4113-9554-40ca0f1a59e0","Type":"ContainerStarted","Data":"829d6cf00493f19ba7f35a481afa8139fdb3aa45f28b2611473f8d25b5e4cda7"}
Sep 16 12:41:22.595631 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:22.595580    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d65db55cb-fprtv" podStartSLOduration=2.024976691 podStartE2EDuration="4.595562899s" totalImagesPullingTime="2.570586208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:41:22.5940227 +0000 UTC m=+166.158843790" watchObservedRunningTime="2026-09-16 12:41:22.595562899 +0000 UTC m=+166.160383990"
Sep 16 12:41:23.195495 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:23.195440    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:23.575829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:23.575737    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rgxdk" event={"ID":"e2840f8d-0b93-4727-a7f3-fd9eef53c609","Type":"ContainerStarted","Data":"90e44ccfcdeb0b746546f1dbe9ab567efcb3cc7e949a7d865c684f9f89fa2428"}
Sep 16 12:41:23.575829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:23.575791    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rgxdk" event={"ID":"e2840f8d-0b93-4727-a7f3-fd9eef53c609","Type":"ContainerStarted","Data":"e944cc9fae0a25e4bfeed59e80c4d672178b8e4f4613c7cadef83813b93b084b"}
Sep 16 12:41:23.576267 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:23.576043    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:41:23.598087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:23.598047    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rgxdk" podStartSLOduration=128.979329601 podStartE2EDuration="2m11.598031231s" totalImagesPullingTime="2.61870163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:39:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:41:23.596946089 +0000 UTC m=+167.161767180" watchObservedRunningTime="2026-09-16 12:41:23.598031231 +0000 UTC m=+167.162852322"
Sep 16 12:41:23.757264 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:23.757221    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:24.215737 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:24.215703    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:24.316359 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:24.316330    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:25.829461 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:25.829426    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:27.713871 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:27.713836    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:27.773994 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:27.773964    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:28.819532 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:28.819500    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:28.914903 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:28.914867    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:41:29.066171 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.066120    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:29.137706 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.137585    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mcffg"]
Sep 16 12:41:29.140806 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.140784    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.144328 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.144304    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 16 12:41:29.144513 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.144342    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 16 12:41:29.144949 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.144932    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 16 12:41:29.145060 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.144970    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 16 12:41:29.145127 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.144989    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 16 12:41:29.145127 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.145110    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 16 12:41:29.145234 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.145022    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-krqlf\""
Sep 16 12:41:29.193085 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.193047    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:29.234412 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.234378    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56d83072-5edc-40f0-a46e-90b5f91bbbcc-root\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.234412 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.234411    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-accelerators-collector-config\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.234639 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.234432    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56d83072-5edc-40f0-a46e-90b5f91bbbcc-sys\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.234639 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.234456    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.234639 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.234555    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbl9k\" (UniqueName: \"kubernetes.io/projected/56d83072-5edc-40f0-a46e-90b5f91bbbcc-kube-api-access-rbl9k\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.234639 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.234612    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-textfile\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.234781 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.234642    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-tls\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.234781 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.234690    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-wtmp\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.234781 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.234721    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56d83072-5edc-40f0-a46e-90b5f91bbbcc-metrics-client-ca\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.291879 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.291846    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:29.302677 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.302655    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:29.302803 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.302731    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:29.307337 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.307317    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:29.335230 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.335205    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-textfile\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.335357 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.335231    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-tls\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.335357 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.335268    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-wtmp\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.335357 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.335298    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56d83072-5edc-40f0-a46e-90b5f91bbbcc-metrics-client-ca\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.335552 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.335458    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-wtmp\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.335641 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.335622    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-textfile\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.335717 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.335697    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56d83072-5edc-40f0-a46e-90b5f91bbbcc-root\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.335763 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.335715    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/56d83072-5edc-40f0-a46e-90b5f91bbbcc-root\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.335799 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.335760    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-accelerators-collector-config\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.335841 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.335819    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56d83072-5edc-40f0-a46e-90b5f91bbbcc-sys\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.335897 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.335842    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.335897 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.335891    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbl9k\" (UniqueName: \"kubernetes.io/projected/56d83072-5edc-40f0-a46e-90b5f91bbbcc-kube-api-access-rbl9k\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.335997 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.335888    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56d83072-5edc-40f0-a46e-90b5f91bbbcc-sys\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.336051 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.335989    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56d83072-5edc-40f0-a46e-90b5f91bbbcc-metrics-client-ca\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.336280 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.336243    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-accelerators-collector-config\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.337975 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.337950    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-tls\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.338060 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.337993    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/56d83072-5edc-40f0-a46e-90b5f91bbbcc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.344987 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.344965    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbl9k\" (UniqueName: \"kubernetes.io/projected/56d83072-5edc-40f0-a46e-90b5f91bbbcc-kube-api-access-rbl9k\") pod \"node-exporter-mcffg\" (UID: \"56d83072-5edc-40f0-a46e-90b5f91bbbcc\") " pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.362632 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.362608    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:29.444424 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.444396    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:29.451371 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.451348    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mcffg"
Sep 16 12:41:29.465662 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:41:29.465623    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56d83072_5edc_40f0_a46e_90b5f91bbbcc.slice/crio-971ddb244ea829f99ec7f210793cb3baa24df66dbeb470377b4ca1acda659eb2 WatchSource:0}: Error finding container 971ddb244ea829f99ec7f210793cb3baa24df66dbeb470377b4ca1acda659eb2: Status 404 returned error can't find the container with id 971ddb244ea829f99ec7f210793cb3baa24df66dbeb470377b4ca1acda659eb2
Sep 16 12:41:29.595037 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.595000    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcffg" event={"ID":"56d83072-5edc-40f0-a46e-90b5f91bbbcc","Type":"ContainerStarted","Data":"971ddb244ea829f99ec7f210793cb3baa24df66dbeb470377b4ca1acda659eb2"}
Sep 16 12:41:29.604068 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.604043    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:41:29.745466 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.745379    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:29.844300 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.844257    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:29.989201 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:29.989167    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:30.096198 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:30.096117    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:30.216930 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:30.216893    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:30.312723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:30.312690    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:30.424678 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:30.424649    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:30.600771 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:30.600744    2549 generic.go:356] "Generic (PLEG): container finished" podID="56d83072-5edc-40f0-a46e-90b5f91bbbcc" containerID="eb9d597bc753cc20e83022d05d5b62f10d60661ef87aff931efc5299d31ed298" exitCode=0
Sep 16 12:41:30.600931 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:30.600818    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcffg" event={"ID":"56d83072-5edc-40f0-a46e-90b5f91bbbcc","Type":"ContainerDied","Data":"eb9d597bc753cc20e83022d05d5b62f10d60661ef87aff931efc5299d31ed298"}
Sep 16 12:41:30.919098 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:30.919068    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:31.605607 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:31.605566    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcffg" event={"ID":"56d83072-5edc-40f0-a46e-90b5f91bbbcc","Type":"ContainerStarted","Data":"c5d3b024f2ddd77b0b87c91103966abca02b8624df23691b802b7b322c06000c"}
Sep 16 12:41:31.605815 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:31.605623    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcffg" event={"ID":"56d83072-5edc-40f0-a46e-90b5f91bbbcc","Type":"ContainerStarted","Data":"54eaa1c4ee8f0328cd101393c3146d4a96a250684d8699ee5dea240c43edaa87"}
Sep 16 12:41:31.627404 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:31.627351    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mcffg" podStartSLOduration=1.7154919770000001 podStartE2EDuration="2.627333704s" totalImagesPullingTime="851.203107ms" totalInitContainerRuntime="60.63862ms" isStatefulPod=true podCreationTimestamp="2026-09-16 12:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:41:31.626412456 +0000 UTC m=+175.191233546" watchObservedRunningTime="2026-09-16 12:41:31.627333704 +0000 UTC m=+175.192154798"
Sep 16 12:41:32.076251 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.076218    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:32.102560 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.102531    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"]
Sep 16 12:41:32.106518 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.106499    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.110237 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.110214    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ekcfaupdehq8r\""
Sep 16 12:41:32.110345 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.110258    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 16 12:41:32.110345 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.110223    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 16 12:41:32.110345 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.110217    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 16 12:41:32.110559 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.110535    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 16 12:41:32.110683 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.110627    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-25jjl\""
Sep 16 12:41:32.110683 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.110636    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 16 12:41:32.119068 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.119049    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"]
Sep 16 12:41:32.147441 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.147422    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:32.156497 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.156459    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-grpc-tls\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.156572 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.156518    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5wm4\" (UniqueName: \"kubernetes.io/projected/6e6142c3-ca86-4fb0-bab8-c9749d052038-kube-api-access-d5wm4\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.156572 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.156557    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.156635 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.156589    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.156635 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.156610    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e6142c3-ca86-4fb0-bab8-c9749d052038-metrics-client-ca\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.156698 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.156639    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.156698 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.156669    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.156698 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.156692    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-tls\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.258001 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.257972    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-grpc-tls\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.258120 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.258015    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5wm4\" (UniqueName: \"kubernetes.io/projected/6e6142c3-ca86-4fb0-bab8-c9749d052038-kube-api-access-d5wm4\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.258120 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.258043    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.258120 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.258070    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.258120 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.258094    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e6142c3-ca86-4fb0-bab8-c9749d052038-metrics-client-ca\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.258319 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.258124    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.258319 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.258258    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.258319 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.258305    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-tls\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.258905 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.258856    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6e6142c3-ca86-4fb0-bab8-c9749d052038-metrics-client-ca\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.261407 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.261099    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-tls\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.261407 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.261193    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.261407 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.261266    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.261407 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.261345    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.261710 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.261452    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.262676 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.262659    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6e6142c3-ca86-4fb0-bab8-c9749d052038-secret-grpc-tls\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.267228 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.267205    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5wm4\" (UniqueName: \"kubernetes.io/projected/6e6142c3-ca86-4fb0-bab8-c9749d052038-kube-api-access-d5wm4\") pod \"thanos-querier-65f97c6c5d-znxdq\" (UID: \"6e6142c3-ca86-4fb0-bab8-c9749d052038\") " pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.335554 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.335499    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:32.415686 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.415663    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:32.438298 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.438278    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:32.691078 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:32.691051    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"]
Sep 16 12:41:32.694135 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:41:32.694110    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6142c3_ca86_4fb0_bab8_c9749d052038.slice/crio-0e0b54b31c068366eb1deb557ab9e2a4429ff3c3232de74b69929483e1b8895e WatchSource:0}: Error finding container 0e0b54b31c068366eb1deb557ab9e2a4429ff3c3232de74b69929483e1b8895e: Status 404 returned error can't find the container with id 0e0b54b31c068366eb1deb557ab9e2a4429ff3c3232de74b69929483e1b8895e
Sep 16 12:41:33.581433 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:33.581404    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rgxdk"
Sep 16 12:41:33.614213 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:33.614176    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq" event={"ID":"6e6142c3-ca86-4fb0-bab8-c9749d052038","Type":"ContainerStarted","Data":"0e0b54b31c068366eb1deb557ab9e2a4429ff3c3232de74b69929483e1b8895e"}
Sep 16 12:41:33.884737 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:33.884660    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:33.921984 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:33.921956    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt"]
Sep 16 12:41:33.926165 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:33.926143    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt"
Sep 16 12:41:33.928618 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:33.928597    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 16 12:41:33.928711 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:33.928599    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5bb97\""
Sep 16 12:41:33.944549 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:33.944527    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt"]
Sep 16 12:41:33.970869 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:33.970842    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bf257e1-b4d9-4361-91fe-c06a3af8d733-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-2p6vt\" (UID: \"7bf257e1-b4d9-4361-91fe-c06a3af8d733\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt"
Sep 16 12:41:33.970974 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:33.970904    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2sr9\" (UniqueName: \"kubernetes.io/projected/7bf257e1-b4d9-4361-91fe-c06a3af8d733-kube-api-access-b2sr9\") pod \"monitoring-plugin-5d85778b9d-2p6vt\" (UID: \"7bf257e1-b4d9-4361-91fe-c06a3af8d733\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt"
Sep 16 12:41:33.982195 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:33.982172    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:34.072053 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:34.072023    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2sr9\" (UniqueName: \"kubernetes.io/projected/7bf257e1-b4d9-4361-91fe-c06a3af8d733-kube-api-access-b2sr9\") pod \"monitoring-plugin-5d85778b9d-2p6vt\" (UID: \"7bf257e1-b4d9-4361-91fe-c06a3af8d733\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt"
Sep 16 12:41:34.072152 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:34.072117    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bf257e1-b4d9-4361-91fe-c06a3af8d733-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-2p6vt\" (UID: \"7bf257e1-b4d9-4361-91fe-c06a3af8d733\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt"
Sep 16 12:41:34.074520 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:34.074498    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7bf257e1-b4d9-4361-91fe-c06a3af8d733-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-2p6vt\" (UID: \"7bf257e1-b4d9-4361-91fe-c06a3af8d733\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt"
Sep 16 12:41:34.092321 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:34.092301    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:34.092407 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:34.092323    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2sr9\" (UniqueName: \"kubernetes.io/projected/7bf257e1-b4d9-4361-91fe-c06a3af8d733-kube-api-access-b2sr9\") pod \"monitoring-plugin-5d85778b9d-2p6vt\" (UID: \"7bf257e1-b4d9-4361-91fe-c06a3af8d733\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt"
Sep 16 12:41:34.184884 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:34.184856    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:34.234796 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:34.234771    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt"
Sep 16 12:41:34.513753 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:34.513665    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt"]
Sep 16 12:41:34.518123 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:41:34.518089    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bf257e1_b4d9_4361_91fe_c06a3af8d733.slice/crio-69c97c2ad1cfe32f87f35ab66d9c7239e7f1406e8faf6409f59f81d18bdd5fbc WatchSource:0}: Error finding container 69c97c2ad1cfe32f87f35ab66d9c7239e7f1406e8faf6409f59f81d18bdd5fbc: Status 404 returned error can't find the container with id 69c97c2ad1cfe32f87f35ab66d9c7239e7f1406e8faf6409f59f81d18bdd5fbc
Sep 16 12:41:34.619951 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:34.619913    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt" event={"ID":"7bf257e1-b4d9-4361-91fe-c06a3af8d733","Type":"ContainerStarted","Data":"69c97c2ad1cfe32f87f35ab66d9c7239e7f1406e8faf6409f59f81d18bdd5fbc"}
Sep 16 12:41:34.763824 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:34.763747    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:34.838206 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:34.838170    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:35.474101 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:35.474061    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:36.629815 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:36.629790    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq" event={"ID":"6e6142c3-ca86-4fb0-bab8-c9749d052038","Type":"ContainerStarted","Data":"7426822f7f4befe2e20e0a764a93ddcfa2f4f5bbfc4c7c544dc5ec4b56b64f0e"}
Sep 16 12:41:36.630114 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:36.629900    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq" event={"ID":"6e6142c3-ca86-4fb0-bab8-c9749d052038","Type":"ContainerStarted","Data":"4792339a9e01abeb73722f6e74b337c36049cda683f15a359adb25813c57dd8e"}
Sep 16 12:41:36.630114 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:36.629946    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq" event={"ID":"6e6142c3-ca86-4fb0-bab8-c9749d052038","Type":"ContainerStarted","Data":"a3b6dd39604e9188110e1e64363a49d95352ee35037b3f275438a6684f683a9d"}
Sep 16 12:41:36.631440 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:36.631415    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt" event={"ID":"7bf257e1-b4d9-4361-91fe-c06a3af8d733","Type":"ContainerStarted","Data":"a95136503499a4d0713386589c8014c4b33ee1f17be555d95437283f532fde52"}
Sep 16 12:41:36.631589 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:36.631570    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt"
Sep 16 12:41:36.636411 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:36.636385    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt"
Sep 16 12:41:36.649547 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:36.649511    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-2p6vt" podStartSLOduration=2.378050776 podStartE2EDuration="3.649496075s" totalImagesPullingTime="1.271445299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:41:36.648526573 +0000 UTC m=+180.213347665" watchObservedRunningTime="2026-09-16 12:41:36.649496075 +0000 UTC m=+180.214317162"
Sep 16 12:41:37.637243 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:37.637208    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq" event={"ID":"6e6142c3-ca86-4fb0-bab8-c9749d052038","Type":"ContainerStarted","Data":"e5908c76fcb0a212efed181df4ad16530cdcc28f912bad0e67c949c1599ee814"}
Sep 16 12:41:37.637641 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:37.637282    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq" event={"ID":"6e6142c3-ca86-4fb0-bab8-c9749d052038","Type":"ContainerStarted","Data":"875b13bc69c4d20d03428a872ed3f94f28cb2c446fddbf4ae4bad6175de8ebdc"}
Sep 16 12:41:37.637641 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:37.637312    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq" event={"ID":"6e6142c3-ca86-4fb0-bab8-c9749d052038","Type":"ContainerStarted","Data":"170e9f01dfec81b8396a863b8d961056268147d8f124e4ca8c8214e597020121"}
Sep 16 12:41:37.666868 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:37.666823    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq" podStartSLOduration=1.949688996 podStartE2EDuration="5.66680789s" totalImagesPullingTime="3.717118894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:41:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:41:37.665240295 +0000 UTC m=+181.230061407" watchObservedRunningTime="2026-09-16 12:41:37.66680789 +0000 UTC m=+181.231628981"
Sep 16 12:41:38.013918 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:38.013879    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:38.075851 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:38.075804    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:38.641328 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:38.641294    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:40.169727 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:40.169693    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:40.268752 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:40.268726    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:42.730715 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:42.730684    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:43.650473 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:43.650440    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:43.714668 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:43.714639    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:44.352331 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:44.352299    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d65db55cb-fprtv"]
Sep 16 12:41:44.467430 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:44.467393    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:44.650986 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:44.650914    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-65f97c6c5d-znxdq"
Sep 16 12:41:45.338118 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:45.338079    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:45.438428 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:45.438396    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:53.017014 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:53.016981    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:41:53.087840 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:41:53.087810    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:02.696430 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:02.696389    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq" podUID="6a8136d4-ed69-47ce-be91-3aa3d7daf643" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 16 12:42:08.006449 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:08.006400    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:08.104464 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:08.104430    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:09.370723 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.370686    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d65db55cb-fprtv" podUID="0e43f7d5-9c57-4113-9554-40ca0f1a59e0" containerName="console" containerID="cri-o://829d6cf00493f19ba7f35a481afa8139fdb3aa45f28b2611473f8d25b5e4cda7" gracePeriod=15
Sep 16 12:42:09.610600 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.610578    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:42:09.742823 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.742789    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-config\") pod \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") "
Sep 16 12:42:09.742988 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.742832    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8kzsf\" (UniqueName: \"kubernetes.io/projected/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-kube-api-access-8kzsf\") pod \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") "
Sep 16 12:42:09.742988 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.742854    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-oauth-serving-cert\") pod \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") "
Sep 16 12:42:09.742988 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.742878    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-serving-cert\") pod \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") "
Sep 16 12:42:09.742988 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.742921    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-trusted-ca-bundle\") pod \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") "
Sep 16 12:42:09.742988 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.742960    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-oauth-config\") pod \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") "
Sep 16 12:42:09.743234 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.742999    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-service-ca\") pod \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\" (UID: \"0e43f7d5-9c57-4113-9554-40ca0f1a59e0\") "
Sep 16 12:42:09.743319 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.743289    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0e43f7d5-9c57-4113-9554-40ca0f1a59e0" (UID: "0e43f7d5-9c57-4113-9554-40ca0f1a59e0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:42:09.743319 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.743301    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-config" (OuterVolumeSpecName: "console-config") pod "0e43f7d5-9c57-4113-9554-40ca0f1a59e0" (UID: "0e43f7d5-9c57-4113-9554-40ca0f1a59e0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:42:09.743435 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.743411    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0e43f7d5-9c57-4113-9554-40ca0f1a59e0" (UID: "0e43f7d5-9c57-4113-9554-40ca0f1a59e0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:42:09.743550 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.743531    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-service-ca" (OuterVolumeSpecName: "service-ca") pod "0e43f7d5-9c57-4113-9554-40ca0f1a59e0" (UID: "0e43f7d5-9c57-4113-9554-40ca0f1a59e0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:42:09.745170 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.745148    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0e43f7d5-9c57-4113-9554-40ca0f1a59e0" (UID: "0e43f7d5-9c57-4113-9554-40ca0f1a59e0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:42:09.745350 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.745336    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-kube-api-access-8kzsf" (OuterVolumeSpecName: "kube-api-access-8kzsf") pod "0e43f7d5-9c57-4113-9554-40ca0f1a59e0" (UID: "0e43f7d5-9c57-4113-9554-40ca0f1a59e0"). InnerVolumeSpecName "kube-api-access-8kzsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:42:09.745432 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.745409    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0e43f7d5-9c57-4113-9554-40ca0f1a59e0" (UID: "0e43f7d5-9c57-4113-9554-40ca0f1a59e0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:42:09.753129 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.753105    2549 generic.go:356] "Generic (PLEG): container finished" podID="0e43f7d5-9c57-4113-9554-40ca0f1a59e0" containerID="829d6cf00493f19ba7f35a481afa8139fdb3aa45f28b2611473f8d25b5e4cda7" exitCode=0
Sep 16 12:42:09.753239 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.753146    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d65db55cb-fprtv" event={"ID":"0e43f7d5-9c57-4113-9554-40ca0f1a59e0","Type":"ContainerDied","Data":"829d6cf00493f19ba7f35a481afa8139fdb3aa45f28b2611473f8d25b5e4cda7"}
Sep 16 12:42:09.753239 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.753154    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d65db55cb-fprtv"
Sep 16 12:42:09.753239 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.753181    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d65db55cb-fprtv" event={"ID":"0e43f7d5-9c57-4113-9554-40ca0f1a59e0","Type":"ContainerDied","Data":"0c6e90702b8276c0e36e9c78ece13713dbe64ba9cafc1864da13544823c34071"}
Sep 16 12:42:09.753239 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.753204    2549 scope.go:117] "RemoveContainer" containerID="829d6cf00493f19ba7f35a481afa8139fdb3aa45f28b2611473f8d25b5e4cda7"
Sep 16 12:42:09.762154 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.762138    2549 scope.go:117] "RemoveContainer" containerID="829d6cf00493f19ba7f35a481afa8139fdb3aa45f28b2611473f8d25b5e4cda7"
Sep 16 12:42:09.762434 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:42:09.762416    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"829d6cf00493f19ba7f35a481afa8139fdb3aa45f28b2611473f8d25b5e4cda7\": container with ID starting with 829d6cf00493f19ba7f35a481afa8139fdb3aa45f28b2611473f8d25b5e4cda7 not found: ID does not exist" containerID="829d6cf00493f19ba7f35a481afa8139fdb3aa45f28b2611473f8d25b5e4cda7"
Sep 16 12:42:09.762499 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.762442    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"829d6cf00493f19ba7f35a481afa8139fdb3aa45f28b2611473f8d25b5e4cda7"} err="failed to get container status \"829d6cf00493f19ba7f35a481afa8139fdb3aa45f28b2611473f8d25b5e4cda7\": rpc error: code = NotFound desc = could not find container \"829d6cf00493f19ba7f35a481afa8139fdb3aa45f28b2611473f8d25b5e4cda7\": container with ID starting with 829d6cf00493f19ba7f35a481afa8139fdb3aa45f28b2611473f8d25b5e4cda7 not found: ID does not exist"
Sep 16 12:42:09.777222 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.777193    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d65db55cb-fprtv"]
Sep 16 12:42:09.778094 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.778075    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d65db55cb-fprtv"]
Sep 16 12:42:09.843521 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.843497    2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-service-ca\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:42:09.843521 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.843516    2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-config\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:42:09.843629 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.843525    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8kzsf\" (UniqueName: \"kubernetes.io/projected/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-kube-api-access-8kzsf\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:42:09.843629 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.843534    2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-oauth-serving-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:42:09.843629 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.843543    2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-serving-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:42:09.843629 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.843551    2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-trusted-ca-bundle\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:42:09.843629 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:09.843559    2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0e43f7d5-9c57-4113-9554-40ca0f1a59e0-console-oauth-config\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:42:10.596352 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:10.596302    2549 patch_prober.go:28] interesting pod/console-d65db55cb-fprtv container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.12:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 12:42:10.596737 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:10.596375    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-d65db55cb-fprtv" podUID="0e43f7d5-9c57-4113-9554-40ca0f1a59e0" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 16 12:42:10.918340 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:10.918313    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e43f7d5-9c57-4113-9554-40ca0f1a59e0" path="/var/lib/kubelet/pods/0e43f7d5-9c57-4113-9554-40ca0f1a59e0/volumes"
Sep 16 12:42:12.696842 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:12.696804    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq" podUID="6a8136d4-ed69-47ce-be91-3aa3d7daf643" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 16 12:42:22.696819 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:22.696781    2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq" podUID="6a8136d4-ed69-47ce-be91-3aa3d7daf643" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 16 12:42:22.697275 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:22.696852    2549 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq"
Sep 16 12:42:22.697427 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:22.697405    2549 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"a820f5ba47ed0386e02cda96c0860ccc263b92e62dd7d9f990a28cb1565f6b09"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 16 12:42:22.697519 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:22.697452    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq" podUID="6a8136d4-ed69-47ce-be91-3aa3d7daf643" containerName="service-proxy" containerID="cri-o://a820f5ba47ed0386e02cda96c0860ccc263b92e62dd7d9f990a28cb1565f6b09" gracePeriod=30
Sep 16 12:42:23.802968 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:23.802932    2549 generic.go:356] "Generic (PLEG): container finished" podID="6a8136d4-ed69-47ce-be91-3aa3d7daf643" containerID="a820f5ba47ed0386e02cda96c0860ccc263b92e62dd7d9f990a28cb1565f6b09" exitCode=2
Sep 16 12:42:23.803356 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:23.803013    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq" event={"ID":"6a8136d4-ed69-47ce-be91-3aa3d7daf643","Type":"ContainerDied","Data":"a820f5ba47ed0386e02cda96c0860ccc263b92e62dd7d9f990a28cb1565f6b09"}
Sep 16 12:42:23.803356 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:23.803057    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7c4d58dcf7-qjxgq" event={"ID":"6a8136d4-ed69-47ce-be91-3aa3d7daf643","Type":"ContainerStarted","Data":"a6654ffc4db980ff09f9437f480b6c50ea2ed2ffadda335e434c4d117e67cbff"}
Sep 16 12:42:28.133804 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:28.133773    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:28.222052 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:28.222021    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:32.633927 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:32.633897    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:32.731562 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:32.731527    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:33.163165 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:33.163137    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:48.461571 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:48.461535    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:48.811126 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:48.811040    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:42:48.813304 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:48.813274    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0cad7b5e-dab9-4fb5-94ab-4c7f31755c34-metrics-certs\") pod \"network-metrics-daemon-7sbll\" (UID: \"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34\") " pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:42:48.873629 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:48.873603    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:49.018299 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:49.018273    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b66st\""
Sep 16 12:42:49.025693 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:49.025679    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7sbll"
Sep 16 12:42:49.296065 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:49.296005    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7sbll"]
Sep 16 12:42:49.298647 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:42:49.298609    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cad7b5e_dab9_4fb5_94ab_4c7f31755c34.slice/crio-bc5624ed3f97b8ae63c922c2bf248f1989cfe9ecd69b9385dff047a3199ed316 WatchSource:0}: Error finding container bc5624ed3f97b8ae63c922c2bf248f1989cfe9ecd69b9385dff047a3199ed316: Status 404 returned error can't find the container with id bc5624ed3f97b8ae63c922c2bf248f1989cfe9ecd69b9385dff047a3199ed316
Sep 16 12:42:49.888296 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:49.888263    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7sbll" event={"ID":"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34","Type":"ContainerStarted","Data":"bc5624ed3f97b8ae63c922c2bf248f1989cfe9ecd69b9385dff047a3199ed316"}
Sep 16 12:42:50.893457 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:50.893375    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7sbll" event={"ID":"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34","Type":"ContainerStarted","Data":"ad6a17038d823ca1d9af49a14c54015859d403983094d78dc469a4bc75eeddf9"}
Sep 16 12:42:50.893457 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:50.893439    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7sbll" event={"ID":"0cad7b5e-dab9-4fb5-94ab-4c7f31755c34","Type":"ContainerStarted","Data":"1717e79c4f6180f9e691dd3519d4293fac8adbb2089a9f6393b55cc33387ada9"}
Sep 16 12:42:50.913748 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:50.913703    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7sbll" podStartSLOduration=252.656609757 podStartE2EDuration="4m13.913686722s" totalImagesPullingTime="1.257076965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:42:50.912709079 +0000 UTC m=+254.477530170" watchObservedRunningTime="2026-09-16 12:42:50.913686722 +0000 UTC m=+254.478507813"
Sep 16 12:42:51.077336 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:51.077303    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:51.178037 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:51.178015    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:58.233701 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.233656    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-bd44994cf-jzms5"]
Sep 16 12:42:58.234079 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.233902    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e43f7d5-9c57-4113-9554-40ca0f1a59e0" containerName="console"
Sep 16 12:42:58.234079 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.233914    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e43f7d5-9c57-4113-9554-40ca0f1a59e0" containerName="console"
Sep 16 12:42:58.234079 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.233971    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e43f7d5-9c57-4113-9554-40ca0f1a59e0" containerName="console"
Sep 16 12:42:58.235794 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.235778    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.238842 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.238818    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 16 12:42:58.238959 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.238893    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 16 12:42:58.239660 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.239630    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 16 12:42:58.239660 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.239635    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 16 12:42:58.239833 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.239773    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 16 12:42:58.239890 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.239852    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 16 12:42:58.242605 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.242588    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 16 12:42:58.243037 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.243023    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jjnxd\""
Sep 16 12:42:58.252553 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.252526    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 16 12:42:58.254537 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.254514    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd44994cf-jzms5"]
Sep 16 12:42:58.273227 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.273202    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-config\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.273327 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.273233    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-trusted-ca-bundle\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.273327 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.273256    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cggfz\" (UniqueName: \"kubernetes.io/projected/0859b18b-1961-46c5-8ce0-48b71fcf154e-kube-api-access-cggfz\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.273327 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.273317    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-oauth-serving-cert\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.273425 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.273346    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-oauth-config\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.273425 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.273382    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-serving-cert\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.273425 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.273403    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-service-ca\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.301050 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.301027    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:58.367308 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.367257    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:58.374404 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.374378    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-oauth-serving-cert\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.374548 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.374412    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-oauth-config\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.374548 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.374440    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-serving-cert\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.374548 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.374458    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-service-ca\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.374548 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.374501    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-config\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.374548 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.374518    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-trusted-ca-bundle\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.374548 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.374536    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cggfz\" (UniqueName: \"kubernetes.io/projected/0859b18b-1961-46c5-8ce0-48b71fcf154e-kube-api-access-cggfz\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.375229 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.375207    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-oauth-serving-cert\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.375385 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.375267    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-config\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.375493 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.375278    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-service-ca\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.375618 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.375594    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-trusted-ca-bundle\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.377036 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.377015    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-serving-cert\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.377118 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.377070    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-oauth-config\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.384128 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.384108    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cggfz\" (UniqueName: \"kubernetes.io/projected/0859b18b-1961-46c5-8ce0-48b71fcf154e-kube-api-access-cggfz\") pod \"console-bd44994cf-jzms5\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") " pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.450662 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.450621    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:42:58.544848 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.544762    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:42:58.813502 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.813410    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-bd44994cf-jzms5"]
Sep 16 12:42:58.816277 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:42:58.816250    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0859b18b_1961_46c5_8ce0_48b71fcf154e.slice/crio-78d87bc3b212814aa5db8795349c3dea5a481191db59eb32cb4f31f286ef8020 WatchSource:0}: Error finding container 78d87bc3b212814aa5db8795349c3dea5a481191db59eb32cb4f31f286ef8020: Status 404 returned error can't find the container with id 78d87bc3b212814aa5db8795349c3dea5a481191db59eb32cb4f31f286ef8020
Sep 16 12:42:58.920978 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.920919    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd44994cf-jzms5" event={"ID":"0859b18b-1961-46c5-8ce0-48b71fcf154e","Type":"ContainerStarted","Data":"a929b53551edbc43ec26a925ba79704a2b04db6ac72e2e1f30d284f5371b25a6"}
Sep 16 12:42:58.920978 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.920983    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd44994cf-jzms5" event={"ID":"0859b18b-1961-46c5-8ce0-48b71fcf154e","Type":"ContainerStarted","Data":"78d87bc3b212814aa5db8795349c3dea5a481191db59eb32cb4f31f286ef8020"}
Sep 16 12:42:58.940295 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:42:58.940238    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-bd44994cf-jzms5" podStartSLOduration=0.940218828 podStartE2EDuration="940.218828ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:42:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:42:58.939737155 +0000 UTC m=+262.504558284" watchObservedRunningTime="2026-09-16 12:42:58.940218828 +0000 UTC m=+262.505039920"
Sep 16 12:43:01.232127 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:43:01.232095    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:43:01.293867 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:43:01.293838    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:43:08.545372 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:43:08.545333    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:43:08.545828 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:43:08.545420    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:43:08.550053 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:43:08.550031    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:43:08.957885 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:43:08.957858    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:43:09.114224 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:43:09.114192    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:43:09.178090 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:43:09.178060    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:43:09.242741 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:43:09.242676    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:43:36.807766 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:43:36.807738    2549 kubelet.go:1648] "Image garbage collection succeeded"
Sep 16 12:43:42.084566 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:43:42.084528    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:43:46.671551 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:43:46.671513    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:43:46.773312 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:43:46.773284    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:44:03.730022 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:03.729970    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:44:03.825570 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:03.825541    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:44:03.931256 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:03.931221    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:44:03.998449 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:03.998385    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:44:14.472099 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:14.472066    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd44994cf-jzms5"]
Sep 16 12:44:14.589563 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:14.589511    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:44:14.648531 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:14.648498    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:44:14.704239 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:14.704212    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:44:15.783701 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:15.783669    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:44:15.844024 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:15.843991    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:44:23.013094 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:23.013057    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:44:23.111968 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:23.111936    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:44:39.493213 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.493113    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-bd44994cf-jzms5" podUID="0859b18b-1961-46c5-8ce0-48b71fcf154e" containerName="console" containerID="cri-o://a929b53551edbc43ec26a925ba79704a2b04db6ac72e2e1f30d284f5371b25a6" gracePeriod=15
Sep 16 12:44:39.722991 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.722969    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:44:39.857990 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.857915    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-oauth-config\") pod \"0859b18b-1961-46c5-8ce0-48b71fcf154e\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") "
Sep 16 12:44:39.857990 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.857955    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cggfz\" (UniqueName: \"kubernetes.io/projected/0859b18b-1961-46c5-8ce0-48b71fcf154e-kube-api-access-cggfz\") pod \"0859b18b-1961-46c5-8ce0-48b71fcf154e\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") "
Sep 16 12:44:39.858161 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.857991    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-config\") pod \"0859b18b-1961-46c5-8ce0-48b71fcf154e\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") "
Sep 16 12:44:39.858161 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.858121    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-trusted-ca-bundle\") pod \"0859b18b-1961-46c5-8ce0-48b71fcf154e\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") "
Sep 16 12:44:39.858268 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.858175    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-service-ca\") pod \"0859b18b-1961-46c5-8ce0-48b71fcf154e\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") "
Sep 16 12:44:39.858268 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.858203    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-serving-cert\") pod \"0859b18b-1961-46c5-8ce0-48b71fcf154e\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") "
Sep 16 12:44:39.858268 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.858236    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-oauth-serving-cert\") pod \"0859b18b-1961-46c5-8ce0-48b71fcf154e\" (UID: \"0859b18b-1961-46c5-8ce0-48b71fcf154e\") "
Sep 16 12:44:39.858514 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.858471    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-config" (OuterVolumeSpecName: "console-config") pod "0859b18b-1961-46c5-8ce0-48b71fcf154e" (UID: "0859b18b-1961-46c5-8ce0-48b71fcf154e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:44:39.858599 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.858555    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0859b18b-1961-46c5-8ce0-48b71fcf154e" (UID: "0859b18b-1961-46c5-8ce0-48b71fcf154e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:44:39.858653 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.858620    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-service-ca" (OuterVolumeSpecName: "service-ca") pod "0859b18b-1961-46c5-8ce0-48b71fcf154e" (UID: "0859b18b-1961-46c5-8ce0-48b71fcf154e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:44:39.858757 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.858733    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0859b18b-1961-46c5-8ce0-48b71fcf154e" (UID: "0859b18b-1961-46c5-8ce0-48b71fcf154e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:44:39.860127 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.860107    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0859b18b-1961-46c5-8ce0-48b71fcf154e" (UID: "0859b18b-1961-46c5-8ce0-48b71fcf154e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:44:39.860597 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.860571    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0859b18b-1961-46c5-8ce0-48b71fcf154e" (UID: "0859b18b-1961-46c5-8ce0-48b71fcf154e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:44:39.860649 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.860582    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0859b18b-1961-46c5-8ce0-48b71fcf154e-kube-api-access-cggfz" (OuterVolumeSpecName: "kube-api-access-cggfz") pod "0859b18b-1961-46c5-8ce0-48b71fcf154e" (UID: "0859b18b-1961-46c5-8ce0-48b71fcf154e"). InnerVolumeSpecName "kube-api-access-cggfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:44:39.958724 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.958703    2549 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-service-ca\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:44:39.958724 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.958723    2549 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-serving-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:44:39.958850 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.958732    2549 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-oauth-serving-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:44:39.958850 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.958741    2549 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-oauth-config\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:44:39.958850 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.958749    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cggfz\" (UniqueName: \"kubernetes.io/projected/0859b18b-1961-46c5-8ce0-48b71fcf154e-kube-api-access-cggfz\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:44:39.958850 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.958757    2549 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-console-config\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:44:39.958850 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:39.958765    2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0859b18b-1961-46c5-8ce0-48b71fcf154e-trusted-ca-bundle\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:44:40.253241 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:40.253212    2549 generic.go:356] "Generic (PLEG): container finished" podID="0859b18b-1961-46c5-8ce0-48b71fcf154e" containerID="a929b53551edbc43ec26a925ba79704a2b04db6ac72e2e1f30d284f5371b25a6" exitCode=0
Sep 16 12:44:40.253380 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:40.253270    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd44994cf-jzms5" event={"ID":"0859b18b-1961-46c5-8ce0-48b71fcf154e","Type":"ContainerDied","Data":"a929b53551edbc43ec26a925ba79704a2b04db6ac72e2e1f30d284f5371b25a6"}
Sep 16 12:44:40.253380 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:40.253285    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-bd44994cf-jzms5"
Sep 16 12:44:40.253380 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:40.253316    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-bd44994cf-jzms5" event={"ID":"0859b18b-1961-46c5-8ce0-48b71fcf154e","Type":"ContainerDied","Data":"78d87bc3b212814aa5db8795349c3dea5a481191db59eb32cb4f31f286ef8020"}
Sep 16 12:44:40.253380 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:40.253338    2549 scope.go:117] "RemoveContainer" containerID="a929b53551edbc43ec26a925ba79704a2b04db6ac72e2e1f30d284f5371b25a6"
Sep 16 12:44:40.261679 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:40.261656    2549 scope.go:117] "RemoveContainer" containerID="a929b53551edbc43ec26a925ba79704a2b04db6ac72e2e1f30d284f5371b25a6"
Sep 16 12:44:40.261937 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:44:40.261919    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a929b53551edbc43ec26a925ba79704a2b04db6ac72e2e1f30d284f5371b25a6\": container with ID starting with a929b53551edbc43ec26a925ba79704a2b04db6ac72e2e1f30d284f5371b25a6 not found: ID does not exist" containerID="a929b53551edbc43ec26a925ba79704a2b04db6ac72e2e1f30d284f5371b25a6"
Sep 16 12:44:40.261992 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:40.261947    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a929b53551edbc43ec26a925ba79704a2b04db6ac72e2e1f30d284f5371b25a6"} err="failed to get container status \"a929b53551edbc43ec26a925ba79704a2b04db6ac72e2e1f30d284f5371b25a6\": rpc error: code = NotFound desc = could not find container \"a929b53551edbc43ec26a925ba79704a2b04db6ac72e2e1f30d284f5371b25a6\": container with ID starting with a929b53551edbc43ec26a925ba79704a2b04db6ac72e2e1f30d284f5371b25a6 not found: ID does not exist"
Sep 16 12:44:40.274278 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:40.274257    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-bd44994cf-jzms5"]
Sep 16 12:44:40.277788 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:40.277768    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-bd44994cf-jzms5"]
Sep 16 12:44:40.918947 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:44:40.918906    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0859b18b-1961-46c5-8ce0-48b71fcf154e" path="/var/lib/kubelet/pods/0859b18b-1961-46c5-8ce0-48b71fcf154e/volumes"
Sep 16 12:45:00.987190 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:00.987153    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:01.039921 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:01.039887    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:25.382946 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:25.382904    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:25.481010 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:25.480977    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:26.124376 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.124337    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"]
Sep 16 12:45:26.124653 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.124639    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0859b18b-1961-46c5-8ce0-48b71fcf154e" containerName="console"
Sep 16 12:45:26.124702 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.124655    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="0859b18b-1961-46c5-8ce0-48b71fcf154e" containerName="console"
Sep 16 12:45:26.124736 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.124704    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="0859b18b-1961-46c5-8ce0-48b71fcf154e" containerName="console"
Sep 16 12:45:26.127787 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.127771    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"
Sep 16 12:45:26.130345 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.130324    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 12:45:26.130938 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.130923    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5ttwq\""
Sep 16 12:45:26.130999 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.130925    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 12:45:26.137591 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.137572    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"]
Sep 16 12:45:26.176443 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.176416    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a579645-be98-4eee-a9e4-2e78b7356c54-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z\" (UID: \"8a579645-be98-4eee-a9e4-2e78b7356c54\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"
Sep 16 12:45:26.176590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.176448    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a579645-be98-4eee-a9e4-2e78b7356c54-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z\" (UID: \"8a579645-be98-4eee-a9e4-2e78b7356c54\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"
Sep 16 12:45:26.176590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.176490    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vckwc\" (UniqueName: \"kubernetes.io/projected/8a579645-be98-4eee-a9e4-2e78b7356c54-kube-api-access-vckwc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z\" (UID: \"8a579645-be98-4eee-a9e4-2e78b7356c54\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"
Sep 16 12:45:26.277045 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.277014    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a579645-be98-4eee-a9e4-2e78b7356c54-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z\" (UID: \"8a579645-be98-4eee-a9e4-2e78b7356c54\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"
Sep 16 12:45:26.277045 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.277046    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a579645-be98-4eee-a9e4-2e78b7356c54-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z\" (UID: \"8a579645-be98-4eee-a9e4-2e78b7356c54\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"
Sep 16 12:45:26.277228 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.277068    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vckwc\" (UniqueName: \"kubernetes.io/projected/8a579645-be98-4eee-a9e4-2e78b7356c54-kube-api-access-vckwc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z\" (UID: \"8a579645-be98-4eee-a9e4-2e78b7356c54\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"
Sep 16 12:45:26.277378 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.277358    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a579645-be98-4eee-a9e4-2e78b7356c54-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z\" (UID: \"8a579645-be98-4eee-a9e4-2e78b7356c54\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"
Sep 16 12:45:26.277442 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.277409    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a579645-be98-4eee-a9e4-2e78b7356c54-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z\" (UID: \"8a579645-be98-4eee-a9e4-2e78b7356c54\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"
Sep 16 12:45:26.286384 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.286357    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vckwc\" (UniqueName: \"kubernetes.io/projected/8a579645-be98-4eee-a9e4-2e78b7356c54-kube-api-access-vckwc\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z\" (UID: \"8a579645-be98-4eee-a9e4-2e78b7356c54\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"
Sep 16 12:45:26.436440 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.436419    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"
Sep 16 12:45:26.713050 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.712975    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"]
Sep 16 12:45:26.717779 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:45:26.717753    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a579645_be98_4eee_a9e4_2e78b7356c54.slice/crio-fb10dc49734c91e7f005d6d3e3bc8f43d80919d8877b54a88b2d20c70c38b457 WatchSource:0}: Error finding container fb10dc49734c91e7f005d6d3e3bc8f43d80919d8877b54a88b2d20c70c38b457: Status 404 returned error can't find the container with id fb10dc49734c91e7f005d6d3e3bc8f43d80919d8877b54a88b2d20c70c38b457
Sep 16 12:45:26.719887 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:26.719871    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:45:27.416639 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:27.416607    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z" event={"ID":"8a579645-be98-4eee-a9e4-2e78b7356c54","Type":"ContainerStarted","Data":"fb10dc49734c91e7f005d6d3e3bc8f43d80919d8877b54a88b2d20c70c38b457"}
Sep 16 12:45:33.440263 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:33.440230    2549 generic.go:356] "Generic (PLEG): container finished" podID="8a579645-be98-4eee-a9e4-2e78b7356c54" containerID="2e1f23fb91d865574662bfc0274cbd4d745c1051afbb9528f6c0c5ed06b65223" exitCode=0
Sep 16 12:45:33.440685 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:33.440309    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z" event={"ID":"8a579645-be98-4eee-a9e4-2e78b7356c54","Type":"ContainerDied","Data":"2e1f23fb91d865574662bfc0274cbd4d745c1051afbb9528f6c0c5ed06b65223"}
Sep 16 12:45:36.453176 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:36.453141    2549 generic.go:356] "Generic (PLEG): container finished" podID="8a579645-be98-4eee-a9e4-2e78b7356c54" containerID="8ffadb3ca56b15081241e924692a1e11feda62f7d557ec2e12d1bfcfb0e268d9" exitCode=0
Sep 16 12:45:36.453584 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:36.453180    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z" event={"ID":"8a579645-be98-4eee-a9e4-2e78b7356c54","Type":"ContainerDied","Data":"8ffadb3ca56b15081241e924692a1e11feda62f7d557ec2e12d1bfcfb0e268d9"}
Sep 16 12:45:43.488315 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:43.488279    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z" event={"ID":"8a579645-be98-4eee-a9e4-2e78b7356c54","Type":"ContainerStarted","Data":"d581269e6175e2dd51908f76303665ea047e54504153bde83d4c6a0f0a3260aa"}
Sep 16 12:45:43.508514 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:43.508447    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z" podStartSLOduration=1.743038012 podStartE2EDuration="17.508426878s" totalImagesPullingTime="15.765388866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:45:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:45:43.508054618 +0000 UTC m=+427.072875737" watchObservedRunningTime="2026-09-16 12:45:43.508426878 +0000 UTC m=+427.073247970"
Sep 16 12:45:44.493047 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:44.493014    2549 generic.go:356] "Generic (PLEG): container finished" podID="8a579645-be98-4eee-a9e4-2e78b7356c54" containerID="d581269e6175e2dd51908f76303665ea047e54504153bde83d4c6a0f0a3260aa" exitCode=0
Sep 16 12:45:44.493537 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:44.493108    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z" event={"ID":"8a579645-be98-4eee-a9e4-2e78b7356c54","Type":"ContainerDied","Data":"d581269e6175e2dd51908f76303665ea047e54504153bde83d4c6a0f0a3260aa"}
Sep 16 12:45:45.616132 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:45.616109    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"
Sep 16 12:45:45.723292 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:45.723264    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vckwc\" (UniqueName: \"kubernetes.io/projected/8a579645-be98-4eee-a9e4-2e78b7356c54-kube-api-access-vckwc\") pod \"8a579645-be98-4eee-a9e4-2e78b7356c54\" (UID: \"8a579645-be98-4eee-a9e4-2e78b7356c54\") "
Sep 16 12:45:45.723441 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:45.723363    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a579645-be98-4eee-a9e4-2e78b7356c54-bundle\") pod \"8a579645-be98-4eee-a9e4-2e78b7356c54\" (UID: \"8a579645-be98-4eee-a9e4-2e78b7356c54\") "
Sep 16 12:45:45.723441 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:45.723391    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a579645-be98-4eee-a9e4-2e78b7356c54-util\") pod \"8a579645-be98-4eee-a9e4-2e78b7356c54\" (UID: \"8a579645-be98-4eee-a9e4-2e78b7356c54\") "
Sep 16 12:45:45.724007 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:45.723980    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a579645-be98-4eee-a9e4-2e78b7356c54-bundle" (OuterVolumeSpecName: "bundle") pod "8a579645-be98-4eee-a9e4-2e78b7356c54" (UID: "8a579645-be98-4eee-a9e4-2e78b7356c54"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:45:45.725412 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:45.725391    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a579645-be98-4eee-a9e4-2e78b7356c54-kube-api-access-vckwc" (OuterVolumeSpecName: "kube-api-access-vckwc") pod "8a579645-be98-4eee-a9e4-2e78b7356c54" (UID: "8a579645-be98-4eee-a9e4-2e78b7356c54"). InnerVolumeSpecName "kube-api-access-vckwc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:45:45.727926 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:45.727903    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a579645-be98-4eee-a9e4-2e78b7356c54-util" (OuterVolumeSpecName: "util") pod "8a579645-be98-4eee-a9e4-2e78b7356c54" (UID: "8a579645-be98-4eee-a9e4-2e78b7356c54"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:45:45.824157 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:45.824099    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vckwc\" (UniqueName: \"kubernetes.io/projected/8a579645-be98-4eee-a9e4-2e78b7356c54-kube-api-access-vckwc\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:45:45.824157 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:45.824122    2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8a579645-be98-4eee-a9e4-2e78b7356c54-bundle\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:45:45.824157 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:45.824131    2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8a579645-be98-4eee-a9e4-2e78b7356c54-util\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:45:46.501236 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:46.501202    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z" event={"ID":"8a579645-be98-4eee-a9e4-2e78b7356c54","Type":"ContainerDied","Data":"fb10dc49734c91e7f005d6d3e3bc8f43d80919d8877b54a88b2d20c70c38b457"}
Sep 16 12:45:46.501236 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:46.501225    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408z52z"
Sep 16 12:45:46.501503 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:46.501247    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fb10dc49734c91e7f005d6d3e3bc8f43d80919d8877b54a88b2d20c70c38b457"
Sep 16 12:45:52.204330 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:52.204242    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:53.562666 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:53.562628    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:55.799685 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:55.799654    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:55.907510 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:55.906214    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:58.062383 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.062349    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:58.147411 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.147380    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:58.351543 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.351455    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:58.448626 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.448595    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:45:58.918625 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.918597    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"]
Sep 16 12:45:58.918825 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.918814    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a579645-be98-4eee-a9e4-2e78b7356c54" containerName="util"
Sep 16 12:45:58.918868 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.918827    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a579645-be98-4eee-a9e4-2e78b7356c54" containerName="util"
Sep 16 12:45:58.918868 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.918841    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a579645-be98-4eee-a9e4-2e78b7356c54" containerName="pull"
Sep 16 12:45:58.918868 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.918846    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a579645-be98-4eee-a9e4-2e78b7356c54" containerName="pull"
Sep 16 12:45:58.918868 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.918853    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a579645-be98-4eee-a9e4-2e78b7356c54" containerName="extract"
Sep 16 12:45:58.918868 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.918858    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a579645-be98-4eee-a9e4-2e78b7356c54" containerName="extract"
Sep 16 12:45:58.919014 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.918897    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a579645-be98-4eee-a9e4-2e78b7356c54" containerName="extract"
Sep 16 12:45:58.923361 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.923342    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"
Sep 16 12:45:58.926595 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.926565    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5ttwq\""
Sep 16 12:45:58.926713 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.926601    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 12:45:58.926713 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.926626    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 12:45:58.927166 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:58.927141    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"]
Sep 16 12:45:59.006215 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:59.006191    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72db92f6-6275-48b7-a47e-e670a59536c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w\" (UID: \"72db92f6-6275-48b7-a47e-e670a59536c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"
Sep 16 12:45:59.006309 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:59.006231    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72db92f6-6275-48b7-a47e-e670a59536c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w\" (UID: \"72db92f6-6275-48b7-a47e-e670a59536c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"
Sep 16 12:45:59.006356 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:59.006306    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gl85j\" (UniqueName: \"kubernetes.io/projected/72db92f6-6275-48b7-a47e-e670a59536c4-kube-api-access-gl85j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w\" (UID: \"72db92f6-6275-48b7-a47e-e670a59536c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"
Sep 16 12:45:59.107015 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:59.106972    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gl85j\" (UniqueName: \"kubernetes.io/projected/72db92f6-6275-48b7-a47e-e670a59536c4-kube-api-access-gl85j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w\" (UID: \"72db92f6-6275-48b7-a47e-e670a59536c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"
Sep 16 12:45:59.107015 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:59.107019    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72db92f6-6275-48b7-a47e-e670a59536c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w\" (UID: \"72db92f6-6275-48b7-a47e-e670a59536c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"
Sep 16 12:45:59.107386 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:59.107051    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72db92f6-6275-48b7-a47e-e670a59536c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w\" (UID: \"72db92f6-6275-48b7-a47e-e670a59536c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"
Sep 16 12:45:59.107386 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:59.107355    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72db92f6-6275-48b7-a47e-e670a59536c4-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w\" (UID: \"72db92f6-6275-48b7-a47e-e670a59536c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"
Sep 16 12:45:59.107454 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:59.107411    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72db92f6-6275-48b7-a47e-e670a59536c4-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w\" (UID: \"72db92f6-6275-48b7-a47e-e670a59536c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"
Sep 16 12:45:59.114911 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:59.114884    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gl85j\" (UniqueName: \"kubernetes.io/projected/72db92f6-6275-48b7-a47e-e670a59536c4-kube-api-access-gl85j\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w\" (UID: \"72db92f6-6275-48b7-a47e-e670a59536c4\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"
Sep 16 12:45:59.233003 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:59.232913    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"
Sep 16 12:45:59.502273 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:59.502249    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"]
Sep 16 12:45:59.504565 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:45:59.504530    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72db92f6_6275_48b7_a47e_e670a59536c4.slice/crio-2a4c7169cf04a185f7db465e0cdd1ae1049ba23a09729b4808a1683c02e8c3ee WatchSource:0}: Error finding container 2a4c7169cf04a185f7db465e0cdd1ae1049ba23a09729b4808a1683c02e8c3ee: Status 404 returned error can't find the container with id 2a4c7169cf04a185f7db465e0cdd1ae1049ba23a09729b4808a1683c02e8c3ee
Sep 16 12:45:59.545048 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:45:59.545021    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w" event={"ID":"72db92f6-6275-48b7-a47e-e670a59536c4","Type":"ContainerStarted","Data":"2a4c7169cf04a185f7db465e0cdd1ae1049ba23a09729b4808a1683c02e8c3ee"}
Sep 16 12:46:00.399248 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:00.399169    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:00.551364 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:00.551330    2549 generic.go:356] "Generic (PLEG): container finished" podID="72db92f6-6275-48b7-a47e-e670a59536c4" containerID="04ec5a2a3556d2060e1ff04e2fa5473c96260dc05ae74a84546d849e12c1881d" exitCode=0
Sep 16 12:46:00.551542 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:00.551419    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w" event={"ID":"72db92f6-6275-48b7-a47e-e670a59536c4","Type":"ContainerDied","Data":"04ec5a2a3556d2060e1ff04e2fa5473c96260dc05ae74a84546d849e12c1881d"}
Sep 16 12:46:00.584115 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:00.584091    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:02.802685 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:02.802653    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:02.873358 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:02.873328    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:04.567754 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:04.567721    2549 generic.go:356] "Generic (PLEG): container finished" podID="72db92f6-6275-48b7-a47e-e670a59536c4" containerID="7c82937994d6b097d4a8b3ce4406a3d4e6850cbb6e76be2a8355258804e2cb5e" exitCode=0
Sep 16 12:46:04.568086 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:04.567761    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w" event={"ID":"72db92f6-6275-48b7-a47e-e670a59536c4","Type":"ContainerDied","Data":"7c82937994d6b097d4a8b3ce4406a3d4e6850cbb6e76be2a8355258804e2cb5e"}
Sep 16 12:46:05.573363 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:05.573331    2549 generic.go:356] "Generic (PLEG): container finished" podID="72db92f6-6275-48b7-a47e-e670a59536c4" containerID="d16ce181993147a28f81e6479eee3813f3eb723f1eaf8736c05f52865c979d6d" exitCode=0
Sep 16 12:46:05.573743 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:05.573373    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w" event={"ID":"72db92f6-6275-48b7-a47e-e670a59536c4","Type":"ContainerDied","Data":"d16ce181993147a28f81e6479eee3813f3eb723f1eaf8736c05f52865c979d6d"}
Sep 16 12:46:06.694361 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:06.694340    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"
Sep 16 12:46:06.760677 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:06.760651    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72db92f6-6275-48b7-a47e-e670a59536c4-bundle\") pod \"72db92f6-6275-48b7-a47e-e670a59536c4\" (UID: \"72db92f6-6275-48b7-a47e-e670a59536c4\") "
Sep 16 12:46:06.760677 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:06.760680    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72db92f6-6275-48b7-a47e-e670a59536c4-util\") pod \"72db92f6-6275-48b7-a47e-e670a59536c4\" (UID: \"72db92f6-6275-48b7-a47e-e670a59536c4\") "
Sep 16 12:46:06.760826 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:06.760722    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gl85j\" (UniqueName: \"kubernetes.io/projected/72db92f6-6275-48b7-a47e-e670a59536c4-kube-api-access-gl85j\") pod \"72db92f6-6275-48b7-a47e-e670a59536c4\" (UID: \"72db92f6-6275-48b7-a47e-e670a59536c4\") "
Sep 16 12:46:06.761008 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:06.760987    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72db92f6-6275-48b7-a47e-e670a59536c4-bundle" (OuterVolumeSpecName: "bundle") pod "72db92f6-6275-48b7-a47e-e670a59536c4" (UID: "72db92f6-6275-48b7-a47e-e670a59536c4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:46:06.762743 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:06.762718    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72db92f6-6275-48b7-a47e-e670a59536c4-kube-api-access-gl85j" (OuterVolumeSpecName: "kube-api-access-gl85j") pod "72db92f6-6275-48b7-a47e-e670a59536c4" (UID: "72db92f6-6275-48b7-a47e-e670a59536c4"). InnerVolumeSpecName "kube-api-access-gl85j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:46:06.765393 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:06.765367    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72db92f6-6275-48b7-a47e-e670a59536c4-util" (OuterVolumeSpecName: "util") pod "72db92f6-6275-48b7-a47e-e670a59536c4" (UID: "72db92f6-6275-48b7-a47e-e670a59536c4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:46:06.861275 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:06.861212    2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72db92f6-6275-48b7-a47e-e670a59536c4-bundle\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:46:06.861275 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:06.861234    2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72db92f6-6275-48b7-a47e-e670a59536c4-util\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:46:06.861275 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:06.861260    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gl85j\" (UniqueName: \"kubernetes.io/projected/72db92f6-6275-48b7-a47e-e670a59536c4-kube-api-access-gl85j\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:46:07.582685 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:07.582650    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w" event={"ID":"72db92f6-6275-48b7-a47e-e670a59536c4","Type":"ContainerDied","Data":"2a4c7169cf04a185f7db465e0cdd1ae1049ba23a09729b4808a1683c02e8c3ee"}
Sep 16 12:46:07.582685 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:07.582676    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f6dq4w"
Sep 16 12:46:07.582685 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:07.582694    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a4c7169cf04a185f7db465e0cdd1ae1049ba23a09729b4808a1683c02e8c3ee"
Sep 16 12:46:07.796033 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:07.795995    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:07.852958 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:07.852894    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:08.006208 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:08.006179    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:09.321374 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.321341    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2kmrb"]
Sep 16 12:46:09.321748 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.321597    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72db92f6-6275-48b7-a47e-e670a59536c4" containerName="pull"
Sep 16 12:46:09.321748 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.321608    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="72db92f6-6275-48b7-a47e-e670a59536c4" containerName="pull"
Sep 16 12:46:09.321748 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.321622    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72db92f6-6275-48b7-a47e-e670a59536c4" containerName="extract"
Sep 16 12:46:09.321748 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.321627    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="72db92f6-6275-48b7-a47e-e670a59536c4" containerName="extract"
Sep 16 12:46:09.321748 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.321648    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72db92f6-6275-48b7-a47e-e670a59536c4" containerName="util"
Sep 16 12:46:09.321748 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.321655    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="72db92f6-6275-48b7-a47e-e670a59536c4" containerName="util"
Sep 16 12:46:09.321748 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.321697    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="72db92f6-6275-48b7-a47e-e670a59536c4" containerName="extract"
Sep 16 12:46:09.325616 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.325600    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2kmrb"
Sep 16 12:46:09.328704 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.328684    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 16 12:46:09.328905 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.328887    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 16 12:46:09.328974 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.328942    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-8n6cf\""
Sep 16 12:46:09.336337 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.336313    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2kmrb"]
Sep 16 12:46:09.379303 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.379279    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f6542cc-e23b-482d-b5e2-1002bc2a4a59-bound-sa-token\") pod \"cert-manager-55b4d954d5-2kmrb\" (UID: \"9f6542cc-e23b-482d-b5e2-1002bc2a4a59\") " pod="cert-manager/cert-manager-55b4d954d5-2kmrb"
Sep 16 12:46:09.379386 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.379326    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4rnf\" (UniqueName: \"kubernetes.io/projected/9f6542cc-e23b-482d-b5e2-1002bc2a4a59-kube-api-access-n4rnf\") pod \"cert-manager-55b4d954d5-2kmrb\" (UID: \"9f6542cc-e23b-482d-b5e2-1002bc2a4a59\") " pod="cert-manager/cert-manager-55b4d954d5-2kmrb"
Sep 16 12:46:09.479865 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.479833    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f6542cc-e23b-482d-b5e2-1002bc2a4a59-bound-sa-token\") pod \"cert-manager-55b4d954d5-2kmrb\" (UID: \"9f6542cc-e23b-482d-b5e2-1002bc2a4a59\") " pod="cert-manager/cert-manager-55b4d954d5-2kmrb"
Sep 16 12:46:09.479955 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.479886    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4rnf\" (UniqueName: \"kubernetes.io/projected/9f6542cc-e23b-482d-b5e2-1002bc2a4a59-kube-api-access-n4rnf\") pod \"cert-manager-55b4d954d5-2kmrb\" (UID: \"9f6542cc-e23b-482d-b5e2-1002bc2a4a59\") " pod="cert-manager/cert-manager-55b4d954d5-2kmrb"
Sep 16 12:46:09.489384 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.489364    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4rnf\" (UniqueName: \"kubernetes.io/projected/9f6542cc-e23b-482d-b5e2-1002bc2a4a59-kube-api-access-n4rnf\") pod \"cert-manager-55b4d954d5-2kmrb\" (UID: \"9f6542cc-e23b-482d-b5e2-1002bc2a4a59\") " pod="cert-manager/cert-manager-55b4d954d5-2kmrb"
Sep 16 12:46:09.489454 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.489366    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f6542cc-e23b-482d-b5e2-1002bc2a4a59-bound-sa-token\") pod \"cert-manager-55b4d954d5-2kmrb\" (UID: \"9f6542cc-e23b-482d-b5e2-1002bc2a4a59\") " pod="cert-manager/cert-manager-55b4d954d5-2kmrb"
Sep 16 12:46:09.634134 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.634047    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2kmrb"
Sep 16 12:46:09.904396 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:09.904288    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2kmrb"]
Sep 16 12:46:09.906891 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:46:09.906865    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f6542cc_e23b_482d_b5e2_1002bc2a4a59.slice/crio-1dc4421ad318886e0d251102b7b8c8c6b3ccb829988fe2f221b1736953c7f92c WatchSource:0}: Error finding container 1dc4421ad318886e0d251102b7b8c8c6b3ccb829988fe2f221b1736953c7f92c: Status 404 returned error can't find the container with id 1dc4421ad318886e0d251102b7b8c8c6b3ccb829988fe2f221b1736953c7f92c
Sep 16 12:46:10.594284 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:10.594248    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2kmrb" event={"ID":"9f6542cc-e23b-482d-b5e2-1002bc2a4a59","Type":"ContainerStarted","Data":"1dc4421ad318886e0d251102b7b8c8c6b3ccb829988fe2f221b1736953c7f92c"}
Sep 16 12:46:10.707852 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:10.707817    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:10.806338 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:10.806296    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:12.067368 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.067332    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lddq"]
Sep 16 12:46:12.070922 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.070902    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lddq"
Sep 16 12:46:12.073426 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.073395    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gmfmr\""
Sep 16 12:46:12.073571 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.073469    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 16 12:46:12.074051 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.074031    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 16 12:46:12.079420 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.079400    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lddq"]
Sep 16 12:46:12.199671 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.199627    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntsrk\" (UniqueName: \"kubernetes.io/projected/4eafe9a1-ae1d-4320-8616-b3478f533829-kube-api-access-ntsrk\") pod \"openshift-lws-operator-fd8ccff4c-5lddq\" (UID: \"4eafe9a1-ae1d-4320-8616-b3478f533829\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lddq"
Sep 16 12:46:12.199847 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.199695    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4eafe9a1-ae1d-4320-8616-b3478f533829-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5lddq\" (UID: \"4eafe9a1-ae1d-4320-8616-b3478f533829\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lddq"
Sep 16 12:46:12.301025 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.300994    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4eafe9a1-ae1d-4320-8616-b3478f533829-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5lddq\" (UID: \"4eafe9a1-ae1d-4320-8616-b3478f533829\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lddq"
Sep 16 12:46:12.301177 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.301052    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntsrk\" (UniqueName: \"kubernetes.io/projected/4eafe9a1-ae1d-4320-8616-b3478f533829-kube-api-access-ntsrk\") pod \"openshift-lws-operator-fd8ccff4c-5lddq\" (UID: \"4eafe9a1-ae1d-4320-8616-b3478f533829\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lddq"
Sep 16 12:46:12.301326 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.301306    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4eafe9a1-ae1d-4320-8616-b3478f533829-tmp\") pod \"openshift-lws-operator-fd8ccff4c-5lddq\" (UID: \"4eafe9a1-ae1d-4320-8616-b3478f533829\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lddq"
Sep 16 12:46:12.309617 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.309597    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntsrk\" (UniqueName: \"kubernetes.io/projected/4eafe9a1-ae1d-4320-8616-b3478f533829-kube-api-access-ntsrk\") pod \"openshift-lws-operator-fd8ccff4c-5lddq\" (UID: \"4eafe9a1-ae1d-4320-8616-b3478f533829\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lddq"
Sep 16 12:46:12.382624 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.382603    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lddq"
Sep 16 12:46:12.602534 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.602497    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2kmrb" event={"ID":"9f6542cc-e23b-482d-b5e2-1002bc2a4a59","Type":"ContainerStarted","Data":"78ba6e49540c98041ce3ac7885d162b27b9023979ef1bf1819b249947e2b10bf"}
Sep 16 12:46:12.626122 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.626038    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-2kmrb" podStartSLOduration=1.167957992 podStartE2EDuration="3.626021377s" totalImagesPullingTime="2.458063385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:46:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:46:12.624018487 +0000 UTC m=+456.188839578" watchObservedRunningTime="2026-09-16 12:46:12.626021377 +0000 UTC m=+456.190842466"
Sep 16 12:46:12.673711 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:12.673684    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lddq"]
Sep 16 12:46:12.675226 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:46:12.675194    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4eafe9a1_ae1d_4320_8616_b3478f533829.slice/crio-ab3405add86cb6cb9716792b00df45152e217183c8988cf0432a509d97175e28 WatchSource:0}: Error finding container ab3405add86cb6cb9716792b00df45152e217183c8988cf0432a509d97175e28: Status 404 returned error can't find the container with id ab3405add86cb6cb9716792b00df45152e217183c8988cf0432a509d97175e28
Sep 16 12:46:13.607200 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:13.607157    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lddq" event={"ID":"4eafe9a1-ae1d-4320-8616-b3478f533829","Type":"ContainerStarted","Data":"ab3405add86cb6cb9716792b00df45152e217183c8988cf0432a509d97175e28"}
Sep 16 12:46:15.118920 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:15.118889    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:15.177020 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:15.176988    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:18.627971 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:18.627883    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lddq" event={"ID":"4eafe9a1-ae1d-4320-8616-b3478f533829","Type":"ContainerStarted","Data":"ddb9e566a0748c21aaeefa4b602040a23f6d6fa1f86262b4b8f0e36f1e1a9f31"}
Sep 16 12:46:18.647782 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:18.647734    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-5lddq" podStartSLOduration=1.072294371 podStartE2EDuration="6.647721032s" totalImagesPullingTime="5.575426661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:46:18.646577422 +0000 UTC m=+462.211398516" watchObservedRunningTime="2026-09-16 12:46:18.647721032 +0000 UTC m=+462.212542122"
Sep 16 12:46:19.388372 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:19.388338    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:19.491398 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:19.491356    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:21.306087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:21.306053    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:26.135183 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:26.135146    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:26.236121 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:26.236092    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:34.650320 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.650275    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"]
Sep 16 12:46:34.653671 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.653652    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"
Sep 16 12:46:34.656195 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.656168    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 12:46:34.656195 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.656181    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 12:46:34.656853 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.656836    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5ttwq\""
Sep 16 12:46:34.662960 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.662938    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"]
Sep 16 12:46:34.758282 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.758251    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d2pp\" (UniqueName: \"kubernetes.io/projected/10f49c86-4add-47d3-9add-0b83fdcf20b3-kube-api-access-5d2pp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf\" (UID: \"10f49c86-4add-47d3-9add-0b83fdcf20b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"
Sep 16 12:46:34.758404 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.758290    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10f49c86-4add-47d3-9add-0b83fdcf20b3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf\" (UID: \"10f49c86-4add-47d3-9add-0b83fdcf20b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"
Sep 16 12:46:34.758404 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.758308    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10f49c86-4add-47d3-9add-0b83fdcf20b3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf\" (UID: \"10f49c86-4add-47d3-9add-0b83fdcf20b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"
Sep 16 12:46:34.858680 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.858651    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d2pp\" (UniqueName: \"kubernetes.io/projected/10f49c86-4add-47d3-9add-0b83fdcf20b3-kube-api-access-5d2pp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf\" (UID: \"10f49c86-4add-47d3-9add-0b83fdcf20b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"
Sep 16 12:46:34.858824 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.858689    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10f49c86-4add-47d3-9add-0b83fdcf20b3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf\" (UID: \"10f49c86-4add-47d3-9add-0b83fdcf20b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"
Sep 16 12:46:34.858824 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.858707    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10f49c86-4add-47d3-9add-0b83fdcf20b3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf\" (UID: \"10f49c86-4add-47d3-9add-0b83fdcf20b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"
Sep 16 12:46:34.859040 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.859023    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10f49c86-4add-47d3-9add-0b83fdcf20b3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf\" (UID: \"10f49c86-4add-47d3-9add-0b83fdcf20b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"
Sep 16 12:46:34.859106 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.859085    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10f49c86-4add-47d3-9add-0b83fdcf20b3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf\" (UID: \"10f49c86-4add-47d3-9add-0b83fdcf20b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"
Sep 16 12:46:34.867959 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.867939    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d2pp\" (UniqueName: \"kubernetes.io/projected/10f49c86-4add-47d3-9add-0b83fdcf20b3-kube-api-access-5d2pp\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf\" (UID: \"10f49c86-4add-47d3-9add-0b83fdcf20b3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"
Sep 16 12:46:34.962783 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:34.962759    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"
Sep 16 12:46:35.234084 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:35.234054    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"]
Sep 16 12:46:35.236161 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:46:35.236128    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f49c86_4add_47d3_9add_0b83fdcf20b3.slice/crio-019541314e27ffcab1747ba4234a97a8fdb670e2818699e936fbfd6f0403251b WatchSource:0}: Error finding container 019541314e27ffcab1747ba4234a97a8fdb670e2818699e936fbfd6f0403251b: Status 404 returned error can't find the container with id 019541314e27ffcab1747ba4234a97a8fdb670e2818699e936fbfd6f0403251b
Sep 16 12:46:35.694842 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:35.694806    2549 generic.go:356] "Generic (PLEG): container finished" podID="10f49c86-4add-47d3-9add-0b83fdcf20b3" containerID="c2afa2c08e5ee069ae13e87bd484ec8800d7818a568033af8dadfedc5ad49ef8" exitCode=0
Sep 16 12:46:35.695290 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:35.694852    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf" event={"ID":"10f49c86-4add-47d3-9add-0b83fdcf20b3","Type":"ContainerDied","Data":"c2afa2c08e5ee069ae13e87bd484ec8800d7818a568033af8dadfedc5ad49ef8"}
Sep 16 12:46:35.695290 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:35.694893    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf" event={"ID":"10f49c86-4add-47d3-9add-0b83fdcf20b3","Type":"ContainerStarted","Data":"019541314e27ffcab1747ba4234a97a8fdb670e2818699e936fbfd6f0403251b"}
Sep 16 12:46:36.700831 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:36.700750    2549 generic.go:356] "Generic (PLEG): container finished" podID="10f49c86-4add-47d3-9add-0b83fdcf20b3" containerID="c4700108129473150957689483d503b897f1820a7c9ffbd5967f0c202eee4555" exitCode=0
Sep 16 12:46:36.700831 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:36.700789    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf" event={"ID":"10f49c86-4add-47d3-9add-0b83fdcf20b3","Type":"ContainerDied","Data":"c4700108129473150957689483d503b897f1820a7c9ffbd5967f0c202eee4555"}
Sep 16 12:46:37.542561 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:37.542522    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:37.636494 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:37.636444    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:37.706368 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:37.706340    2549 generic.go:356] "Generic (PLEG): container finished" podID="10f49c86-4add-47d3-9add-0b83fdcf20b3" containerID="6fe2b474a61e379a211c2ee38a72b87274fe2f02e729b54a7a89b8db9177e006" exitCode=0
Sep 16 12:46:37.706728 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:37.706430    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf" event={"ID":"10f49c86-4add-47d3-9add-0b83fdcf20b3","Type":"ContainerDied","Data":"6fe2b474a61e379a211c2ee38a72b87274fe2f02e729b54a7a89b8db9177e006"}
Sep 16 12:46:38.825307 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:38.825283    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"
Sep 16 12:46:38.989767 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:38.989690    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10f49c86-4add-47d3-9add-0b83fdcf20b3-bundle\") pod \"10f49c86-4add-47d3-9add-0b83fdcf20b3\" (UID: \"10f49c86-4add-47d3-9add-0b83fdcf20b3\") "
Sep 16 12:46:38.989767 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:38.989727    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10f49c86-4add-47d3-9add-0b83fdcf20b3-util\") pod \"10f49c86-4add-47d3-9add-0b83fdcf20b3\" (UID: \"10f49c86-4add-47d3-9add-0b83fdcf20b3\") "
Sep 16 12:46:38.989967 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:38.989805    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d2pp\" (UniqueName: \"kubernetes.io/projected/10f49c86-4add-47d3-9add-0b83fdcf20b3-kube-api-access-5d2pp\") pod \"10f49c86-4add-47d3-9add-0b83fdcf20b3\" (UID: \"10f49c86-4add-47d3-9add-0b83fdcf20b3\") "
Sep 16 12:46:38.990357 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:38.990329    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f49c86-4add-47d3-9add-0b83fdcf20b3-bundle" (OuterVolumeSpecName: "bundle") pod "10f49c86-4add-47d3-9add-0b83fdcf20b3" (UID: "10f49c86-4add-47d3-9add-0b83fdcf20b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:46:38.991851 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:38.991830    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10f49c86-4add-47d3-9add-0b83fdcf20b3-kube-api-access-5d2pp" (OuterVolumeSpecName: "kube-api-access-5d2pp") pod "10f49c86-4add-47d3-9add-0b83fdcf20b3" (UID: "10f49c86-4add-47d3-9add-0b83fdcf20b3"). InnerVolumeSpecName "kube-api-access-5d2pp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:46:38.996012 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:38.995989    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f49c86-4add-47d3-9add-0b83fdcf20b3-util" (OuterVolumeSpecName: "util") pod "10f49c86-4add-47d3-9add-0b83fdcf20b3" (UID: "10f49c86-4add-47d3-9add-0b83fdcf20b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:46:39.090296 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:39.090263    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5d2pp\" (UniqueName: \"kubernetes.io/projected/10f49c86-4add-47d3-9add-0b83fdcf20b3-kube-api-access-5d2pp\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:46:39.090296 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:39.090293    2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/10f49c86-4add-47d3-9add-0b83fdcf20b3-bundle\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:46:39.090456 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:39.090307    2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/10f49c86-4add-47d3-9add-0b83fdcf20b3-util\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:46:39.714937 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:39.714903    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf" event={"ID":"10f49c86-4add-47d3-9add-0b83fdcf20b3","Type":"ContainerDied","Data":"019541314e27ffcab1747ba4234a97a8fdb670e2818699e936fbfd6f0403251b"}
Sep 16 12:46:39.714937 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:39.714923    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgmhsf"
Sep 16 12:46:39.715139 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:39.714950    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="019541314e27ffcab1747ba4234a97a8fdb670e2818699e936fbfd6f0403251b"
Sep 16 12:46:44.479267 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.479235    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"]
Sep 16 12:46:44.479659 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.479499    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10f49c86-4add-47d3-9add-0b83fdcf20b3" containerName="util"
Sep 16 12:46:44.479659 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.479511    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="10f49c86-4add-47d3-9add-0b83fdcf20b3" containerName="util"
Sep 16 12:46:44.479659 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.479520    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10f49c86-4add-47d3-9add-0b83fdcf20b3" containerName="pull"
Sep 16 12:46:44.479659 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.479525    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="10f49c86-4add-47d3-9add-0b83fdcf20b3" containerName="pull"
Sep 16 12:46:44.479659 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.479532    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10f49c86-4add-47d3-9add-0b83fdcf20b3" containerName="extract"
Sep 16 12:46:44.479659 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.479538    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="10f49c86-4add-47d3-9add-0b83fdcf20b3" containerName="extract"
Sep 16 12:46:44.479659 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.479579    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="10f49c86-4add-47d3-9add-0b83fdcf20b3" containerName="extract"
Sep 16 12:46:44.483525 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.483506    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"
Sep 16 12:46:44.485942 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.485919    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5ttwq\""
Sep 16 12:46:44.486259 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.486242    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 12:46:44.486662 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.486646    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 12:46:44.494151 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.494128    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"]
Sep 16 12:46:44.626415 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.626383    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e636a131-5ade-4311-b449-49ddbdd38e65-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5\" (UID: \"e636a131-5ade-4311-b449-49ddbdd38e65\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"
Sep 16 12:46:44.626415 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.626414    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e636a131-5ade-4311-b449-49ddbdd38e65-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5\" (UID: \"e636a131-5ade-4311-b449-49ddbdd38e65\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"
Sep 16 12:46:44.626636 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.626436    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjq57\" (UniqueName: \"kubernetes.io/projected/e636a131-5ade-4311-b449-49ddbdd38e65-kube-api-access-pjq57\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5\" (UID: \"e636a131-5ade-4311-b449-49ddbdd38e65\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"
Sep 16 12:46:44.727347 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.727318    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e636a131-5ade-4311-b449-49ddbdd38e65-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5\" (UID: \"e636a131-5ade-4311-b449-49ddbdd38e65\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"
Sep 16 12:46:44.727347 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.727347    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e636a131-5ade-4311-b449-49ddbdd38e65-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5\" (UID: \"e636a131-5ade-4311-b449-49ddbdd38e65\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"
Sep 16 12:46:44.727531 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.727370    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjq57\" (UniqueName: \"kubernetes.io/projected/e636a131-5ade-4311-b449-49ddbdd38e65-kube-api-access-pjq57\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5\" (UID: \"e636a131-5ade-4311-b449-49ddbdd38e65\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"
Sep 16 12:46:44.727695 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.727679    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e636a131-5ade-4311-b449-49ddbdd38e65-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5\" (UID: \"e636a131-5ade-4311-b449-49ddbdd38e65\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"
Sep 16 12:46:44.727785 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.727768    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e636a131-5ade-4311-b449-49ddbdd38e65-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5\" (UID: \"e636a131-5ade-4311-b449-49ddbdd38e65\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"
Sep 16 12:46:44.736008 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.735954    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjq57\" (UniqueName: \"kubernetes.io/projected/e636a131-5ade-4311-b449-49ddbdd38e65-kube-api-access-pjq57\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5\" (UID: \"e636a131-5ade-4311-b449-49ddbdd38e65\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"
Sep 16 12:46:44.792444 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:44.792421    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"
Sep 16 12:46:45.081290 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:45.081260    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"]
Sep 16 12:46:45.083965 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:46:45.083941    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode636a131_5ade_4311_b449_49ddbdd38e65.slice/crio-7cf8917e0b04534f4b88f1ca0f135fcec1747113364ab0b7d53525b7e0fd229b WatchSource:0}: Error finding container 7cf8917e0b04534f4b88f1ca0f135fcec1747113364ab0b7d53525b7e0fd229b: Status 404 returned error can't find the container with id 7cf8917e0b04534f4b88f1ca0f135fcec1747113364ab0b7d53525b7e0fd229b
Sep 16 12:46:45.561933 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:45.561897    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:45.666353 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:45.666327    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:45.737933 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:45.737895    2549 generic.go:356] "Generic (PLEG): container finished" podID="e636a131-5ade-4311-b449-49ddbdd38e65" containerID="7e06fba34ced1415c82c03b4f343917c48cdc0529d528513cfd65102d2faadec" exitCode=0
Sep 16 12:46:45.738081 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:45.737974    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5" event={"ID":"e636a131-5ade-4311-b449-49ddbdd38e65","Type":"ContainerDied","Data":"7e06fba34ced1415c82c03b4f343917c48cdc0529d528513cfd65102d2faadec"}
Sep 16 12:46:45.738081 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:45.738024    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5" event={"ID":"e636a131-5ade-4311-b449-49ddbdd38e65","Type":"ContainerStarted","Data":"7cf8917e0b04534f4b88f1ca0f135fcec1747113364ab0b7d53525b7e0fd229b"}
Sep 16 12:46:46.188169 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.188116    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:46.423361 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.423328    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:46.529436 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.529361    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:46.581013 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.580981    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"]
Sep 16 12:46:46.584975 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.584958    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.589041 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.589019    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 16 12:46:46.595579 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.595553    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-72j5p\""
Sep 16 12:46:46.595785 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.595768    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 16 12:46:46.595870 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.595854    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 16 12:46:46.595923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.595868    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 16 12:46:46.617629 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.617605    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"]
Sep 16 12:46:46.744044 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.744012    2549 generic.go:356] "Generic (PLEG): container finished" podID="e636a131-5ade-4311-b449-49ddbdd38e65" containerID="4141a75320efe3d0d07477eb4a2cb5fcea66b7833b593ab6c63a824ed0120633" exitCode=0
Sep 16 12:46:46.744176 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.744067    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5" event={"ID":"e636a131-5ade-4311-b449-49ddbdd38e65","Type":"ContainerDied","Data":"4141a75320efe3d0d07477eb4a2cb5fcea66b7833b593ab6c63a824ed0120633"}
Sep 16 12:46:46.745091 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.745071    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7lkk\" (UniqueName: \"kubernetes.io/projected/9f1bce76-0b21-462b-b809-bb07d34c06b0-kube-api-access-v7lkk\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.745180 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.745114    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f1bce76-0b21-462b-b809-bb07d34c06b0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.745180 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.745144    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f1bce76-0b21-462b-b809-bb07d34c06b0-tmp\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.745257 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.745219    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f1bce76-0b21-462b-b809-bb07d34c06b0-manifests\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.745257 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.745250    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f1bce76-0b21-462b-b809-bb07d34c06b0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.782818 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.782766    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:46.846238 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.846212    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7lkk\" (UniqueName: \"kubernetes.io/projected/9f1bce76-0b21-462b-b809-bb07d34c06b0-kube-api-access-v7lkk\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.846418 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.846254    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f1bce76-0b21-462b-b809-bb07d34c06b0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.846418 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.846287    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f1bce76-0b21-462b-b809-bb07d34c06b0-tmp\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.846418 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.846333    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f1bce76-0b21-462b-b809-bb07d34c06b0-manifests\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.846418 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.846361    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f1bce76-0b21-462b-b809-bb07d34c06b0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.846855 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.846832    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9f1bce76-0b21-462b-b809-bb07d34c06b0-manifests\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.849026 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.849006    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9f1bce76-0b21-462b-b809-bb07d34c06b0-tmp\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.849199 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.849182    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9f1bce76-0b21-462b-b809-bb07d34c06b0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.849338 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.849317    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f1bce76-0b21-462b-b809-bb07d34c06b0-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.854581 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.854563    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7lkk\" (UniqueName: \"kubernetes.io/projected/9f1bce76-0b21-462b-b809-bb07d34c06b0-kube-api-access-v7lkk\") pod \"opendatahub-operator-controller-manager-5c7bc95455-gvj6l\" (UID: \"9f1bce76-0b21-462b-b809-bb07d34c06b0\") " pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.890842 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.890810    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:46.894809 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.894787    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:46.993029 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:46.993002    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:47.094815 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:47.094747    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:47.175224 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:47.175200    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"]
Sep 16 12:46:47.177700 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:46:47.177675    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f1bce76_0b21_462b_b809_bb07d34c06b0.slice/crio-c686194df4ba1eae1c1cec6ed247d202fc95351b2f9a14f9a1383a655dc1028f WatchSource:0}: Error finding container c686194df4ba1eae1c1cec6ed247d202fc95351b2f9a14f9a1383a655dc1028f: Status 404 returned error can't find the container with id c686194df4ba1eae1c1cec6ed247d202fc95351b2f9a14f9a1383a655dc1028f
Sep 16 12:46:47.182099 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:47.182072    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:47.260144 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:47.260094    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:46:47.751058 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:47.751024    2549 generic.go:356] "Generic (PLEG): container finished" podID="e636a131-5ade-4311-b449-49ddbdd38e65" containerID="11cfd5b1dd5a5c798840038385ff11a9b6167176185dc07070221a59c31d2338" exitCode=0
Sep 16 12:46:47.751506 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:47.751103    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5" event={"ID":"e636a131-5ade-4311-b449-49ddbdd38e65","Type":"ContainerDied","Data":"11cfd5b1dd5a5c798840038385ff11a9b6167176185dc07070221a59c31d2338"}
Sep 16 12:46:47.752493 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:47.752453    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l" event={"ID":"9f1bce76-0b21-462b-b809-bb07d34c06b0","Type":"ContainerStarted","Data":"c686194df4ba1eae1c1cec6ed247d202fc95351b2f9a14f9a1383a655dc1028f"}
Sep 16 12:46:50.317170 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:50.317146    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"
Sep 16 12:46:50.472622 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:50.472591    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e636a131-5ade-4311-b449-49ddbdd38e65-util\") pod \"e636a131-5ade-4311-b449-49ddbdd38e65\" (UID: \"e636a131-5ade-4311-b449-49ddbdd38e65\") "
Sep 16 12:46:50.472757 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:50.472650    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e636a131-5ade-4311-b449-49ddbdd38e65-bundle\") pod \"e636a131-5ade-4311-b449-49ddbdd38e65\" (UID: \"e636a131-5ade-4311-b449-49ddbdd38e65\") "
Sep 16 12:46:50.472757 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:50.472699    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjq57\" (UniqueName: \"kubernetes.io/projected/e636a131-5ade-4311-b449-49ddbdd38e65-kube-api-access-pjq57\") pod \"e636a131-5ade-4311-b449-49ddbdd38e65\" (UID: \"e636a131-5ade-4311-b449-49ddbdd38e65\") "
Sep 16 12:46:50.473315 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:50.473286    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e636a131-5ade-4311-b449-49ddbdd38e65-bundle" (OuterVolumeSpecName: "bundle") pod "e636a131-5ade-4311-b449-49ddbdd38e65" (UID: "e636a131-5ade-4311-b449-49ddbdd38e65"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:46:50.474708 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:50.474684    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e636a131-5ade-4311-b449-49ddbdd38e65-kube-api-access-pjq57" (OuterVolumeSpecName: "kube-api-access-pjq57") pod "e636a131-5ade-4311-b449-49ddbdd38e65" (UID: "e636a131-5ade-4311-b449-49ddbdd38e65"). InnerVolumeSpecName "kube-api-access-pjq57". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:46:50.485713 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:50.485693    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e636a131-5ade-4311-b449-49ddbdd38e65-util" (OuterVolumeSpecName: "util") pod "e636a131-5ade-4311-b449-49ddbdd38e65" (UID: "e636a131-5ade-4311-b449-49ddbdd38e65"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:46:50.573725 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:50.573635    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjq57\" (UniqueName: \"kubernetes.io/projected/e636a131-5ade-4311-b449-49ddbdd38e65-kube-api-access-pjq57\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:46:50.573725 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:50.573682    2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e636a131-5ade-4311-b449-49ddbdd38e65-util\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:46:50.573725 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:50.573698    2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e636a131-5ade-4311-b449-49ddbdd38e65-bundle\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:46:50.768608 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:50.768574    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5" event={"ID":"e636a131-5ade-4311-b449-49ddbdd38e65","Type":"ContainerDied","Data":"7cf8917e0b04534f4b88f1ca0f135fcec1747113364ab0b7d53525b7e0fd229b"}
Sep 16 12:46:50.768608 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:50.768610    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ctzs5"
Sep 16 12:46:50.768806 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:50.768651    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cf8917e0b04534f4b88f1ca0f135fcec1747113364ab0b7d53525b7e0fd229b"
Sep 16 12:46:50.770341 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:50.770311    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l" event={"ID":"9f1bce76-0b21-462b-b809-bb07d34c06b0","Type":"ContainerStarted","Data":"3173e645a38ed459579692bf4dd216fbb089685ef659a0bc8fdf026e09880d06"}
Sep 16 12:46:51.776380 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:51.776300    2549 generic.go:356] "Generic (PLEG): container finished" podID="9f1bce76-0b21-462b-b809-bb07d34c06b0" containerID="3173e645a38ed459579692bf4dd216fbb089685ef659a0bc8fdf026e09880d06" exitCode=0
Sep 16 12:46:51.776380 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:51.776354    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l" event={"ID":"9f1bce76-0b21-462b-b809-bb07d34c06b0","Type":"ContainerDied","Data":"3173e645a38ed459579692bf4dd216fbb089685ef659a0bc8fdf026e09880d06"}
Sep 16 12:46:52.783912 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:52.783871    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l" event={"ID":"9f1bce76-0b21-462b-b809-bb07d34c06b0","Type":"ContainerStarted","Data":"56487b23e0f145ee77f79a3e6f2662bb6cfb633e5f83fa15bef2bea0506370f9"}
Sep 16 12:46:52.784404 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:52.783997    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:46:52.813582 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:46:52.813533    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l" podStartSLOduration=2.176972496 podStartE2EDuration="6.813517703s" totalImagesPullingTime="3.606450363s" totalInitContainerRuntime="1.030094844s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:46:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:46:52.811937466 +0000 UTC m=+496.376758568" watchObservedRunningTime="2026-09-16 12:46:52.813517703 +0000 UTC m=+496.378338794"
Sep 16 12:47:03.791254 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:03.791221    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c7bc95455-gvj6l"
Sep 16 12:47:07.632848 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:07.632812    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:07.745633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:07.745600    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:18.354017 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.353973    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:18.491770 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.491734    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"]
Sep 16 12:47:18.492051 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.492031    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e636a131-5ade-4311-b449-49ddbdd38e65" containerName="util"
Sep 16 12:47:18.492051 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.492050    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e636a131-5ade-4311-b449-49ddbdd38e65" containerName="util"
Sep 16 12:47:18.492246 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.492066    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e636a131-5ade-4311-b449-49ddbdd38e65" containerName="pull"
Sep 16 12:47:18.492246 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.492074    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e636a131-5ade-4311-b449-49ddbdd38e65" containerName="pull"
Sep 16 12:47:18.492246 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.492086    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e636a131-5ade-4311-b449-49ddbdd38e65" containerName="extract"
Sep 16 12:47:18.492246 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.492094    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e636a131-5ade-4311-b449-49ddbdd38e65" containerName="extract"
Sep 16 12:47:18.492246 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.492166    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="e636a131-5ade-4311-b449-49ddbdd38e65" containerName="extract"
Sep 16 12:47:18.496552 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.496533    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"
Sep 16 12:47:18.498881 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.498861    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 16 12:47:18.498881 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.498872    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kc96p\""
Sep 16 12:47:18.499552 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.499528    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 16 12:47:18.499552 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.499542    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 16 12:47:18.499698 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.499563    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 16 12:47:18.512160 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.512137    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"]
Sep 16 12:47:18.571384 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.571346    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab49eb08-0e42-4208-a0d7-eeb1191ab4fc-tls-certs\") pod \"kube-auth-proxy-8568fcf948-vhx9p\" (UID: \"ab49eb08-0e42-4208-a0d7-eeb1191ab4fc\") " pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"
Sep 16 12:47:18.571384 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.571384    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjckw\" (UniqueName: \"kubernetes.io/projected/ab49eb08-0e42-4208-a0d7-eeb1191ab4fc-kube-api-access-zjckw\") pod \"kube-auth-proxy-8568fcf948-vhx9p\" (UID: \"ab49eb08-0e42-4208-a0d7-eeb1191ab4fc\") " pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"
Sep 16 12:47:18.571608 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.571429    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab49eb08-0e42-4208-a0d7-eeb1191ab4fc-tmp\") pod \"kube-auth-proxy-8568fcf948-vhx9p\" (UID: \"ab49eb08-0e42-4208-a0d7-eeb1191ab4fc\") " pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"
Sep 16 12:47:18.656232 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.656205    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xpg7x"]
Sep 16 12:47:18.659755 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.659705    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xpg7x"
Sep 16 12:47:18.662264 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.662243    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 16 12:47:18.662391 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.662295    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-bt7m2\""
Sep 16 12:47:18.671866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.671842    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab49eb08-0e42-4208-a0d7-eeb1191ab4fc-tls-certs\") pod \"kube-auth-proxy-8568fcf948-vhx9p\" (UID: \"ab49eb08-0e42-4208-a0d7-eeb1191ab4fc\") " pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"
Sep 16 12:47:18.671961 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.671889    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjckw\" (UniqueName: \"kubernetes.io/projected/ab49eb08-0e42-4208-a0d7-eeb1191ab4fc-kube-api-access-zjckw\") pod \"kube-auth-proxy-8568fcf948-vhx9p\" (UID: \"ab49eb08-0e42-4208-a0d7-eeb1191ab4fc\") " pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"
Sep 16 12:47:18.671961 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.671935    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab49eb08-0e42-4208-a0d7-eeb1191ab4fc-tmp\") pod \"kube-auth-proxy-8568fcf948-vhx9p\" (UID: \"ab49eb08-0e42-4208-a0d7-eeb1191ab4fc\") " pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"
Sep 16 12:47:18.672216 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:47:18.672195    2549 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 16 12:47:18.672304 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:47:18.672268    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab49eb08-0e42-4208-a0d7-eeb1191ab4fc-tls-certs podName:ab49eb08-0e42-4208-a0d7-eeb1191ab4fc nodeName:}" failed. No retries permitted until 2026-09-16 12:47:19.172247223 +0000 UTC m=+522.737068298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ab49eb08-0e42-4208-a0d7-eeb1191ab4fc-tls-certs") pod "kube-auth-proxy-8568fcf948-vhx9p" (UID: "ab49eb08-0e42-4208-a0d7-eeb1191ab4fc") : secret "kube-auth-proxy-tls" not found
Sep 16 12:47:18.674160 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.674132    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ab49eb08-0e42-4208-a0d7-eeb1191ab4fc-tmp\") pod \"kube-auth-proxy-8568fcf948-vhx9p\" (UID: \"ab49eb08-0e42-4208-a0d7-eeb1191ab4fc\") " pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"
Sep 16 12:47:18.681097 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.681076    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xpg7x"]
Sep 16 12:47:18.685347 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.685321    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjckw\" (UniqueName: \"kubernetes.io/projected/ab49eb08-0e42-4208-a0d7-eeb1191ab4fc-kube-api-access-zjckw\") pod \"kube-auth-proxy-8568fcf948-vhx9p\" (UID: \"ab49eb08-0e42-4208-a0d7-eeb1191ab4fc\") " pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"
Sep 16 12:47:18.710526 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.710456    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:18.772906 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.772872    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102-cert\") pod \"odh-model-controller-7998c67dc4-xpg7x\" (UID: \"ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102\") " pod="opendatahub/odh-model-controller-7998c67dc4-xpg7x"
Sep 16 12:47:18.773091 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.772962    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqgm2\" (UniqueName: \"kubernetes.io/projected/ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102-kube-api-access-nqgm2\") pod \"odh-model-controller-7998c67dc4-xpg7x\" (UID: \"ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102\") " pod="opendatahub/odh-model-controller-7998c67dc4-xpg7x"
Sep 16 12:47:18.810188 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.810149    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:18.873434 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.873395    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102-cert\") pod \"odh-model-controller-7998c67dc4-xpg7x\" (UID: \"ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102\") " pod="opendatahub/odh-model-controller-7998c67dc4-xpg7x"
Sep 16 12:47:18.873634 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.873506    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqgm2\" (UniqueName: \"kubernetes.io/projected/ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102-kube-api-access-nqgm2\") pod \"odh-model-controller-7998c67dc4-xpg7x\" (UID: \"ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102\") " pod="opendatahub/odh-model-controller-7998c67dc4-xpg7x"
Sep 16 12:47:18.873634 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:47:18.873552    2549 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 16 12:47:18.873634 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:47:18.873619    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102-cert podName:ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102 nodeName:}" failed. No retries permitted until 2026-09-16 12:47:19.373600952 +0000 UTC m=+522.938422035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102-cert") pod "odh-model-controller-7998c67dc4-xpg7x" (UID: "ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102") : secret "odh-model-controller-webhook-cert" not found
Sep 16 12:47:18.884908 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.884879    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqgm2\" (UniqueName: \"kubernetes.io/projected/ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102-kube-api-access-nqgm2\") pod \"odh-model-controller-7998c67dc4-xpg7x\" (UID: \"ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102\") " pod="opendatahub/odh-model-controller-7998c67dc4-xpg7x"
Sep 16 12:47:18.926453 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:18.926368    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:19.176073 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.176040    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab49eb08-0e42-4208-a0d7-eeb1191ab4fc-tls-certs\") pod \"kube-auth-proxy-8568fcf948-vhx9p\" (UID: \"ab49eb08-0e42-4208-a0d7-eeb1191ab4fc\") " pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"
Sep 16 12:47:19.178533 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.178457    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab49eb08-0e42-4208-a0d7-eeb1191ab4fc-tls-certs\") pod \"kube-auth-proxy-8568fcf948-vhx9p\" (UID: \"ab49eb08-0e42-4208-a0d7-eeb1191ab4fc\") " pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"
Sep 16 12:47:19.232058 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.232024    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:19.306518 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.306465    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4fz99"]
Sep 16 12:47:19.310905 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.310888    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4fz99"
Sep 16 12:47:19.313118 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.313097    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hg4c5\""
Sep 16 12:47:19.313118 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.313098    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 16 12:47:19.320343 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.320322    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4fz99"]
Sep 16 12:47:19.377014 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.376983    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7b26d94-5f27-4f38-a066-70f1d20ae6d9-tls-certs\") pod \"model-serving-api-54d89bd5fc-4fz99\" (UID: \"e7b26d94-5f27-4f38-a066-70f1d20ae6d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-4fz99"
Sep 16 12:47:19.377449 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.377042    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102-cert\") pod \"odh-model-controller-7998c67dc4-xpg7x\" (UID: \"ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102\") " pod="opendatahub/odh-model-controller-7998c67dc4-xpg7x"
Sep 16 12:47:19.377449 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.377088    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjsh2\" (UniqueName: \"kubernetes.io/projected/e7b26d94-5f27-4f38-a066-70f1d20ae6d9-kube-api-access-wjsh2\") pod \"model-serving-api-54d89bd5fc-4fz99\" (UID: \"e7b26d94-5f27-4f38-a066-70f1d20ae6d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-4fz99"
Sep 16 12:47:19.379787 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.379761    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102-cert\") pod \"odh-model-controller-7998c67dc4-xpg7x\" (UID: \"ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102\") " pod="opendatahub/odh-model-controller-7998c67dc4-xpg7x"
Sep 16 12:47:19.386031 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.386007    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:19.406736 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.406705    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"
Sep 16 12:47:19.478236 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.478202    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjsh2\" (UniqueName: \"kubernetes.io/projected/e7b26d94-5f27-4f38-a066-70f1d20ae6d9-kube-api-access-wjsh2\") pod \"model-serving-api-54d89bd5fc-4fz99\" (UID: \"e7b26d94-5f27-4f38-a066-70f1d20ae6d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-4fz99"
Sep 16 12:47:19.478361 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.478293    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7b26d94-5f27-4f38-a066-70f1d20ae6d9-tls-certs\") pod \"model-serving-api-54d89bd5fc-4fz99\" (UID: \"e7b26d94-5f27-4f38-a066-70f1d20ae6d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-4fz99"
Sep 16 12:47:19.480767 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.480737    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7b26d94-5f27-4f38-a066-70f1d20ae6d9-tls-certs\") pod \"model-serving-api-54d89bd5fc-4fz99\" (UID: \"e7b26d94-5f27-4f38-a066-70f1d20ae6d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-4fz99"
Sep 16 12:47:19.492981 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.492957    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjsh2\" (UniqueName: \"kubernetes.io/projected/e7b26d94-5f27-4f38-a066-70f1d20ae6d9-kube-api-access-wjsh2\") pod \"model-serving-api-54d89bd5fc-4fz99\" (UID: \"e7b26d94-5f27-4f38-a066-70f1d20ae6d9\") " pod="opendatahub/model-serving-api-54d89bd5fc-4fz99"
Sep 16 12:47:19.536882 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.536860    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:19.573035 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.572998    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xpg7x"
Sep 16 12:47:19.622805 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.622758    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-4fz99"
Sep 16 12:47:19.703328 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.702995    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p"]
Sep 16 12:47:19.705674 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:47:19.705635    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab49eb08_0e42_4208_a0d7_eeb1191ab4fc.slice/crio-8fdd97126a27571d74b34c0c3c1ca50614d8b3c8bd34f9aa2fa8869eaac8fd6c WatchSource:0}: Error finding container 8fdd97126a27571d74b34c0c3c1ca50614d8b3c8bd34f9aa2fa8869eaac8fd6c: Status 404 returned error can't find the container with id 8fdd97126a27571d74b34c0c3c1ca50614d8b3c8bd34f9aa2fa8869eaac8fd6c
Sep 16 12:47:19.784861 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.784813    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:19.793842 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.793815    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"]
Sep 16 12:47:19.798302 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.798283    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.800536 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.800513    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 16 12:47:19.800536 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.800536    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 16 12:47:19.800694 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.800596    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kzntr\""
Sep 16 12:47:19.800859 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.800843    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 16 12:47:19.800985 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.800964    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 16 12:47:19.810869 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.810843    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"]
Sep 16 12:47:19.847456 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.847436    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xpg7x"]
Sep 16 12:47:19.848850 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:47:19.848826    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebcbdbb1_eaa5_4c4b_b2f3_8f94baad6102.slice/crio-ef6f007cc02eef40cfe5fdf4d2c9fad7b1dd7c94bddf99477e449b53fa5a3a1e WatchSource:0}: Error finding container ef6f007cc02eef40cfe5fdf4d2c9fad7b1dd7c94bddf99477e449b53fa5a3a1e: Status 404 returned error can't find the container with id ef6f007cc02eef40cfe5fdf4d2c9fad7b1dd7c94bddf99477e449b53fa5a3a1e
Sep 16 12:47:19.859371 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.859352    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:19.882607 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.882587    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/688fc75f-d9f0-4e95-9840-e18dd35191f2-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.882716 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.882619    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.882716 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.882652    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfqhm\" (UniqueName: \"kubernetes.io/projected/688fc75f-d9f0-4e95-9840-e18dd35191f2-kube-api-access-tfqhm\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.882824 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.882729    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.882824 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.882765    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.882909 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.882855    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.882909 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.882895    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.900780 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.900749    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xpg7x" event={"ID":"ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102","Type":"ContainerStarted","Data":"ef6f007cc02eef40cfe5fdf4d2c9fad7b1dd7c94bddf99477e449b53fa5a3a1e"}
Sep 16 12:47:19.902030 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.902002    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p" event={"ID":"ab49eb08-0e42-4208-a0d7-eeb1191ab4fc","Type":"ContainerStarted","Data":"8fdd97126a27571d74b34c0c3c1ca50614d8b3c8bd34f9aa2fa8869eaac8fd6c"}
Sep 16 12:47:19.908219 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.908198    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-4fz99"]
Sep 16 12:47:19.910239 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:47:19.910215    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b26d94_5f27_4f38_a066_70f1d20ae6d9.slice/crio-751799672ff9a926d22d3281e3cc7a25a276d630c687a59994d3e03dd3767e65 WatchSource:0}: Error finding container 751799672ff9a926d22d3281e3cc7a25a276d630c687a59994d3e03dd3767e65: Status 404 returned error can't find the container with id 751799672ff9a926d22d3281e3cc7a25a276d630c687a59994d3e03dd3767e65
Sep 16 12:47:19.983535 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.983417    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.983535 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.983470    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfqhm\" (UniqueName: \"kubernetes.io/projected/688fc75f-d9f0-4e95-9840-e18dd35191f2-kube-api-access-tfqhm\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.983767 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.983723    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.983834 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.983795    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.984425 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.983909    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.984425 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.983945    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.984425 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.983986    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/688fc75f-d9f0-4e95-9840-e18dd35191f2-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.984751 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.984731    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.986526 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.986500    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.986647 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.986626    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/688fc75f-d9f0-4e95-9840-e18dd35191f2-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.986822 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.986803    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.986958 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.986935    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.992295 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.992268    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:19.992822 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:19.992801    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfqhm\" (UniqueName: \"kubernetes.io/projected/688fc75f-d9f0-4e95-9840-e18dd35191f2-kube-api-access-tfqhm\") pod \"istiod-openshift-gateway-7b7995d5cd-lwtdf\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:20.107825 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:20.107776    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:20.388174 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:20.388104    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"]
Sep 16 12:47:20.391417 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:47:20.391390    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod688fc75f_d9f0_4e95_9840_e18dd35191f2.slice/crio-27a28d49e4fcfae5a74dd60cb63cf974ebb63b4016011446828d2a7bc8000704 WatchSource:0}: Error finding container 27a28d49e4fcfae5a74dd60cb63cf974ebb63b4016011446828d2a7bc8000704: Status 404 returned error can't find the container with id 27a28d49e4fcfae5a74dd60cb63cf974ebb63b4016011446828d2a7bc8000704
Sep 16 12:47:20.881388 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:20.881328    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:20.911301 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:20.911263    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4fz99" event={"ID":"e7b26d94-5f27-4f38-a066-70f1d20ae6d9","Type":"ContainerStarted","Data":"751799672ff9a926d22d3281e3cc7a25a276d630c687a59994d3e03dd3767e65"}
Sep 16 12:47:20.913595 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:20.913527    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf" event={"ID":"688fc75f-d9f0-4e95-9840-e18dd35191f2","Type":"ContainerStarted","Data":"27a28d49e4fcfae5a74dd60cb63cf974ebb63b4016011446828d2a7bc8000704"}
Sep 16 12:47:26.378519 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:26.378468    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:26.474238 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:26.474174    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:47:26.474300 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:26.474249    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:47:26.482901 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:26.482879    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:26.956905 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:26.956862    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xpg7x" event={"ID":"ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102","Type":"ContainerStarted","Data":"92cd2a6a0e5e7bf8eb16035a0a8773d3fd2b009bb74ad2f009bd6409f9387be4"}
Sep 16 12:47:26.957193 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:26.957175    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-xpg7x"
Sep 16 12:47:26.959424 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:26.959391    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p" event={"ID":"ab49eb08-0e42-4208-a0d7-eeb1191ab4fc","Type":"ContainerStarted","Data":"18fd495bb6f2e11a0520b3a165f5fe78290814750118a9ad1122cf2f59e354e4"}
Sep 16 12:47:26.962530 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:26.962501    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-4fz99" event={"ID":"e7b26d94-5f27-4f38-a066-70f1d20ae6d9","Type":"ContainerStarted","Data":"c6005a2b7a71ad9ad0b81e731a84f8f92c062336559bd9698e6f68653fb90641"}
Sep 16 12:47:26.962650 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:26.962560    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-4fz99"
Sep 16 12:47:26.964651 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:26.964621    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf" event={"ID":"688fc75f-d9f0-4e95-9840-e18dd35191f2","Type":"ContainerStarted","Data":"b68deefc9a8e08345e2ed442494e3be82171053453ca31cd71e155c271c5c63d"}
Sep 16 12:47:26.964804 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:26.964748    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:26.982024 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:26.981950    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-xpg7x" podStartSLOduration=2.392924331 podStartE2EDuration="8.981930993s" totalImagesPullingTime="6.589006662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:47:26.979741793 +0000 UTC m=+530.544562895" watchObservedRunningTime="2026-09-16 12:47:26.981930993 +0000 UTC m=+530.546752086"
Sep 16 12:47:26.988083 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:26.988035    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:27.029866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.029816    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8568fcf948-vhx9p" podStartSLOduration=2.267533074 podStartE2EDuration="9.029799037s" totalImagesPullingTime="6.762265963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:47:27.002930754 +0000 UTC m=+530.567751846" watchObservedRunningTime="2026-09-16 12:47:27.029799037 +0000 UTC m=+530.594620455"
Sep 16 12:47:27.030192 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.030158    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf" podStartSLOduration=1.949611193 podStartE2EDuration="8.030143918s" totalImagesPullingTime="6.080532725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:47:27.028302412 +0000 UTC m=+530.593123504" watchObservedRunningTime="2026-09-16 12:47:27.030143918 +0000 UTC m=+530.594965009"
Sep 16 12:47:27.059781 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.059729    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-4fz99" podStartSLOduration=1.501459916 podStartE2EDuration="8.059709267s" totalImagesPullingTime="6.558249351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:47:27.056781328 +0000 UTC m=+530.621602420" watchObservedRunningTime="2026-09-16 12:47:27.059709267 +0000 UTC m=+530.624530361"
Sep 16 12:47:27.061366 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.061334    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:27.358758 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.358680    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:27.542196 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.542156    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"]
Sep 16 12:47:27.544883 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.544859    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.563998 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.563969    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"]
Sep 16 12:47:27.565710 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.565654    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:27.658813 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.658438    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2gxc\" (UniqueName: \"kubernetes.io/projected/9ba27cb0-3e67-4533-9fde-b364c1866e35-kube-api-access-x2gxc\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.658813 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.658537    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9ba27cb0-3e67-4533-9fde-b364c1866e35-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.658813 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.658585    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9ba27cb0-3e67-4533-9fde-b364c1866e35-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.658813 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.658616    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ba27cb0-3e67-4533-9fde-b364c1866e35-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.658813 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.658649    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ba27cb0-3e67-4533-9fde-b364c1866e35-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.658813 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.658682    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9ba27cb0-3e67-4533-9fde-b364c1866e35-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.658813 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.658707    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ba27cb0-3e67-4533-9fde-b364c1866e35-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.759660 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.759621    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9ba27cb0-3e67-4533-9fde-b364c1866e35-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.759823 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.759674    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ba27cb0-3e67-4533-9fde-b364c1866e35-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.759823 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.759710    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ba27cb0-3e67-4533-9fde-b364c1866e35-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.759823 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.759743    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9ba27cb0-3e67-4533-9fde-b364c1866e35-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.759823 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.759768    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ba27cb0-3e67-4533-9fde-b364c1866e35-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.760015 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.759828    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2gxc\" (UniqueName: \"kubernetes.io/projected/9ba27cb0-3e67-4533-9fde-b364c1866e35-kube-api-access-x2gxc\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.760015 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.759925    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9ba27cb0-3e67-4533-9fde-b364c1866e35-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.761385 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.761314    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9ba27cb0-3e67-4533-9fde-b364c1866e35-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.762389 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.762363    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ba27cb0-3e67-4533-9fde-b364c1866e35-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.762510 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.762399    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9ba27cb0-3e67-4533-9fde-b364c1866e35-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.762510 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.762415    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ba27cb0-3e67-4533-9fde-b364c1866e35-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.762631 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.762611    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9ba27cb0-3e67-4533-9fde-b364c1866e35-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.769449 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.769421    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2gxc\" (UniqueName: \"kubernetes.io/projected/9ba27cb0-3e67-4533-9fde-b364c1866e35-kube-api-access-x2gxc\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.772160 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.772139    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ba27cb0-3e67-4533-9fde-b364c1866e35-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-t9znl\" (UID: \"9ba27cb0-3e67-4533-9fde-b364c1866e35\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.854260 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.854233    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:27.971718 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:27.971655    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:28.074006 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:28.073971    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:28.130191 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:28.130167    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"]
Sep 16 12:47:28.132320 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:47:28.132294    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ba27cb0_3e67_4533_9fde_b364c1866e35.slice/crio-8f3a48b8c290c9a46aa079636f54f502803bb67dcbefdc6edf853caf5bdb5978 WatchSource:0}: Error finding container 8f3a48b8c290c9a46aa079636f54f502803bb67dcbefdc6edf853caf5bdb5978: Status 404 returned error can't find the container with id 8f3a48b8c290c9a46aa079636f54f502803bb67dcbefdc6edf853caf5bdb5978
Sep 16 12:47:28.135197 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:28.135163    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:47:28.135278 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:28.135233    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:47:28.975966 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:28.975925    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl" event={"ID":"9ba27cb0-3e67-4533-9fde-b364c1866e35","Type":"ContainerStarted","Data":"1ca505751a351476bfffae08a3b8f4cce3241ea16ba4d1895117abe3237c0815"}
Sep 16 12:47:28.976360 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:28.976139    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:28.976360 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:28.976185    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl" event={"ID":"9ba27cb0-3e67-4533-9fde-b364c1866e35","Type":"ContainerStarted","Data":"8f3a48b8c290c9a46aa079636f54f502803bb67dcbefdc6edf853caf5bdb5978"}
Sep 16 12:47:29.003900 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:29.003850    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl" podStartSLOduration=2.003833784 podStartE2EDuration="2.003833784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:47:29.001059444 +0000 UTC m=+532.565880568" watchObservedRunningTime="2026-09-16 12:47:29.003833784 +0000 UTC m=+532.568654876"
Sep 16 12:47:29.982884 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:29.982855    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-t9znl"
Sep 16 12:47:30.057620 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.057591    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"]
Sep 16 12:47:30.057784 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.057769    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf" podUID="688fc75f-d9f0-4e95-9840-e18dd35191f2" containerName="discovery" containerID="cri-o://b68deefc9a8e08345e2ed442494e3be82171053453ca31cd71e155c271c5c63d" gracePeriod=30
Sep 16 12:47:30.298067 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.298038    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:30.394234 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.394203    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/688fc75f-d9f0-4e95-9840-e18dd35191f2-local-certs\") pod \"688fc75f-d9f0-4e95-9840-e18dd35191f2\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") "
Sep 16 12:47:30.394405 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.394247    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-token\") pod \"688fc75f-d9f0-4e95-9840-e18dd35191f2\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") "
Sep 16 12:47:30.394405 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.394296    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-cacerts\") pod \"688fc75f-d9f0-4e95-9840-e18dd35191f2\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") "
Sep 16 12:47:30.394405 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.394321    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-csr-dns-cert\") pod \"688fc75f-d9f0-4e95-9840-e18dd35191f2\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") "
Sep 16 12:47:30.394405 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.394354    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfqhm\" (UniqueName: \"kubernetes.io/projected/688fc75f-d9f0-4e95-9840-e18dd35191f2-kube-api-access-tfqhm\") pod \"688fc75f-d9f0-4e95-9840-e18dd35191f2\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") "
Sep 16 12:47:30.394657 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.394408    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-csr-ca-configmap\") pod \"688fc75f-d9f0-4e95-9840-e18dd35191f2\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") "
Sep 16 12:47:30.394657 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.394460    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-kubeconfig\") pod \"688fc75f-d9f0-4e95-9840-e18dd35191f2\" (UID: \"688fc75f-d9f0-4e95-9840-e18dd35191f2\") "
Sep 16 12:47:30.394912 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.394848    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "688fc75f-d9f0-4e95-9840-e18dd35191f2" (UID: "688fc75f-d9f0-4e95-9840-e18dd35191f2"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:47:30.397006 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.396972    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "688fc75f-d9f0-4e95-9840-e18dd35191f2" (UID: "688fc75f-d9f0-4e95-9840-e18dd35191f2"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:47:30.397006 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.396992    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/688fc75f-d9f0-4e95-9840-e18dd35191f2-local-certs" (OuterVolumeSpecName: "local-certs") pod "688fc75f-d9f0-4e95-9840-e18dd35191f2" (UID: "688fc75f-d9f0-4e95-9840-e18dd35191f2"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:47:30.397178 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.397004    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "688fc75f-d9f0-4e95-9840-e18dd35191f2" (UID: "688fc75f-d9f0-4e95-9840-e18dd35191f2"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:47:30.397178 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.397023    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-cacerts" (OuterVolumeSpecName: "cacerts") pod "688fc75f-d9f0-4e95-9840-e18dd35191f2" (UID: "688fc75f-d9f0-4e95-9840-e18dd35191f2"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:47:30.397178 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.396992    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/688fc75f-d9f0-4e95-9840-e18dd35191f2-kube-api-access-tfqhm" (OuterVolumeSpecName: "kube-api-access-tfqhm") pod "688fc75f-d9f0-4e95-9840-e18dd35191f2" (UID: "688fc75f-d9f0-4e95-9840-e18dd35191f2"). InnerVolumeSpecName "kube-api-access-tfqhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:47:30.397178 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.397054    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-token" (OuterVolumeSpecName: "istio-token") pod "688fc75f-d9f0-4e95-9840-e18dd35191f2" (UID: "688fc75f-d9f0-4e95-9840-e18dd35191f2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:47:30.495470 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.495447    2549 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-cacerts\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:47:30.495470 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.495471    2549 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-csr-dns-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:47:30.495646 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.495499    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfqhm\" (UniqueName: \"kubernetes.io/projected/688fc75f-d9f0-4e95-9840-e18dd35191f2-kube-api-access-tfqhm\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:47:30.495646 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.495520    2549 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-csr-ca-configmap\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:47:30.495646 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.495528    2549 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-kubeconfig\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:47:30.495646 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.495536    2549 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/688fc75f-d9f0-4e95-9840-e18dd35191f2-local-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:47:30.495646 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.495544    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/688fc75f-d9f0-4e95-9840-e18dd35191f2-istio-token\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:47:30.794192 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.794158    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:30.902373 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.902302    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:30.941622 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.941595    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cm822"]
Sep 16 12:47:30.941923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.941907    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="688fc75f-d9f0-4e95-9840-e18dd35191f2" containerName="discovery"
Sep 16 12:47:30.941992 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.941926    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="688fc75f-d9f0-4e95-9840-e18dd35191f2" containerName="discovery"
Sep 16 12:47:30.942029 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.941994    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="688fc75f-d9f0-4e95-9840-e18dd35191f2" containerName="discovery"
Sep 16 12:47:30.944754 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.944733    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cm822"
Sep 16 12:47:30.948072 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.948051    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-fm4tk\""
Sep 16 12:47:30.948663 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.948646    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 16 12:47:30.966001 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.965976    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cm822"]
Sep 16 12:47:30.987797 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.987771    2549 generic.go:356] "Generic (PLEG): container finished" podID="688fc75f-d9f0-4e95-9840-e18dd35191f2" containerID="b68deefc9a8e08345e2ed442494e3be82171053453ca31cd71e155c271c5c63d" exitCode=0
Sep 16 12:47:30.988201 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.987831    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"
Sep 16 12:47:30.988201 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.987870    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf" event={"ID":"688fc75f-d9f0-4e95-9840-e18dd35191f2","Type":"ContainerDied","Data":"b68deefc9a8e08345e2ed442494e3be82171053453ca31cd71e155c271c5c63d"}
Sep 16 12:47:30.988201 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.987912    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf" event={"ID":"688fc75f-d9f0-4e95-9840-e18dd35191f2","Type":"ContainerDied","Data":"27a28d49e4fcfae5a74dd60cb63cf974ebb63b4016011446828d2a7bc8000704"}
Sep 16 12:47:30.988201 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.987936    2549 scope.go:117] "RemoveContainer" containerID="b68deefc9a8e08345e2ed442494e3be82171053453ca31cd71e155c271c5c63d"
Sep 16 12:47:30.996511 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.996492    2549 scope.go:117] "RemoveContainer" containerID="b68deefc9a8e08345e2ed442494e3be82171053453ca31cd71e155c271c5c63d"
Sep 16 12:47:30.996789 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:47:30.996765    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b68deefc9a8e08345e2ed442494e3be82171053453ca31cd71e155c271c5c63d\": container with ID starting with b68deefc9a8e08345e2ed442494e3be82171053453ca31cd71e155c271c5c63d not found: ID does not exist" containerID="b68deefc9a8e08345e2ed442494e3be82171053453ca31cd71e155c271c5c63d"
Sep 16 12:47:30.996851 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:30.996801    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b68deefc9a8e08345e2ed442494e3be82171053453ca31cd71e155c271c5c63d"} err="failed to get container status \"b68deefc9a8e08345e2ed442494e3be82171053453ca31cd71e155c271c5c63d\": rpc error: code = NotFound desc = could not find container \"b68deefc9a8e08345e2ed442494e3be82171053453ca31cd71e155c271c5c63d\": container with ID starting with b68deefc9a8e08345e2ed442494e3be82171053453ca31cd71e155c271c5c63d not found: ID does not exist"
Sep 16 12:47:31.000212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:31.000169    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ckdp\" (UniqueName: \"kubernetes.io/projected/eae319fe-3165-436d-a422-ccc32ee28537-kube-api-access-9ckdp\") pod \"kserve-controller-manager-d6f4b65b8-cm822\" (UID: \"eae319fe-3165-436d-a422-ccc32ee28537\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cm822"
Sep 16 12:47:31.000323 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:31.000232    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eae319fe-3165-436d-a422-ccc32ee28537-cert\") pod \"kserve-controller-manager-d6f4b65b8-cm822\" (UID: \"eae319fe-3165-436d-a422-ccc32ee28537\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cm822"
Sep 16 12:47:31.021881 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:31.021859    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:31.055189 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:31.055127    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"]
Sep 16 12:47:31.062082 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:31.062058    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-lwtdf"]
Sep 16 12:47:31.101050 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:31.101023    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ckdp\" (UniqueName: \"kubernetes.io/projected/eae319fe-3165-436d-a422-ccc32ee28537-kube-api-access-9ckdp\") pod \"kserve-controller-manager-d6f4b65b8-cm822\" (UID: \"eae319fe-3165-436d-a422-ccc32ee28537\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cm822"
Sep 16 12:47:31.101154 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:31.101073    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eae319fe-3165-436d-a422-ccc32ee28537-cert\") pod \"kserve-controller-manager-d6f4b65b8-cm822\" (UID: \"eae319fe-3165-436d-a422-ccc32ee28537\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cm822"
Sep 16 12:47:31.101234 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:47:31.101186    2549 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 16 12:47:31.101291 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:47:31.101250    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae319fe-3165-436d-a422-ccc32ee28537-cert podName:eae319fe-3165-436d-a422-ccc32ee28537 nodeName:}" failed. No retries permitted until 2026-09-16 12:47:31.601229892 +0000 UTC m=+535.166050979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/eae319fe-3165-436d-a422-ccc32ee28537-cert") pod "kserve-controller-manager-d6f4b65b8-cm822" (UID: "eae319fe-3165-436d-a422-ccc32ee28537") : secret "kserve-webhook-server-cert" not found
Sep 16 12:47:31.121411 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:31.121383    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ckdp\" (UniqueName: \"kubernetes.io/projected/eae319fe-3165-436d-a422-ccc32ee28537-kube-api-access-9ckdp\") pod \"kserve-controller-manager-d6f4b65b8-cm822\" (UID: \"eae319fe-3165-436d-a422-ccc32ee28537\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cm822"
Sep 16 12:47:31.173918 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:31.173869    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:31.419836 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:31.419801    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:31.605748 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:31.605712    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eae319fe-3165-436d-a422-ccc32ee28537-cert\") pod \"kserve-controller-manager-d6f4b65b8-cm822\" (UID: \"eae319fe-3165-436d-a422-ccc32ee28537\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cm822"
Sep 16 12:47:31.608014 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:31.607992    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eae319fe-3165-436d-a422-ccc32ee28537-cert\") pod \"kserve-controller-manager-d6f4b65b8-cm822\" (UID: \"eae319fe-3165-436d-a422-ccc32ee28537\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cm822"
Sep 16 12:47:31.854517 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:31.854424    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cm822"
Sep 16 12:47:32.130532 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:32.130504    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cm822"]
Sep 16 12:47:32.132451 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:47:32.132418    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae319fe_3165_436d_a422_ccc32ee28537.slice/crio-62e9a5c339b0f23a5f9d1fdbcbecea7a754e2fbe89fd32faeae67bd4ca8876f1 WatchSource:0}: Error finding container 62e9a5c339b0f23a5f9d1fdbcbecea7a754e2fbe89fd32faeae67bd4ca8876f1: Status 404 returned error can't find the container with id 62e9a5c339b0f23a5f9d1fdbcbecea7a754e2fbe89fd32faeae67bd4ca8876f1
Sep 16 12:47:32.227494 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:32.227442    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:32.332185 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:32.332150    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:32.400847 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:32.400746    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:47:32.921495 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:32.921456    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="688fc75f-d9f0-4e95-9840-e18dd35191f2" path="/var/lib/kubelet/pods/688fc75f-d9f0-4e95-9840-e18dd35191f2/volumes"
Sep 16 12:47:32.999927 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:32.999891    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cm822" event={"ID":"eae319fe-3165-436d-a422-ccc32ee28537","Type":"ContainerStarted","Data":"62e9a5c339b0f23a5f9d1fdbcbecea7a754e2fbe89fd32faeae67bd4ca8876f1"}
Sep 16 12:47:35.012528 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:35.012495    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cm822" event={"ID":"eae319fe-3165-436d-a422-ccc32ee28537","Type":"ContainerStarted","Data":"0cf0494487a09495dc5de1c0abd8a0b4dfdf4a4e5906203c93245be366fbfc22"}
Sep 16 12:47:35.012872 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:35.012627    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cm822"
Sep 16 12:47:35.048594 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:35.048545    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cm822" podStartSLOduration=2.8417103839999998 podStartE2EDuration="5.048528074s" totalImagesPullingTime="2.20681769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:47:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:47:35.045086258 +0000 UTC m=+538.609907349" watchObservedRunningTime="2026-09-16 12:47:35.048528074 +0000 UTC m=+538.613349164"
Sep 16 12:47:37.975231 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:37.975202    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-4fz99"
Sep 16 12:47:38.978562 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:47:38.978534    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-xpg7x"
Sep 16 12:48:06.023083 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:06.023050    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cm822"
Sep 16 12:48:19.892182 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:19.892145    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:19.992531 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:19.992473    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:24.056096 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.056060    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"]
Sep 16 12:48:24.058603 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.058583    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"
Sep 16 12:48:24.061220 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.061198    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 16 12:48:24.061328 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.061199    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-5ttwq\""
Sep 16 12:48:24.061990 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.061972    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 16 12:48:24.069674 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.069653    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"]
Sep 16 12:48:24.111371 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.111345    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864\" (UID: \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"
Sep 16 12:48:24.111501 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.111400    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864\" (UID: \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"
Sep 16 12:48:24.111501 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.111440    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn972\" (UniqueName: \"kubernetes.io/projected/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-kube-api-access-dn972\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864\" (UID: \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"
Sep 16 12:48:24.185078 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.185052    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"]
Sep 16 12:48:24.187507 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.187470    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"
Sep 16 12:48:24.200823 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.200802    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"]
Sep 16 12:48:24.212209 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.212184    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864\" (UID: \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"
Sep 16 12:48:24.212324 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.212256    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864\" (UID: \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"
Sep 16 12:48:24.212324 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.212299    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn972\" (UniqueName: \"kubernetes.io/projected/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-kube-api-access-dn972\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864\" (UID: \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"
Sep 16 12:48:24.212617 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.212596    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864\" (UID: \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"
Sep 16 12:48:24.212686 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.212632    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864\" (UID: \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"
Sep 16 12:48:24.221278 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.221259    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn972\" (UniqueName: \"kubernetes.io/projected/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-kube-api-access-dn972\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864\" (UID: \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"
Sep 16 12:48:24.263174 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.263147    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"]
Sep 16 12:48:24.265447 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.265428    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"
Sep 16 12:48:24.275743 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.275722    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"]
Sep 16 12:48:24.313200 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.313146    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4114faa-767b-4c52-8502-19bb86efbbbd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8\" (UID: \"d4114faa-767b-4c52-8502-19bb86efbbbd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"
Sep 16 12:48:24.313200 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.313191    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12aef8cc-c83b-484d-a765-eca240d5f2a5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv\" (UID: \"12aef8cc-c83b-484d-a765-eca240d5f2a5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"
Sep 16 12:48:24.313321 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.313229    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trqtb\" (UniqueName: \"kubernetes.io/projected/d4114faa-767b-4c52-8502-19bb86efbbbd-kube-api-access-trqtb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8\" (UID: \"d4114faa-767b-4c52-8502-19bb86efbbbd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"
Sep 16 12:48:24.313321 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.313260    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpzpl\" (UniqueName: \"kubernetes.io/projected/12aef8cc-c83b-484d-a765-eca240d5f2a5-kube-api-access-wpzpl\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv\" (UID: \"12aef8cc-c83b-484d-a765-eca240d5f2a5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"
Sep 16 12:48:24.313321 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.313311    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12aef8cc-c83b-484d-a765-eca240d5f2a5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv\" (UID: \"12aef8cc-c83b-484d-a765-eca240d5f2a5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"
Sep 16 12:48:24.313413 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.313328    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4114faa-767b-4c52-8502-19bb86efbbbd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8\" (UID: \"d4114faa-767b-4c52-8502-19bb86efbbbd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"
Sep 16 12:48:24.357797 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.357770    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"]
Sep 16 12:48:24.360214 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.360197    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"
Sep 16 12:48:24.366784 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.366765    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"
Sep 16 12:48:24.370108 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.370088    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"]
Sep 16 12:48:24.414589 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.414553    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqtb\" (UniqueName: \"kubernetes.io/projected/d4114faa-767b-4c52-8502-19bb86efbbbd-kube-api-access-trqtb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8\" (UID: \"d4114faa-767b-4c52-8502-19bb86efbbbd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"
Sep 16 12:48:24.414763 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.414610    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eae54ca1-97ab-46ef-94d6-d4175d836326-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q\" (UID: \"eae54ca1-97ab-46ef-94d6-d4175d836326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"
Sep 16 12:48:24.414763 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.414633    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpzpl\" (UniqueName: \"kubernetes.io/projected/12aef8cc-c83b-484d-a765-eca240d5f2a5-kube-api-access-wpzpl\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv\" (UID: \"12aef8cc-c83b-484d-a765-eca240d5f2a5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"
Sep 16 12:48:24.414763 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.414667    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eae54ca1-97ab-46ef-94d6-d4175d836326-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q\" (UID: \"eae54ca1-97ab-46ef-94d6-d4175d836326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"
Sep 16 12:48:24.414763 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.414716    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12aef8cc-c83b-484d-a765-eca240d5f2a5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv\" (UID: \"12aef8cc-c83b-484d-a765-eca240d5f2a5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"
Sep 16 12:48:24.414763 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.414744    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4114faa-767b-4c52-8502-19bb86efbbbd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8\" (UID: \"d4114faa-767b-4c52-8502-19bb86efbbbd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"
Sep 16 12:48:24.415076 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.414792    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4114faa-767b-4c52-8502-19bb86efbbbd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8\" (UID: \"d4114faa-767b-4c52-8502-19bb86efbbbd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"
Sep 16 12:48:24.415076 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.414824    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7trb\" (UniqueName: \"kubernetes.io/projected/eae54ca1-97ab-46ef-94d6-d4175d836326-kube-api-access-h7trb\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q\" (UID: \"eae54ca1-97ab-46ef-94d6-d4175d836326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"
Sep 16 12:48:24.415076 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.414873    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12aef8cc-c83b-484d-a765-eca240d5f2a5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv\" (UID: \"12aef8cc-c83b-484d-a765-eca240d5f2a5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"
Sep 16 12:48:24.415238 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.415144    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12aef8cc-c83b-484d-a765-eca240d5f2a5-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv\" (UID: \"12aef8cc-c83b-484d-a765-eca240d5f2a5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"
Sep 16 12:48:24.415238 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.415166    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4114faa-767b-4c52-8502-19bb86efbbbd-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8\" (UID: \"d4114faa-767b-4c52-8502-19bb86efbbbd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"
Sep 16 12:48:24.415238 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.415190    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4114faa-767b-4c52-8502-19bb86efbbbd-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8\" (UID: \"d4114faa-767b-4c52-8502-19bb86efbbbd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"
Sep 16 12:48:24.415398 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.415336    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12aef8cc-c83b-484d-a765-eca240d5f2a5-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv\" (UID: \"12aef8cc-c83b-484d-a765-eca240d5f2a5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"
Sep 16 12:48:24.424169 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.424143    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trqtb\" (UniqueName: \"kubernetes.io/projected/d4114faa-767b-4c52-8502-19bb86efbbbd-kube-api-access-trqtb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8\" (UID: \"d4114faa-767b-4c52-8502-19bb86efbbbd\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"
Sep 16 12:48:24.424374 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.424348    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpzpl\" (UniqueName: \"kubernetes.io/projected/12aef8cc-c83b-484d-a765-eca240d5f2a5-kube-api-access-wpzpl\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv\" (UID: \"12aef8cc-c83b-484d-a765-eca240d5f2a5\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"
Sep 16 12:48:24.496193 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.496161    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"
Sep 16 12:48:24.516019 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.515995    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7trb\" (UniqueName: \"kubernetes.io/projected/eae54ca1-97ab-46ef-94d6-d4175d836326-kube-api-access-h7trb\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q\" (UID: \"eae54ca1-97ab-46ef-94d6-d4175d836326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"
Sep 16 12:48:24.516143 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.516050    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eae54ca1-97ab-46ef-94d6-d4175d836326-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q\" (UID: \"eae54ca1-97ab-46ef-94d6-d4175d836326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"
Sep 16 12:48:24.516143 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.516089    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eae54ca1-97ab-46ef-94d6-d4175d836326-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q\" (UID: \"eae54ca1-97ab-46ef-94d6-d4175d836326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"
Sep 16 12:48:24.516414 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.516394    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eae54ca1-97ab-46ef-94d6-d4175d836326-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q\" (UID: \"eae54ca1-97ab-46ef-94d6-d4175d836326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"
Sep 16 12:48:24.516517 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.516492    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eae54ca1-97ab-46ef-94d6-d4175d836326-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q\" (UID: \"eae54ca1-97ab-46ef-94d6-d4175d836326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"
Sep 16 12:48:24.526002 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.525974    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7trb\" (UniqueName: \"kubernetes.io/projected/eae54ca1-97ab-46ef-94d6-d4175d836326-kube-api-access-h7trb\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q\" (UID: \"eae54ca1-97ab-46ef-94d6-d4175d836326\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"
Sep 16 12:48:24.575076 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.575006    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"
Sep 16 12:48:24.646160 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.646130    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"]
Sep 16 12:48:24.649517 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:48:24.649449    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7af1d71_6fe5_4f1a_8a6b_55a0fb4173ff.slice/crio-a66aa81528ce3314bb6ef2e73ebdf84a270a41ec517daa9cd6545e19daebc316 WatchSource:0}: Error finding container a66aa81528ce3314bb6ef2e73ebdf84a270a41ec517daa9cd6545e19daebc316: Status 404 returned error can't find the container with id a66aa81528ce3314bb6ef2e73ebdf84a270a41ec517daa9cd6545e19daebc316
Sep 16 12:48:24.669691 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.669667    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"
Sep 16 12:48:24.770193 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.770165    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"]
Sep 16 12:48:24.770976 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:48:24.770955    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12aef8cc_c83b_484d_a765_eca240d5f2a5.slice/crio-fff68656429c1d1af68ba06336df0d9a24d243e17a9fbf754f6c067fde52566b WatchSource:0}: Error finding container fff68656429c1d1af68ba06336df0d9a24d243e17a9fbf754f6c067fde52566b: Status 404 returned error can't find the container with id fff68656429c1d1af68ba06336df0d9a24d243e17a9fbf754f6c067fde52566b
Sep 16 12:48:24.846112 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.846084    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"]
Sep 16 12:48:24.846935 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:48:24.846908    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4114faa_767b_4c52_8502_19bb86efbbbd.slice/crio-8ab3a4fea1032a82644199c73e6c2ee9faf48256118e13096d3d053205808965 WatchSource:0}: Error finding container 8ab3a4fea1032a82644199c73e6c2ee9faf48256118e13096d3d053205808965: Status 404 returned error can't find the container with id 8ab3a4fea1032a82644199c73e6c2ee9faf48256118e13096d3d053205808965
Sep 16 12:48:24.947971 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:24.947774    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"]
Sep 16 12:48:25.010305 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:48:25.010256    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae54ca1_97ab_46ef_94d6_d4175d836326.slice/crio-3143c81e6ac3428b469c414caabe64e2eaec73ea4d7fd16c2d217e784fbd33c7 WatchSource:0}: Error finding container 3143c81e6ac3428b469c414caabe64e2eaec73ea4d7fd16c2d217e784fbd33c7: Status 404 returned error can't find the container with id 3143c81e6ac3428b469c414caabe64e2eaec73ea4d7fd16c2d217e784fbd33c7
Sep 16 12:48:25.243636 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:25.243599    2549 generic.go:356] "Generic (PLEG): container finished" podID="e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff" containerID="b8266cec331d347cad66a3d05f564bf0f4664a2853b4739df3807ad3bc313125" exitCode=0
Sep 16 12:48:25.244059 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:25.243677    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864" event={"ID":"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff","Type":"ContainerDied","Data":"b8266cec331d347cad66a3d05f564bf0f4664a2853b4739df3807ad3bc313125"}
Sep 16 12:48:25.244059 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:25.243727    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864" event={"ID":"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff","Type":"ContainerStarted","Data":"a66aa81528ce3314bb6ef2e73ebdf84a270a41ec517daa9cd6545e19daebc316"}
Sep 16 12:48:25.245444 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:25.245416    2549 generic.go:356] "Generic (PLEG): container finished" podID="eae54ca1-97ab-46ef-94d6-d4175d836326" containerID="62284cc901bccb727ea96a34af595da0d322ff8fface13bb0144556e9db95bb7" exitCode=0
Sep 16 12:48:25.245575 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:25.245490    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q" event={"ID":"eae54ca1-97ab-46ef-94d6-d4175d836326","Type":"ContainerDied","Data":"62284cc901bccb727ea96a34af595da0d322ff8fface13bb0144556e9db95bb7"}
Sep 16 12:48:25.245575 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:25.245548    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q" event={"ID":"eae54ca1-97ab-46ef-94d6-d4175d836326","Type":"ContainerStarted","Data":"3143c81e6ac3428b469c414caabe64e2eaec73ea4d7fd16c2d217e784fbd33c7"}
Sep 16 12:48:25.247139 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:25.247106    2549 generic.go:356] "Generic (PLEG): container finished" podID="d4114faa-767b-4c52-8502-19bb86efbbbd" containerID="8c9c1c7815e5fb8c3d30c0edac57ca11eeb4c58943158fd1253050af15cb9ca4" exitCode=0
Sep 16 12:48:25.247220 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:25.247205    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8" event={"ID":"d4114faa-767b-4c52-8502-19bb86efbbbd","Type":"ContainerDied","Data":"8c9c1c7815e5fb8c3d30c0edac57ca11eeb4c58943158fd1253050af15cb9ca4"}
Sep 16 12:48:25.247278 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:25.247246    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8" event={"ID":"d4114faa-767b-4c52-8502-19bb86efbbbd","Type":"ContainerStarted","Data":"8ab3a4fea1032a82644199c73e6c2ee9faf48256118e13096d3d053205808965"}
Sep 16 12:48:25.249009 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:25.248991    2549 generic.go:356] "Generic (PLEG): container finished" podID="12aef8cc-c83b-484d-a765-eca240d5f2a5" containerID="2a176937e1d26ba182ec78c2d092523ae92ab45e986a3ded72b4af07326b748b" exitCode=0
Sep 16 12:48:25.249100 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:25.249035    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv" event={"ID":"12aef8cc-c83b-484d-a765-eca240d5f2a5","Type":"ContainerDied","Data":"2a176937e1d26ba182ec78c2d092523ae92ab45e986a3ded72b4af07326b748b"}
Sep 16 12:48:25.249100 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:25.249072    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv" event={"ID":"12aef8cc-c83b-484d-a765-eca240d5f2a5","Type":"ContainerStarted","Data":"fff68656429c1d1af68ba06336df0d9a24d243e17a9fbf754f6c067fde52566b"}
Sep 16 12:48:26.257592 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:26.257513    2549 generic.go:356] "Generic (PLEG): container finished" podID="e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff" containerID="13037c3d88d8cb9df16d73701eef527dc146128f07acf9a91019c6851543246b" exitCode=0
Sep 16 12:48:26.257963 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:26.257586    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864" event={"ID":"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff","Type":"ContainerDied","Data":"13037c3d88d8cb9df16d73701eef527dc146128f07acf9a91019c6851543246b"}
Sep 16 12:48:26.259388 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:26.259368    2549 generic.go:356] "Generic (PLEG): container finished" podID="d4114faa-767b-4c52-8502-19bb86efbbbd" containerID="223492f819d2f1942bec4888690dadc20bb97ed8a719718e8090f6da37693f3c" exitCode=0
Sep 16 12:48:26.259509 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:26.259428    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8" event={"ID":"d4114faa-767b-4c52-8502-19bb86efbbbd","Type":"ContainerDied","Data":"223492f819d2f1942bec4888690dadc20bb97ed8a719718e8090f6da37693f3c"}
Sep 16 12:48:26.261274 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:26.261251    2549 generic.go:356] "Generic (PLEG): container finished" podID="12aef8cc-c83b-484d-a765-eca240d5f2a5" containerID="6d8cd6058a8dd2a9befa8c9c21353f233814765799174821b3cddec7b6b4a66e" exitCode=0
Sep 16 12:48:26.261341 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:26.261299    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv" event={"ID":"12aef8cc-c83b-484d-a765-eca240d5f2a5","Type":"ContainerDied","Data":"6d8cd6058a8dd2a9befa8c9c21353f233814765799174821b3cddec7b6b4a66e"}
Sep 16 12:48:27.267997 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:27.267963    2549 generic.go:356] "Generic (PLEG): container finished" podID="12aef8cc-c83b-484d-a765-eca240d5f2a5" containerID="92bca096622f8c41db51fc24cc59cd7c369070e4770c21c6df22460a024485e2" exitCode=0
Sep 16 12:48:27.268426 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:27.268055    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv" event={"ID":"12aef8cc-c83b-484d-a765-eca240d5f2a5","Type":"ContainerDied","Data":"92bca096622f8c41db51fc24cc59cd7c369070e4770c21c6df22460a024485e2"}
Sep 16 12:48:27.270275 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:27.270250    2549 generic.go:356] "Generic (PLEG): container finished" podID="e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff" containerID="ce3fc79181c22626888022451d14ca85aee6c69d9a090b3f60b0d3f9bee10a27" exitCode=0
Sep 16 12:48:27.270387 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:27.270336    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864" event={"ID":"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff","Type":"ContainerDied","Data":"ce3fc79181c22626888022451d14ca85aee6c69d9a090b3f60b0d3f9bee10a27"}
Sep 16 12:48:27.272192 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:27.272173    2549 generic.go:356] "Generic (PLEG): container finished" podID="eae54ca1-97ab-46ef-94d6-d4175d836326" containerID="6f513f6d0852bbcb3d67a99c48e8cade3c111645cf56053532d4baf51809fd9f" exitCode=0
Sep 16 12:48:27.272285 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:27.272248    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q" event={"ID":"eae54ca1-97ab-46ef-94d6-d4175d836326","Type":"ContainerDied","Data":"6f513f6d0852bbcb3d67a99c48e8cade3c111645cf56053532d4baf51809fd9f"}
Sep 16 12:48:27.274646 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:27.274627    2549 generic.go:356] "Generic (PLEG): container finished" podID="d4114faa-767b-4c52-8502-19bb86efbbbd" containerID="c3d901af4380d120b7f3e77b7baed21e912ea3457103060fa1878766c3b40ef6" exitCode=0
Sep 16 12:48:27.274727 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:27.274680    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8" event={"ID":"d4114faa-767b-4c52-8502-19bb86efbbbd","Type":"ContainerDied","Data":"c3d901af4380d120b7f3e77b7baed21e912ea3457103060fa1878766c3b40ef6"}
Sep 16 12:48:28.285216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.285181    2549 generic.go:356] "Generic (PLEG): container finished" podID="eae54ca1-97ab-46ef-94d6-d4175d836326" containerID="424cdeb488bdeb1885d302815d071ac0bc9afbc54a2adaad79f534eaaa37b257" exitCode=0
Sep 16 12:48:28.285597 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.285266    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q" event={"ID":"eae54ca1-97ab-46ef-94d6-d4175d836326","Type":"ContainerDied","Data":"424cdeb488bdeb1885d302815d071ac0bc9afbc54a2adaad79f534eaaa37b257"}
Sep 16 12:48:28.403868 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.403846    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"
Sep 16 12:48:28.438249 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.438226    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"
Sep 16 12:48:28.453970 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.453948    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4114faa-767b-4c52-8502-19bb86efbbbd-bundle\") pod \"d4114faa-767b-4c52-8502-19bb86efbbbd\" (UID: \"d4114faa-767b-4c52-8502-19bb86efbbbd\") "
Sep 16 12:48:28.454101 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.453989    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4114faa-767b-4c52-8502-19bb86efbbbd-util\") pod \"d4114faa-767b-4c52-8502-19bb86efbbbd\" (UID: \"d4114faa-767b-4c52-8502-19bb86efbbbd\") "
Sep 16 12:48:28.454101 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.454050    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trqtb\" (UniqueName: \"kubernetes.io/projected/d4114faa-767b-4c52-8502-19bb86efbbbd-kube-api-access-trqtb\") pod \"d4114faa-767b-4c52-8502-19bb86efbbbd\" (UID: \"d4114faa-767b-4c52-8502-19bb86efbbbd\") "
Sep 16 12:48:28.454747 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.454704    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4114faa-767b-4c52-8502-19bb86efbbbd-bundle" (OuterVolumeSpecName: "bundle") pod "d4114faa-767b-4c52-8502-19bb86efbbbd" (UID: "d4114faa-767b-4c52-8502-19bb86efbbbd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:48:28.456356 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.456326    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4114faa-767b-4c52-8502-19bb86efbbbd-kube-api-access-trqtb" (OuterVolumeSpecName: "kube-api-access-trqtb") pod "d4114faa-767b-4c52-8502-19bb86efbbbd" (UID: "d4114faa-767b-4c52-8502-19bb86efbbbd"). InnerVolumeSpecName "kube-api-access-trqtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:48:28.460933 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.460907    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4114faa-767b-4c52-8502-19bb86efbbbd-util" (OuterVolumeSpecName: "util") pod "d4114faa-767b-4c52-8502-19bb86efbbbd" (UID: "d4114faa-767b-4c52-8502-19bb86efbbbd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:48:28.472759 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.472733    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"
Sep 16 12:48:28.555222 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.555163    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpzpl\" (UniqueName: \"kubernetes.io/projected/12aef8cc-c83b-484d-a765-eca240d5f2a5-kube-api-access-wpzpl\") pod \"12aef8cc-c83b-484d-a765-eca240d5f2a5\" (UID: \"12aef8cc-c83b-484d-a765-eca240d5f2a5\") "
Sep 16 12:48:28.555222 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.555209    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12aef8cc-c83b-484d-a765-eca240d5f2a5-bundle\") pod \"12aef8cc-c83b-484d-a765-eca240d5f2a5\" (UID: \"12aef8cc-c83b-484d-a765-eca240d5f2a5\") "
Sep 16 12:48:28.555369 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.555252    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-bundle\") pod \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\" (UID: \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\") "
Sep 16 12:48:28.555369 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.555275    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12aef8cc-c83b-484d-a765-eca240d5f2a5-util\") pod \"12aef8cc-c83b-484d-a765-eca240d5f2a5\" (UID: \"12aef8cc-c83b-484d-a765-eca240d5f2a5\") "
Sep 16 12:48:28.555369 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.555306    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn972\" (UniqueName: \"kubernetes.io/projected/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-kube-api-access-dn972\") pod \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\" (UID: \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\") "
Sep 16 12:48:28.555369 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.555348    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-util\") pod \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\" (UID: \"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff\") "
Sep 16 12:48:28.555614 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.555590    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trqtb\" (UniqueName: \"kubernetes.io/projected/d4114faa-767b-4c52-8502-19bb86efbbbd-kube-api-access-trqtb\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:48:28.555675 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.555624    2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d4114faa-767b-4c52-8502-19bb86efbbbd-bundle\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:48:28.555675 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.555639    2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d4114faa-767b-4c52-8502-19bb86efbbbd-util\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:48:28.555863 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.555814    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12aef8cc-c83b-484d-a765-eca240d5f2a5-bundle" (OuterVolumeSpecName: "bundle") pod "12aef8cc-c83b-484d-a765-eca240d5f2a5" (UID: "12aef8cc-c83b-484d-a765-eca240d5f2a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:48:28.555927 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.555900    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-bundle" (OuterVolumeSpecName: "bundle") pod "e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff" (UID: "e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:48:28.557264 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.557233    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-kube-api-access-dn972" (OuterVolumeSpecName: "kube-api-access-dn972") pod "e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff" (UID: "e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff"). InnerVolumeSpecName "kube-api-access-dn972". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:48:28.557346 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.557263    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12aef8cc-c83b-484d-a765-eca240d5f2a5-kube-api-access-wpzpl" (OuterVolumeSpecName: "kube-api-access-wpzpl") pod "12aef8cc-c83b-484d-a765-eca240d5f2a5" (UID: "12aef8cc-c83b-484d-a765-eca240d5f2a5"). InnerVolumeSpecName "kube-api-access-wpzpl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:48:28.561346 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.561316    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-util" (OuterVolumeSpecName: "util") pod "e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff" (UID: "e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:48:28.561619 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.561599    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12aef8cc-c83b-484d-a765-eca240d5f2a5-util" (OuterVolumeSpecName: "util") pod "12aef8cc-c83b-484d-a765-eca240d5f2a5" (UID: "12aef8cc-c83b-484d-a765-eca240d5f2a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:48:28.656748 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.656720    2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-bundle\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:48:28.656748 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.656743    2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12aef8cc-c83b-484d-a765-eca240d5f2a5-util\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:48:28.656893 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.656759    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn972\" (UniqueName: \"kubernetes.io/projected/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-kube-api-access-dn972\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:48:28.656893 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.656772    2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff-util\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:48:28.656893 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.656783    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpzpl\" (UniqueName: \"kubernetes.io/projected/12aef8cc-c83b-484d-a765-eca240d5f2a5-kube-api-access-wpzpl\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:48:28.656893 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:28.656794    2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12aef8cc-c83b-484d-a765-eca240d5f2a5-bundle\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:48:29.291870 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.291788    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8"
Sep 16 12:48:29.291870 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.291815    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847asjkw8" event={"ID":"d4114faa-767b-4c52-8502-19bb86efbbbd","Type":"ContainerDied","Data":"8ab3a4fea1032a82644199c73e6c2ee9faf48256118e13096d3d053205808965"}
Sep 16 12:48:29.291870 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.291858    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ab3a4fea1032a82644199c73e6c2ee9faf48256118e13096d3d053205808965"
Sep 16 12:48:29.293920 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.293867    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv"
Sep 16 12:48:29.293920 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.293896    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6bqksv" event={"ID":"12aef8cc-c83b-484d-a765-eca240d5f2a5","Type":"ContainerDied","Data":"fff68656429c1d1af68ba06336df0d9a24d243e17a9fbf754f6c067fde52566b"}
Sep 16 12:48:29.294093 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.293950    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fff68656429c1d1af68ba06336df0d9a24d243e17a9fbf754f6c067fde52566b"
Sep 16 12:48:29.296001 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.295978    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864"
Sep 16 12:48:29.296132 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.295985    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cxq864" event={"ID":"e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff","Type":"ContainerDied","Data":"a66aa81528ce3314bb6ef2e73ebdf84a270a41ec517daa9cd6545e19daebc316"}
Sep 16 12:48:29.296132 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.296037    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a66aa81528ce3314bb6ef2e73ebdf84a270a41ec517daa9cd6545e19daebc316"
Sep 16 12:48:29.412488 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.412455    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"
Sep 16 12:48:29.461617 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.461593    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7trb\" (UniqueName: \"kubernetes.io/projected/eae54ca1-97ab-46ef-94d6-d4175d836326-kube-api-access-h7trb\") pod \"eae54ca1-97ab-46ef-94d6-d4175d836326\" (UID: \"eae54ca1-97ab-46ef-94d6-d4175d836326\") "
Sep 16 12:48:29.461755 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.461668    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eae54ca1-97ab-46ef-94d6-d4175d836326-util\") pod \"eae54ca1-97ab-46ef-94d6-d4175d836326\" (UID: \"eae54ca1-97ab-46ef-94d6-d4175d836326\") "
Sep 16 12:48:29.461859 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.461840    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eae54ca1-97ab-46ef-94d6-d4175d836326-bundle\") pod \"eae54ca1-97ab-46ef-94d6-d4175d836326\" (UID: \"eae54ca1-97ab-46ef-94d6-d4175d836326\") "
Sep 16 12:48:29.462308 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.462285    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eae54ca1-97ab-46ef-94d6-d4175d836326-bundle" (OuterVolumeSpecName: "bundle") pod "eae54ca1-97ab-46ef-94d6-d4175d836326" (UID: "eae54ca1-97ab-46ef-94d6-d4175d836326"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:48:29.463636 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.463614    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eae54ca1-97ab-46ef-94d6-d4175d836326-kube-api-access-h7trb" (OuterVolumeSpecName: "kube-api-access-h7trb") pod "eae54ca1-97ab-46ef-94d6-d4175d836326" (UID: "eae54ca1-97ab-46ef-94d6-d4175d836326"). InnerVolumeSpecName "kube-api-access-h7trb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:48:29.467168 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.467147    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eae54ca1-97ab-46ef-94d6-d4175d836326-util" (OuterVolumeSpecName: "util") pod "eae54ca1-97ab-46ef-94d6-d4175d836326" (UID: "eae54ca1-97ab-46ef-94d6-d4175d836326"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:48:29.563285 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.563231    2549 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/eae54ca1-97ab-46ef-94d6-d4175d836326-util\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:48:29.563285 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.563254    2549 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/eae54ca1-97ab-46ef-94d6-d4175d836326-bundle\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:48:29.563285 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:29.563263    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7trb\" (UniqueName: \"kubernetes.io/projected/eae54ca1-97ab-46ef-94d6-d4175d836326-kube-api-access-h7trb\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:48:30.307842 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:30.307807    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q"
Sep 16 12:48:30.307842 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:30.307821    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7mrd6q" event={"ID":"eae54ca1-97ab-46ef-94d6-d4175d836326","Type":"ContainerDied","Data":"3143c81e6ac3428b469c414caabe64e2eaec73ea4d7fd16c2d217e784fbd33c7"}
Sep 16 12:48:30.308242 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:30.307904    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3143c81e6ac3428b469c414caabe64e2eaec73ea4d7fd16c2d217e784fbd33c7"
Sep 16 12:48:32.942629 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:32.942598    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:35.341676 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:35.341644    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:35.821949 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:35.821916    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:36.821118 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:36.821088    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:36.916722 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:36.916688    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:38.179896 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:38.179865    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:38.342815 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:38.342784    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:39.609864 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.609828    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:39.900353 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900275    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"]
Sep 16 12:48:39.900588 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900575    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff" containerName="pull"
Sep 16 12:48:39.900636 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900590    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff" containerName="pull"
Sep 16 12:48:39.900636 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900607    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff" containerName="util"
Sep 16 12:48:39.900636 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900613    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff" containerName="util"
Sep 16 12:48:39.900636 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900621    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12aef8cc-c83b-484d-a765-eca240d5f2a5" containerName="pull"
Sep 16 12:48:39.900636 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900626    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="12aef8cc-c83b-484d-a765-eca240d5f2a5" containerName="pull"
Sep 16 12:48:39.900636 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900632    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4114faa-767b-4c52-8502-19bb86efbbbd" containerName="util"
Sep 16 12:48:39.900636 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900637    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4114faa-767b-4c52-8502-19bb86efbbbd" containerName="util"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900643    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eae54ca1-97ab-46ef-94d6-d4175d836326" containerName="extract"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900648    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="eae54ca1-97ab-46ef-94d6-d4175d836326" containerName="extract"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900654    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12aef8cc-c83b-484d-a765-eca240d5f2a5" containerName="extract"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900659    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="12aef8cc-c83b-484d-a765-eca240d5f2a5" containerName="extract"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900666    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12aef8cc-c83b-484d-a765-eca240d5f2a5" containerName="util"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900672    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="12aef8cc-c83b-484d-a765-eca240d5f2a5" containerName="util"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900677    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4114faa-767b-4c52-8502-19bb86efbbbd" containerName="extract"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900682    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4114faa-767b-4c52-8502-19bb86efbbbd" containerName="extract"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900689    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff" containerName="extract"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900693    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff" containerName="extract"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900702    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eae54ca1-97ab-46ef-94d6-d4175d836326" containerName="util"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900709    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="eae54ca1-97ab-46ef-94d6-d4175d836326" containerName="util"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900714    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4114faa-767b-4c52-8502-19bb86efbbbd" containerName="pull"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900719    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4114faa-767b-4c52-8502-19bb86efbbbd" containerName="pull"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900726    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eae54ca1-97ab-46ef-94d6-d4175d836326" containerName="pull"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900731    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="eae54ca1-97ab-46ef-94d6-d4175d836326" containerName="pull"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900777    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7af1d71-6fe5-4f1a-8a6b-55a0fb4173ff" containerName="extract"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900785    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4114faa-767b-4c52-8502-19bb86efbbbd" containerName="extract"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900792    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="12aef8cc-c83b-484d-a765-eca240d5f2a5" containerName="extract"
Sep 16 12:48:39.900866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.900797    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="eae54ca1-97ab-46ef-94d6-d4175d836326" containerName="extract"
Sep 16 12:48:39.903743 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.903727    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"
Sep 16 12:48:39.905895 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.905868    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 16 12:48:39.906060 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.906042    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-mdnd2\""
Sep 16 12:48:39.906143 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.906091    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 16 12:48:39.918086 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:39.918067    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"]
Sep 16 12:48:40.044785 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:40.044752    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z266\" (UniqueName: \"kubernetes.io/projected/814dd2bf-f06b-4793-bb8f-c9f2a5f846ef-kube-api-access-2z266\") pod \"limitador-operator-controller-manager-74495c69f8-vjh5w\" (UID: \"814dd2bf-f06b-4793-bb8f-c9f2a5f846ef\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"
Sep 16 12:48:40.145489 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:40.145455    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z266\" (UniqueName: \"kubernetes.io/projected/814dd2bf-f06b-4793-bb8f-c9f2a5f846ef-kube-api-access-2z266\") pod \"limitador-operator-controller-manager-74495c69f8-vjh5w\" (UID: \"814dd2bf-f06b-4793-bb8f-c9f2a5f846ef\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"
Sep 16 12:48:40.156910 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:40.156887    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z266\" (UniqueName: \"kubernetes.io/projected/814dd2bf-f06b-4793-bb8f-c9f2a5f846ef-kube-api-access-2z266\") pod \"limitador-operator-controller-manager-74495c69f8-vjh5w\" (UID: \"814dd2bf-f06b-4793-bb8f-c9f2a5f846ef\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"
Sep 16 12:48:40.213333 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:40.213307    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"
Sep 16 12:48:40.492514 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:40.492490    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"]
Sep 16 12:48:40.494030 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:48:40.494004    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod814dd2bf_f06b_4793_bb8f_c9f2a5f846ef.slice/crio-ee5f53311841b9b7dd733939a640c53342645a091c1aee337fe635eec33854a1 WatchSource:0}: Error finding container ee5f53311841b9b7dd733939a640c53342645a091c1aee337fe635eec33854a1: Status 404 returned error can't find the container with id ee5f53311841b9b7dd733939a640c53342645a091c1aee337fe635eec33854a1
Sep 16 12:48:40.548612 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:40.548587    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:40.630192 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:40.630131    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:40.717177 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:40.717136    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:40.939140 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:40.939107    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:41.045246 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:41.045187    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:41.342374 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:41.342282    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:41.363917 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:41.363884    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w" event={"ID":"814dd2bf-f06b-4793-bb8f-c9f2a5f846ef","Type":"ContainerStarted","Data":"ee5f53311841b9b7dd733939a640c53342645a091c1aee337fe635eec33854a1"}
Sep 16 12:48:41.442542 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:41.442507    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:43.377786 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:43.377750    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w" event={"ID":"814dd2bf-f06b-4793-bb8f-c9f2a5f846ef","Type":"ContainerStarted","Data":"2877fc32f001808abd9e6cd3e7d3dc9ea2f5c53ea89f6e22facb8b5b9487ea14"}
Sep 16 12:48:43.378184 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:43.377828    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"
Sep 16 12:48:43.383410 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:43.383385    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:43.400131 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:43.400083    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w" podStartSLOduration=2.089075186 podStartE2EDuration="4.400068834s" totalImagesPullingTime="2.310993648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:48:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:48:43.397572642 +0000 UTC m=+606.962393734" watchObservedRunningTime="2026-09-16 12:48:43.400068834 +0000 UTC m=+606.964889925"
Sep 16 12:48:46.365655 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:46.365611    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:46.468208 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:46.468156    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:51.589535 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:51.589501    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:51.944327 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:51.944289    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:52.116855 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:52.116819    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:52.382726 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:52.382635    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:52.490256 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:52.490217    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:53.982868 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:53.982827    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:54.085996 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:54.085959    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:54.385934 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:54.385851    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"
Sep 16 12:48:58.777088 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:58.777054    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:58.877131 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:58.877098    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:48:59.015494 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:48:59.015451    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:03.017219 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.017188    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"]
Sep 16 12:49:03.020631 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.020606    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"
Sep 16 12:49:03.023854 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.023833    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-hsr4g\""
Sep 16 12:49:03.038181 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.038156    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"]
Sep 16 12:49:03.041676 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.041655    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"]
Sep 16 12:49:03.041857 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.041827    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w" podUID="814dd2bf-f06b-4793-bb8f-c9f2a5f846ef" containerName="manager" containerID="cri-o://2877fc32f001808abd9e6cd3e7d3dc9ea2f5c53ea89f6e22facb8b5b9487ea14" gracePeriod=2
Sep 16 12:49:03.046172 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.046147    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"]
Sep 16 12:49:03.077130 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.077099    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr4zb"]
Sep 16 12:49:03.077462 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.077448    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="814dd2bf-f06b-4793-bb8f-c9f2a5f846ef" containerName="manager"
Sep 16 12:49:03.077519 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.077466    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="814dd2bf-f06b-4793-bb8f-c9f2a5f846ef" containerName="manager"
Sep 16 12:49:03.077560 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.077556    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="814dd2bf-f06b-4793-bb8f-c9f2a5f846ef" containerName="manager"
Sep 16 12:49:03.080426 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.080407    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr4zb"
Sep 16 12:49:03.087077 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:49:03.087048    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vjh5w\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="814dd2bf-f06b-4793-bb8f-c9f2a5f846ef" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"
Sep 16 12:49:03.095116 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.095093    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr4zb"]
Sep 16 12:49:03.123519 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.123499    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dae6b5ae-e403-4236-a92a-06e84cc7c29f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-wk84s\" (UID: \"dae6b5ae-e403-4236-a92a-06e84cc7c29f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"
Sep 16 12:49:03.123651 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.123539    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97vv7\" (UniqueName: \"kubernetes.io/projected/dae6b5ae-e403-4236-a92a-06e84cc7c29f-kube-api-access-97vv7\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-wk84s\" (UID: \"dae6b5ae-e403-4236-a92a-06e84cc7c29f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"
Sep 16 12:49:03.225020 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.224991    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsjjt\" (UniqueName: \"kubernetes.io/projected/ea450005-75b1-4de5-aa4e-649057dc229a-kube-api-access-fsjjt\") pod \"limitador-operator-controller-manager-74495c69f8-rr4zb\" (UID: \"ea450005-75b1-4de5-aa4e-649057dc229a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr4zb"
Sep 16 12:49:03.225136 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.225045    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dae6b5ae-e403-4236-a92a-06e84cc7c29f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-wk84s\" (UID: \"dae6b5ae-e403-4236-a92a-06e84cc7c29f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"
Sep 16 12:49:03.225136 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.225106    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97vv7\" (UniqueName: \"kubernetes.io/projected/dae6b5ae-e403-4236-a92a-06e84cc7c29f-kube-api-access-97vv7\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-wk84s\" (UID: \"dae6b5ae-e403-4236-a92a-06e84cc7c29f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"
Sep 16 12:49:03.225361 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.225344    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dae6b5ae-e403-4236-a92a-06e84cc7c29f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-wk84s\" (UID: \"dae6b5ae-e403-4236-a92a-06e84cc7c29f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"
Sep 16 12:49:03.233518 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.233494    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97vv7\" (UniqueName: \"kubernetes.io/projected/dae6b5ae-e403-4236-a92a-06e84cc7c29f-kube-api-access-97vv7\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-wk84s\" (UID: \"dae6b5ae-e403-4236-a92a-06e84cc7c29f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"
Sep 16 12:49:03.279840 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.279793    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"
Sep 16 12:49:03.282137 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:49:03.282110    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vjh5w\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="814dd2bf-f06b-4793-bb8f-c9f2a5f846ef" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"
Sep 16 12:49:03.325679 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.325659    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsjjt\" (UniqueName: \"kubernetes.io/projected/ea450005-75b1-4de5-aa4e-649057dc229a-kube-api-access-fsjjt\") pod \"limitador-operator-controller-manager-74495c69f8-rr4zb\" (UID: \"ea450005-75b1-4de5-aa4e-649057dc229a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr4zb"
Sep 16 12:49:03.330581 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.330562    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"
Sep 16 12:49:03.336588 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.336566    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsjjt\" (UniqueName: \"kubernetes.io/projected/ea450005-75b1-4de5-aa4e-649057dc229a-kube-api-access-fsjjt\") pod \"limitador-operator-controller-manager-74495c69f8-rr4zb\" (UID: \"ea450005-75b1-4de5-aa4e-649057dc229a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr4zb"
Sep 16 12:49:03.426904 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.426865    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z266\" (UniqueName: \"kubernetes.io/projected/814dd2bf-f06b-4793-bb8f-c9f2a5f846ef-kube-api-access-2z266\") pod \"814dd2bf-f06b-4793-bb8f-c9f2a5f846ef\" (UID: \"814dd2bf-f06b-4793-bb8f-c9f2a5f846ef\") "
Sep 16 12:49:03.429105 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.429081    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr4zb"
Sep 16 12:49:03.429212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.429111    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/814dd2bf-f06b-4793-bb8f-c9f2a5f846ef-kube-api-access-2z266" (OuterVolumeSpecName: "kube-api-access-2z266") pod "814dd2bf-f06b-4793-bb8f-c9f2a5f846ef" (UID: "814dd2bf-f06b-4793-bb8f-c9f2a5f846ef"). InnerVolumeSpecName "kube-api-access-2z266". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:49:03.475122 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.475081    2549 generic.go:356] "Generic (PLEG): container finished" podID="814dd2bf-f06b-4793-bb8f-c9f2a5f846ef" containerID="2877fc32f001808abd9e6cd3e7d3dc9ea2f5c53ea89f6e22facb8b5b9487ea14" exitCode=0
Sep 16 12:49:03.475269 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.475132    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"
Sep 16 12:49:03.475269 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.475161    2549 scope.go:117] "RemoveContainer" containerID="2877fc32f001808abd9e6cd3e7d3dc9ea2f5c53ea89f6e22facb8b5b9487ea14"
Sep 16 12:49:03.479337 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:49:03.478314    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vjh5w\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="814dd2bf-f06b-4793-bb8f-c9f2a5f846ef" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"
Sep 16 12:49:03.488244 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.488201    2549 scope.go:117] "RemoveContainer" containerID="2877fc32f001808abd9e6cd3e7d3dc9ea2f5c53ea89f6e22facb8b5b9487ea14"
Sep 16 12:49:03.488612 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:49:03.488590    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2877fc32f001808abd9e6cd3e7d3dc9ea2f5c53ea89f6e22facb8b5b9487ea14\": container with ID starting with 2877fc32f001808abd9e6cd3e7d3dc9ea2f5c53ea89f6e22facb8b5b9487ea14 not found: ID does not exist" containerID="2877fc32f001808abd9e6cd3e7d3dc9ea2f5c53ea89f6e22facb8b5b9487ea14"
Sep 16 12:49:03.488714 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.488617    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2877fc32f001808abd9e6cd3e7d3dc9ea2f5c53ea89f6e22facb8b5b9487ea14"} err="failed to get container status \"2877fc32f001808abd9e6cd3e7d3dc9ea2f5c53ea89f6e22facb8b5b9487ea14\": rpc error: code = NotFound desc = could not find container \"2877fc32f001808abd9e6cd3e7d3dc9ea2f5c53ea89f6e22facb8b5b9487ea14\": container with ID starting with 2877fc32f001808abd9e6cd3e7d3dc9ea2f5c53ea89f6e22facb8b5b9487ea14 not found: ID does not exist"
Sep 16 12:49:03.494409 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:49:03.494385    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vjh5w\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="814dd2bf-f06b-4793-bb8f-c9f2a5f846ef" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"
Sep 16 12:49:03.527808 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.527787    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z266\" (UniqueName: \"kubernetes.io/projected/814dd2bf-f06b-4793-bb8f-c9f2a5f846ef-kube-api-access-2z266\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:49:03.612049 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.611986    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"]
Sep 16 12:49:03.615368 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:49:03.615341    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae6b5ae_e403_4236_a92a_06e84cc7c29f.slice/crio-d4e9a928a725211201fe43bb4a29a83d2fedd117fc195b08684adf0288d59f1a WatchSource:0}: Error finding container d4e9a928a725211201fe43bb4a29a83d2fedd117fc195b08684adf0288d59f1a: Status 404 returned error can't find the container with id d4e9a928a725211201fe43bb4a29a83d2fedd117fc195b08684adf0288d59f1a
Sep 16 12:49:03.702633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:03.702604    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr4zb"]
Sep 16 12:49:03.704720 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:49:03.704696    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea450005_75b1_4de5_aa4e_649057dc229a.slice/crio-e72e9343cb82b58ee0724ab702062a925420d518d7a07930f12385791a55b426 WatchSource:0}: Error finding container e72e9343cb82b58ee0724ab702062a925420d518d7a07930f12385791a55b426: Status 404 returned error can't find the container with id e72e9343cb82b58ee0724ab702062a925420d518d7a07930f12385791a55b426
Sep 16 12:49:04.481751 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:04.481712    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s" event={"ID":"dae6b5ae-e403-4236-a92a-06e84cc7c29f","Type":"ContainerStarted","Data":"d4e9a928a725211201fe43bb4a29a83d2fedd117fc195b08684adf0288d59f1a"}
Sep 16 12:49:04.484295 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:04.484275    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr4zb" event={"ID":"ea450005-75b1-4de5-aa4e-649057dc229a","Type":"ContainerStarted","Data":"6d36d670f562bc38cb762ab25ab3fc238f64dd8edb79b9759ee3e4989aaa7a40"}
Sep 16 12:49:04.484390 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:04.484312    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr4zb" event={"ID":"ea450005-75b1-4de5-aa4e-649057dc229a","Type":"ContainerStarted","Data":"e72e9343cb82b58ee0724ab702062a925420d518d7a07930f12385791a55b426"}
Sep 16 12:49:04.484440 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:04.484424    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr4zb"
Sep 16 12:49:04.486340 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:49:04.486319    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vjh5w\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="814dd2bf-f06b-4793-bb8f-c9f2a5f846ef" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vjh5w"
Sep 16 12:49:04.511459 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:04.511409    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr4zb" podStartSLOduration=1.511397705 podStartE2EDuration="1.511397705s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:49:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:04.509432791 +0000 UTC m=+628.074253883" watchObservedRunningTime="2026-09-16 12:49:04.511397705 +0000 UTC m=+628.076218796"
Sep 16 12:49:04.921384 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:04.921351    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="814dd2bf-f06b-4793-bb8f-c9f2a5f846ef" path="/var/lib/kubelet/pods/814dd2bf-f06b-4793-bb8f-c9f2a5f846ef/volumes"
Sep 16 12:49:05.483788 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:05.483756    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:05.574103 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:05.574073    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:08.506191 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:08.506156    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s" event={"ID":"dae6b5ae-e403-4236-a92a-06e84cc7c29f","Type":"ContainerStarted","Data":"ca5a1dcc67f15ab2767f07e232378c1702fc01a495d9fcc45e3d2f9074ba3ced"}
Sep 16 12:49:08.506672 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:08.506220    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"
Sep 16 12:49:08.530871 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:08.530819    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s" podStartSLOduration=2.672823304 podStartE2EDuration="6.530803039s" totalImagesPullingTime="3.857979735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:49:08.528946818 +0000 UTC m=+632.093767909" watchObservedRunningTime="2026-09-16 12:49:08.530803039 +0000 UTC m=+632.095624130"
Sep 16 12:49:10.834897 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:10.834870    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:10.907552 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:10.907524    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:11.476541 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:11.476507    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:11.574995 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:11.574965    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:14.869194 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:14.869164    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:14.971756 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:14.971716    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:15.492362 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:15.492328    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-rr4zb"
Sep 16 12:49:18.834229 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:18.834198    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:18.897693 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:18.897658    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:19.068372 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:19.068337    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:19.155976 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:19.155954    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:19.251467 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:19.251442    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:19.375204 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:19.375174    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:19.513607 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:19.513538    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"
Sep 16 12:49:20.279029 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:20.279001    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:20.384341 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:20.384310    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:31.899013 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:31.898976    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"]
Sep 16 12:49:31.899453 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:31.899246    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s" podUID="dae6b5ae-e403-4236-a92a-06e84cc7c29f" containerName="manager" containerID="cri-o://ca5a1dcc67f15ab2767f07e232378c1702fc01a495d9fcc45e3d2f9074ba3ced" gracePeriod=10
Sep 16 12:49:32.150088 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.150038    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"
Sep 16 12:49:32.232539 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.232517    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97vv7\" (UniqueName: \"kubernetes.io/projected/dae6b5ae-e403-4236-a92a-06e84cc7c29f-kube-api-access-97vv7\") pod \"dae6b5ae-e403-4236-a92a-06e84cc7c29f\" (UID: \"dae6b5ae-e403-4236-a92a-06e84cc7c29f\") "
Sep 16 12:49:32.232648 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.232553    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dae6b5ae-e403-4236-a92a-06e84cc7c29f-extensions-socket-volume\") pod \"dae6b5ae-e403-4236-a92a-06e84cc7c29f\" (UID: \"dae6b5ae-e403-4236-a92a-06e84cc7c29f\") "
Sep 16 12:49:32.233049 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.233029    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dae6b5ae-e403-4236-a92a-06e84cc7c29f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dae6b5ae-e403-4236-a92a-06e84cc7c29f" (UID: "dae6b5ae-e403-4236-a92a-06e84cc7c29f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 12:49:32.234431 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.234413    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dae6b5ae-e403-4236-a92a-06e84cc7c29f-kube-api-access-97vv7" (OuterVolumeSpecName: "kube-api-access-97vv7") pod "dae6b5ae-e403-4236-a92a-06e84cc7c29f" (UID: "dae6b5ae-e403-4236-a92a-06e84cc7c29f"). InnerVolumeSpecName "kube-api-access-97vv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:49:32.333535 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.333514    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97vv7\" (UniqueName: \"kubernetes.io/projected/dae6b5ae-e403-4236-a92a-06e84cc7c29f-kube-api-access-97vv7\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:49:32.333535 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.333534    2549 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dae6b5ae-e403-4236-a92a-06e84cc7c29f-extensions-socket-volume\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:49:32.628857 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.628825    2549 generic.go:356] "Generic (PLEG): container finished" podID="dae6b5ae-e403-4236-a92a-06e84cc7c29f" containerID="ca5a1dcc67f15ab2767f07e232378c1702fc01a495d9fcc45e3d2f9074ba3ced" exitCode=0
Sep 16 12:49:32.629021 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.628871    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"
Sep 16 12:49:32.629021 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.628893    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s" event={"ID":"dae6b5ae-e403-4236-a92a-06e84cc7c29f","Type":"ContainerDied","Data":"ca5a1dcc67f15ab2767f07e232378c1702fc01a495d9fcc45e3d2f9074ba3ced"}
Sep 16 12:49:32.629021 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.628934    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s" event={"ID":"dae6b5ae-e403-4236-a92a-06e84cc7c29f","Type":"ContainerDied","Data":"d4e9a928a725211201fe43bb4a29a83d2fedd117fc195b08684adf0288d59f1a"}
Sep 16 12:49:32.629021 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.628955    2549 scope.go:117] "RemoveContainer" containerID="ca5a1dcc67f15ab2767f07e232378c1702fc01a495d9fcc45e3d2f9074ba3ced"
Sep 16 12:49:32.639138 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.639118    2549 scope.go:117] "RemoveContainer" containerID="ca5a1dcc67f15ab2767f07e232378c1702fc01a495d9fcc45e3d2f9074ba3ced"
Sep 16 12:49:32.639402 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:49:32.639385    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca5a1dcc67f15ab2767f07e232378c1702fc01a495d9fcc45e3d2f9074ba3ced\": container with ID starting with ca5a1dcc67f15ab2767f07e232378c1702fc01a495d9fcc45e3d2f9074ba3ced not found: ID does not exist" containerID="ca5a1dcc67f15ab2767f07e232378c1702fc01a495d9fcc45e3d2f9074ba3ced"
Sep 16 12:49:32.639446 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.639408    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca5a1dcc67f15ab2767f07e232378c1702fc01a495d9fcc45e3d2f9074ba3ced"} err="failed to get container status \"ca5a1dcc67f15ab2767f07e232378c1702fc01a495d9fcc45e3d2f9074ba3ced\": rpc error: code = NotFound desc = could not find container \"ca5a1dcc67f15ab2767f07e232378c1702fc01a495d9fcc45e3d2f9074ba3ced\": container with ID starting with ca5a1dcc67f15ab2767f07e232378c1702fc01a495d9fcc45e3d2f9074ba3ced not found: ID does not exist"
Sep 16 12:49:32.654801 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.654778    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"]
Sep 16 12:49:32.658738 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.658717    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-wk84s"]
Sep 16 12:49:32.920265 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:32.920222    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dae6b5ae-e403-4236-a92a-06e84cc7c29f" path="/var/lib/kubelet/pods/dae6b5ae-e403-4236-a92a-06e84cc7c29f/volumes"
Sep 16 12:49:35.150071 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:35.150046    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:36.118682 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:36.118649    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:36.284675 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:36.284643    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:52.764064 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.764029    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:52.764560 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.764206    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9llf7"]
Sep 16 12:49:52.764560 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.764511    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dae6b5ae-e403-4236-a92a-06e84cc7c29f" containerName="manager"
Sep 16 12:49:52.764560 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.764522    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="dae6b5ae-e403-4236-a92a-06e84cc7c29f" containerName="manager"
Sep 16 12:49:52.764679 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.764592    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="dae6b5ae-e403-4236-a92a-06e84cc7c29f" containerName="manager"
Sep 16 12:49:52.767414 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.767395    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-9llf7"
Sep 16 12:49:52.769757 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.769726    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 16 12:49:52.769875 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.769824    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-gpmpt\""
Sep 16 12:49:52.775711 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.775688    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9llf7"]
Sep 16 12:49:52.860785 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.860755    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9llf7"]
Sep 16 12:49:52.863544 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.863520    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:52.889785 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.889754    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsfjl\" (UniqueName: \"kubernetes.io/projected/b6a1513f-7615-471e-a2ff-54863492eb86-kube-api-access-rsfjl\") pod \"limitador-limitador-8588749977-9llf7\" (UID: \"b6a1513f-7615-471e-a2ff-54863492eb86\") " pod="kuadrant-system/limitador-limitador-8588749977-9llf7"
Sep 16 12:49:52.889907 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.889832    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6a1513f-7615-471e-a2ff-54863492eb86-config-file\") pod \"limitador-limitador-8588749977-9llf7\" (UID: \"b6a1513f-7615-471e-a2ff-54863492eb86\") " pod="kuadrant-system/limitador-limitador-8588749977-9llf7"
Sep 16 12:49:52.963996 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.963975    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:52.990244 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.990217    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6a1513f-7615-471e-a2ff-54863492eb86-config-file\") pod \"limitador-limitador-8588749977-9llf7\" (UID: \"b6a1513f-7615-471e-a2ff-54863492eb86\") " pod="kuadrant-system/limitador-limitador-8588749977-9llf7"
Sep 16 12:49:52.990348 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.990324    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsfjl\" (UniqueName: \"kubernetes.io/projected/b6a1513f-7615-471e-a2ff-54863492eb86-kube-api-access-rsfjl\") pod \"limitador-limitador-8588749977-9llf7\" (UID: \"b6a1513f-7615-471e-a2ff-54863492eb86\") " pod="kuadrant-system/limitador-limitador-8588749977-9llf7"
Sep 16 12:49:52.990916 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.990895    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6a1513f-7615-471e-a2ff-54863492eb86-config-file\") pod \"limitador-limitador-8588749977-9llf7\" (UID: \"b6a1513f-7615-471e-a2ff-54863492eb86\") " pod="kuadrant-system/limitador-limitador-8588749977-9llf7"
Sep 16 12:49:52.998443 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:52.998418    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsfjl\" (UniqueName: \"kubernetes.io/projected/b6a1513f-7615-471e-a2ff-54863492eb86-kube-api-access-rsfjl\") pod \"limitador-limitador-8588749977-9llf7\" (UID: \"b6a1513f-7615-471e-a2ff-54863492eb86\") " pod="kuadrant-system/limitador-limitador-8588749977-9llf7"
Sep 16 12:49:53.078004 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:53.077938    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-9llf7"
Sep 16 12:49:53.347674 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:53.347650    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9llf7"]
Sep 16 12:49:53.349997 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:49:53.349961    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a1513f_7615_471e_a2ff_54863492eb86.slice/crio-c90ac4d5ff8d192ad1b79b82745d666ef06fa75dbedf84f33b9ed28cf95d362e WatchSource:0}: Error finding container c90ac4d5ff8d192ad1b79b82745d666ef06fa75dbedf84f33b9ed28cf95d362e: Status 404 returned error can't find the container with id c90ac4d5ff8d192ad1b79b82745d666ef06fa75dbedf84f33b9ed28cf95d362e
Sep 16 12:49:53.614297 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:53.614217    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:53.693642 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:53.693612    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:49:53.730797 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:49:53.730764    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-9llf7" event={"ID":"b6a1513f-7615-471e-a2ff-54863492eb86","Type":"ContainerStarted","Data":"c90ac4d5ff8d192ad1b79b82745d666ef06fa75dbedf84f33b9ed28cf95d362e"}
Sep 16 12:50:06.418869 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:06.418836    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9llf7"]
Sep 16 12:50:09.708875 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:09.708837    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:09.799597 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:09.799562    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:10.209117 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.209083    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq"]
Sep 16 12:50:10.212780 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.212760    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq"
Sep 16 12:50:10.215263 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.215244    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 16 12:50:10.215389 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.215284    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 16 12:50:10.215389 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.215301    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 16 12:50:10.215912 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.215892    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7rdjc\""
Sep 16 12:50:10.220459 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.220437    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq"]
Sep 16 12:50:10.234972 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.234952    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:10.323370 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.323336    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cd49dc67-f74b-4404-ac8c-99ce7552af51-data\") pod \"postgres-69fb4594cf-4p6mq\" (UID: \"cd49dc67-f74b-4404-ac8c-99ce7552af51\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq"
Sep 16 12:50:10.323543 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.323383    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-554rz\" (UniqueName: \"kubernetes.io/projected/cd49dc67-f74b-4404-ac8c-99ce7552af51-kube-api-access-554rz\") pod \"postgres-69fb4594cf-4p6mq\" (UID: \"cd49dc67-f74b-4404-ac8c-99ce7552af51\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq"
Sep 16 12:50:10.423974 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.423942    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cd49dc67-f74b-4404-ac8c-99ce7552af51-data\") pod \"postgres-69fb4594cf-4p6mq\" (UID: \"cd49dc67-f74b-4404-ac8c-99ce7552af51\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq"
Sep 16 12:50:10.424103 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.423987    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-554rz\" (UniqueName: \"kubernetes.io/projected/cd49dc67-f74b-4404-ac8c-99ce7552af51-kube-api-access-554rz\") pod \"postgres-69fb4594cf-4p6mq\" (UID: \"cd49dc67-f74b-4404-ac8c-99ce7552af51\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq"
Sep 16 12:50:10.424323 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.424301    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/cd49dc67-f74b-4404-ac8c-99ce7552af51-data\") pod \"postgres-69fb4594cf-4p6mq\" (UID: \"cd49dc67-f74b-4404-ac8c-99ce7552af51\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq"
Sep 16 12:50:10.432365 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.432338    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-554rz\" (UniqueName: \"kubernetes.io/projected/cd49dc67-f74b-4404-ac8c-99ce7552af51-kube-api-access-554rz\") pod \"postgres-69fb4594cf-4p6mq\" (UID: \"cd49dc67-f74b-4404-ac8c-99ce7552af51\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq"
Sep 16 12:50:10.524852 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.524798    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq"
Sep 16 12:50:10.797441 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.797416    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq"]
Sep 16 12:50:10.799522 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:50:10.799491    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd49dc67_f74b_4404_ac8c_99ce7552af51.slice/crio-0ff80d8bbaa4fd07a203ee2559d9cf4723e10e3c5a75a3078ef0915bfaf4664f WatchSource:0}: Error finding container 0ff80d8bbaa4fd07a203ee2559d9cf4723e10e3c5a75a3078ef0915bfaf4664f: Status 404 returned error can't find the container with id 0ff80d8bbaa4fd07a203ee2559d9cf4723e10e3c5a75a3078ef0915bfaf4664f
Sep 16 12:50:10.812805 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:10.812780    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq" event={"ID":"cd49dc67-f74b-4404-ac8c-99ce7552af51","Type":"ContainerStarted","Data":"0ff80d8bbaa4fd07a203ee2559d9cf4723e10e3c5a75a3078ef0915bfaf4664f"}
Sep 16 12:50:15.845876 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:15.845848    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq" event={"ID":"cd49dc67-f74b-4404-ac8c-99ce7552af51","Type":"ContainerStarted","Data":"bcf1434d2c21bd77ada4d37462870ce6d7b466a23e749ebf48fdaa41e49b0c76"}
Sep 16 12:50:15.846217 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:15.845970    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq"
Sep 16 12:50:15.863505 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:15.863448    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq" podStartSLOduration=1.208082717 podStartE2EDuration="5.863433198s" totalImagesPullingTime="4.655350481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:50:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:50:15.862117406 +0000 UTC m=+699.426938524" watchObservedRunningTime="2026-09-16 12:50:15.863433198 +0000 UTC m=+699.428254595"
Sep 16 12:50:16.853442 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:16.853406    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-9llf7" event={"ID":"b6a1513f-7615-471e-a2ff-54863492eb86","Type":"ContainerStarted","Data":"fff9712af238c1844f142c99bee33a193675ed06405b7f171876b3659752f8d6"}
Sep 16 12:50:16.853914 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:16.853516    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-9llf7" podUID="b6a1513f-7615-471e-a2ff-54863492eb86" containerName="limitador" containerID="cri-o://fff9712af238c1844f142c99bee33a193675ed06405b7f171876b3659752f8d6" gracePeriod=30
Sep 16 12:50:16.853914 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:16.853743    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-9llf7"
Sep 16 12:50:16.876238 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:16.876198    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-9llf7" podStartSLOduration=2.394451484 podStartE2EDuration="24.87618336s" totalImagesPullingTime="22.481731876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:49:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:50:16.873740287 +0000 UTC m=+700.438561379" watchObservedRunningTime="2026-09-16 12:50:16.87618336 +0000 UTC m=+700.441004451"
Sep 16 12:50:17.392235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.392212    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-9llf7"
Sep 16 12:50:17.487769 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.487683    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rsfjl\" (UniqueName: \"kubernetes.io/projected/b6a1513f-7615-471e-a2ff-54863492eb86-kube-api-access-rsfjl\") pod \"b6a1513f-7615-471e-a2ff-54863492eb86\" (UID: \"b6a1513f-7615-471e-a2ff-54863492eb86\") "
Sep 16 12:50:17.487769 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.487766    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6a1513f-7615-471e-a2ff-54863492eb86-config-file\") pod \"b6a1513f-7615-471e-a2ff-54863492eb86\" (UID: \"b6a1513f-7615-471e-a2ff-54863492eb86\") "
Sep 16 12:50:17.488095 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.488070    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6a1513f-7615-471e-a2ff-54863492eb86-config-file" (OuterVolumeSpecName: "config-file") pod "b6a1513f-7615-471e-a2ff-54863492eb86" (UID: "b6a1513f-7615-471e-a2ff-54863492eb86"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:50:17.489628 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.489607    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6a1513f-7615-471e-a2ff-54863492eb86-kube-api-access-rsfjl" (OuterVolumeSpecName: "kube-api-access-rsfjl") pod "b6a1513f-7615-471e-a2ff-54863492eb86" (UID: "b6a1513f-7615-471e-a2ff-54863492eb86"). InnerVolumeSpecName "kube-api-access-rsfjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:50:17.588494 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.588454    2549 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b6a1513f-7615-471e-a2ff-54863492eb86-config-file\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:50:17.588627 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.588505    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rsfjl\" (UniqueName: \"kubernetes.io/projected/b6a1513f-7615-471e-a2ff-54863492eb86-kube-api-access-rsfjl\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:50:17.859385 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.859300    2549 generic.go:356] "Generic (PLEG): container finished" podID="b6a1513f-7615-471e-a2ff-54863492eb86" containerID="fff9712af238c1844f142c99bee33a193675ed06405b7f171876b3659752f8d6" exitCode=0
Sep 16 12:50:17.859385 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.859347    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-9llf7"
Sep 16 12:50:17.859871 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.859391    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-9llf7" event={"ID":"b6a1513f-7615-471e-a2ff-54863492eb86","Type":"ContainerDied","Data":"fff9712af238c1844f142c99bee33a193675ed06405b7f171876b3659752f8d6"}
Sep 16 12:50:17.859871 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.859440    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-9llf7" event={"ID":"b6a1513f-7615-471e-a2ff-54863492eb86","Type":"ContainerDied","Data":"c90ac4d5ff8d192ad1b79b82745d666ef06fa75dbedf84f33b9ed28cf95d362e"}
Sep 16 12:50:17.859871 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.859462    2549 scope.go:117] "RemoveContainer" containerID="fff9712af238c1844f142c99bee33a193675ed06405b7f171876b3659752f8d6"
Sep 16 12:50:17.868779 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.868762    2549 scope.go:117] "RemoveContainer" containerID="fff9712af238c1844f142c99bee33a193675ed06405b7f171876b3659752f8d6"
Sep 16 12:50:17.869029 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:50:17.869008    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fff9712af238c1844f142c99bee33a193675ed06405b7f171876b3659752f8d6\": container with ID starting with fff9712af238c1844f142c99bee33a193675ed06405b7f171876b3659752f8d6 not found: ID does not exist" containerID="fff9712af238c1844f142c99bee33a193675ed06405b7f171876b3659752f8d6"
Sep 16 12:50:17.869119 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.869035    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff9712af238c1844f142c99bee33a193675ed06405b7f171876b3659752f8d6"} err="failed to get container status \"fff9712af238c1844f142c99bee33a193675ed06405b7f171876b3659752f8d6\": rpc error: code = NotFound desc = could not find container \"fff9712af238c1844f142c99bee33a193675ed06405b7f171876b3659752f8d6\": container with ID starting with fff9712af238c1844f142c99bee33a193675ed06405b7f171876b3659752f8d6 not found: ID does not exist"
Sep 16 12:50:17.882518 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.882491    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9llf7"]
Sep 16 12:50:17.888165 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:17.888140    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9llf7"]
Sep 16 12:50:18.919303 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:18.919270    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6a1513f-7615-471e-a2ff-54863492eb86" path="/var/lib/kubelet/pods/b6a1513f-7615-471e-a2ff-54863492eb86/volumes"
Sep 16 12:50:19.975262 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:19.975226    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:21.881337 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:21.881309    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4p6mq"
Sep 16 12:50:22.274525 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:22.274469    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:22.453735 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:22.453702    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:30.247832 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.247749    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:30.280909 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.280874    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-698dc77dc5-bwtpd"]
Sep 16 12:50:30.281627 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.281606    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a1513f-7615-471e-a2ff-54863492eb86" containerName="limitador"
Sep 16 12:50:30.281627 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.281629    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a1513f-7615-471e-a2ff-54863492eb86" containerName="limitador"
Sep 16 12:50:30.281765 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.281725    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a1513f-7615-471e-a2ff-54863492eb86" containerName="limitador"
Sep 16 12:50:30.307538 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.307509    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-698dc77dc5-bwtpd"]
Sep 16 12:50:30.307676 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.307581    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:30.309940 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.309918    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 12:50:30.310058 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.309962    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 12:50:30.310058 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.309927    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-b764r\""
Sep 16 12:50:30.310514 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.310465    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 12:50:30.330375 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.330348    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:30.398137 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.398112    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:30.466691 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.466661    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:30.470840 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.470813    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-6fj4g"]
Sep 16 12:50:30.474201 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.474181    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 12:50:30.484552 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.484524    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzw9r\" (UniqueName: \"kubernetes.io/projected/1262edc9-7430-421f-b160-d00abac75a67-kube-api-access-wzw9r\") pod \"maas-controller-698dc77dc5-bwtpd\" (UID: \"1262edc9-7430-421f-b160-d00abac75a67\") " pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:30.484646 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.484568    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1262edc9-7430-421f-b160-d00abac75a67-webhook-cert\") pod \"maas-controller-698dc77dc5-bwtpd\" (UID: \"1262edc9-7430-421f-b160-d00abac75a67\") " pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:30.484646 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.484604    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1262edc9-7430-421f-b160-d00abac75a67-metrics-certs\") pod \"maas-controller-698dc77dc5-bwtpd\" (UID: \"1262edc9-7430-421f-b160-d00abac75a67\") " pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:30.485373 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.485356    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-6fj4g"]
Sep 16 12:50:30.585696 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.585627    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmf8s\" (UniqueName: \"kubernetes.io/projected/8e8cdd07-7962-4543-80c4-7ac33aeccc06-kube-api-access-jmf8s\") pod \"maas-controller-669f4b5bdf-6fj4g\" (UID: \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\") " pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 12:50:30.585805 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.585697    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e8cdd07-7962-4543-80c4-7ac33aeccc06-webhook-cert\") pod \"maas-controller-669f4b5bdf-6fj4g\" (UID: \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\") " pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 12:50:30.585805 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.585753    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzw9r\" (UniqueName: \"kubernetes.io/projected/1262edc9-7430-421f-b160-d00abac75a67-kube-api-access-wzw9r\") pod \"maas-controller-698dc77dc5-bwtpd\" (UID: \"1262edc9-7430-421f-b160-d00abac75a67\") " pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:30.585805 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.585772    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1262edc9-7430-421f-b160-d00abac75a67-webhook-cert\") pod \"maas-controller-698dc77dc5-bwtpd\" (UID: \"1262edc9-7430-421f-b160-d00abac75a67\") " pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:30.585805 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.585791    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e8cdd07-7962-4543-80c4-7ac33aeccc06-metrics-certs\") pod \"maas-controller-669f4b5bdf-6fj4g\" (UID: \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\") " pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 12:50:30.586011 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.585836    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1262edc9-7430-421f-b160-d00abac75a67-metrics-certs\") pod \"maas-controller-698dc77dc5-bwtpd\" (UID: \"1262edc9-7430-421f-b160-d00abac75a67\") " pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:30.588075 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.588054    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1262edc9-7430-421f-b160-d00abac75a67-metrics-certs\") pod \"maas-controller-698dc77dc5-bwtpd\" (UID: \"1262edc9-7430-421f-b160-d00abac75a67\") " pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:30.588202 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.588183    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1262edc9-7430-421f-b160-d00abac75a67-webhook-cert\") pod \"maas-controller-698dc77dc5-bwtpd\" (UID: \"1262edc9-7430-421f-b160-d00abac75a67\") " pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:30.593548 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.593529    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzw9r\" (UniqueName: \"kubernetes.io/projected/1262edc9-7430-421f-b160-d00abac75a67-kube-api-access-wzw9r\") pod \"maas-controller-698dc77dc5-bwtpd\" (UID: \"1262edc9-7430-421f-b160-d00abac75a67\") " pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:30.618147 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.618125    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:30.686989 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.686962    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e8cdd07-7962-4543-80c4-7ac33aeccc06-metrics-certs\") pod \"maas-controller-669f4b5bdf-6fj4g\" (UID: \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\") " pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 12:50:30.687150 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.687127    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmf8s\" (UniqueName: \"kubernetes.io/projected/8e8cdd07-7962-4543-80c4-7ac33aeccc06-kube-api-access-jmf8s\") pod \"maas-controller-669f4b5bdf-6fj4g\" (UID: \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\") " pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 12:50:30.687193 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.687179    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e8cdd07-7962-4543-80c4-7ac33aeccc06-webhook-cert\") pod \"maas-controller-669f4b5bdf-6fj4g\" (UID: \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\") " pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 12:50:30.689451 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.689400    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e8cdd07-7962-4543-80c4-7ac33aeccc06-metrics-certs\") pod \"maas-controller-669f4b5bdf-6fj4g\" (UID: \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\") " pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 12:50:30.689616 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.689596    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e8cdd07-7962-4543-80c4-7ac33aeccc06-webhook-cert\") pod \"maas-controller-669f4b5bdf-6fj4g\" (UID: \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\") " pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 12:50:30.694498 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.694457    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmf8s\" (UniqueName: \"kubernetes.io/projected/8e8cdd07-7962-4543-80c4-7ac33aeccc06-kube-api-access-jmf8s\") pod \"maas-controller-669f4b5bdf-6fj4g\" (UID: \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\") " pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 12:50:30.784619 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.784599    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 12:50:30.889434 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.889410    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-698dc77dc5-bwtpd"]
Sep 16 12:50:30.891312 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:50:30.891291    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1262edc9_7430_421f_b160_d00abac75a67.slice/crio-93b8aa3a52e14afe76015ecd199cbf650f820044f3b51572d535aa48491da0e7 WatchSource:0}: Error finding container 93b8aa3a52e14afe76015ecd199cbf650f820044f3b51572d535aa48491da0e7: Status 404 returned error can't find the container with id 93b8aa3a52e14afe76015ecd199cbf650f820044f3b51572d535aa48491da0e7
Sep 16 12:50:30.892968 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.892948    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 12:50:30.922586 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:30.922557    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698dc77dc5-bwtpd" event={"ID":"1262edc9-7430-421f-b160-d00abac75a67","Type":"ContainerStarted","Data":"93b8aa3a52e14afe76015ecd199cbf650f820044f3b51572d535aa48491da0e7"}
Sep 16 12:50:31.061857 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:31.059792    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-6fj4g"]
Sep 16 12:50:31.061857 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:50:31.061847    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e8cdd07_7962_4543_80c4_7ac33aeccc06.slice/crio-c6e3af5f96d22fc3e297b1aa43ee474a1babfb4fcf79973190f0291f5a3ae886 WatchSource:0}: Error finding container c6e3af5f96d22fc3e297b1aa43ee474a1babfb4fcf79973190f0291f5a3ae886: Status 404 returned error can't find the container with id c6e3af5f96d22fc3e297b1aa43ee474a1babfb4fcf79973190f0291f5a3ae886
Sep 16 12:50:31.933397 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:31.933359    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669f4b5bdf-6fj4g" event={"ID":"8e8cdd07-7962-4543-80c4-7ac33aeccc06","Type":"ContainerStarted","Data":"c6e3af5f96d22fc3e297b1aa43ee474a1babfb4fcf79973190f0291f5a3ae886"}
Sep 16 12:50:33.631549 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:33.631516    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:33.726167 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:33.726073    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:50:33.950695 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:33.950652    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669f4b5bdf-6fj4g" event={"ID":"8e8cdd07-7962-4543-80c4-7ac33aeccc06","Type":"ContainerStarted","Data":"3e9db67e805820c2e80d31f44575fbde28377cd3243b52381263bc9fc191ef6f"}
Sep 16 12:50:33.950862 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:33.950817    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 12:50:33.952161 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:33.952135    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698dc77dc5-bwtpd" event={"ID":"1262edc9-7430-421f-b160-d00abac75a67","Type":"ContainerStarted","Data":"fd3329512d5b7afd1e169b1962c27166346864d3401b2f20c4433ea303cb8b64"}
Sep 16 12:50:33.952278 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:33.952211    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:33.977076 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:33.976994    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-669f4b5bdf-6fj4g" podStartSLOduration=1.575053874 podStartE2EDuration="3.976978784s" totalImagesPullingTime="2.40192491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:50:33.975264881 +0000 UTC m=+717.540085984" watchObservedRunningTime="2026-09-16 12:50:33.976978784 +0000 UTC m=+717.541799874"
Sep 16 12:50:33.996355 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:33.996315    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-698dc77dc5-bwtpd" podStartSLOduration=1.430854994 podStartE2EDuration="3.996301436s" totalImagesPullingTime="2.565446442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:50:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:50:33.994042788 +0000 UTC m=+717.558863890" watchObservedRunningTime="2026-09-16 12:50:33.996301436 +0000 UTC m=+717.561122577"
Sep 16 12:50:44.959033 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:44.959000    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 12:50:44.959416 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:44.959174    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:45.026650 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:45.026617    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-698dc77dc5-bwtpd"]
Sep 16 12:50:45.026901 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:45.026864    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-698dc77dc5-bwtpd" podUID="1262edc9-7430-421f-b160-d00abac75a67" containerName="manager" containerID="cri-o://fd3329512d5b7afd1e169b1962c27166346864d3401b2f20c4433ea303cb8b64" gracePeriod=30
Sep 16 12:50:45.265166 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:45.265142    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:45.291321 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:45.291292    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzw9r\" (UniqueName: \"kubernetes.io/projected/1262edc9-7430-421f-b160-d00abac75a67-kube-api-access-wzw9r\") pod \"1262edc9-7430-421f-b160-d00abac75a67\" (UID: \"1262edc9-7430-421f-b160-d00abac75a67\") "
Sep 16 12:50:45.291435 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:45.291338    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1262edc9-7430-421f-b160-d00abac75a67-metrics-certs\") pod \"1262edc9-7430-421f-b160-d00abac75a67\" (UID: \"1262edc9-7430-421f-b160-d00abac75a67\") "
Sep 16 12:50:45.291435 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:45.291382    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1262edc9-7430-421f-b160-d00abac75a67-webhook-cert\") pod \"1262edc9-7430-421f-b160-d00abac75a67\" (UID: \"1262edc9-7430-421f-b160-d00abac75a67\") "
Sep 16 12:50:45.293679 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:45.293639    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1262edc9-7430-421f-b160-d00abac75a67-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1262edc9-7430-421f-b160-d00abac75a67" (UID: "1262edc9-7430-421f-b160-d00abac75a67"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:50:45.293797 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:45.293720    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1262edc9-7430-421f-b160-d00abac75a67-kube-api-access-wzw9r" (OuterVolumeSpecName: "kube-api-access-wzw9r") pod "1262edc9-7430-421f-b160-d00abac75a67" (UID: "1262edc9-7430-421f-b160-d00abac75a67"). InnerVolumeSpecName "kube-api-access-wzw9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:50:45.293852 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:45.293820    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1262edc9-7430-421f-b160-d00abac75a67-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1262edc9-7430-421f-b160-d00abac75a67" (UID: "1262edc9-7430-421f-b160-d00abac75a67"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:50:45.392364 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:45.392340    2549 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1262edc9-7430-421f-b160-d00abac75a67-metrics-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:50:45.392364 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:45.392363    2549 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1262edc9-7430-421f-b160-d00abac75a67-webhook-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:50:45.392554 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:45.392373    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzw9r\" (UniqueName: \"kubernetes.io/projected/1262edc9-7430-421f-b160-d00abac75a67-kube-api-access-wzw9r\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:50:46.011889 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:46.011854    2549 generic.go:356] "Generic (PLEG): container finished" podID="1262edc9-7430-421f-b160-d00abac75a67" containerID="fd3329512d5b7afd1e169b1962c27166346864d3401b2f20c4433ea303cb8b64" exitCode=0
Sep 16 12:50:46.012310 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:46.011893    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-698dc77dc5-bwtpd"
Sep 16 12:50:46.012310 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:46.011951    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698dc77dc5-bwtpd" event={"ID":"1262edc9-7430-421f-b160-d00abac75a67","Type":"ContainerDied","Data":"fd3329512d5b7afd1e169b1962c27166346864d3401b2f20c4433ea303cb8b64"}
Sep 16 12:50:46.012310 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:46.012015    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-698dc77dc5-bwtpd" event={"ID":"1262edc9-7430-421f-b160-d00abac75a67","Type":"ContainerDied","Data":"93b8aa3a52e14afe76015ecd199cbf650f820044f3b51572d535aa48491da0e7"}
Sep 16 12:50:46.012310 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:46.012052    2549 scope.go:117] "RemoveContainer" containerID="fd3329512d5b7afd1e169b1962c27166346864d3401b2f20c4433ea303cb8b64"
Sep 16 12:50:46.021335 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:46.021317    2549 scope.go:117] "RemoveContainer" containerID="fd3329512d5b7afd1e169b1962c27166346864d3401b2f20c4433ea303cb8b64"
Sep 16 12:50:46.021654 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:50:46.021623    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd3329512d5b7afd1e169b1962c27166346864d3401b2f20c4433ea303cb8b64\": container with ID starting with fd3329512d5b7afd1e169b1962c27166346864d3401b2f20c4433ea303cb8b64 not found: ID does not exist" containerID="fd3329512d5b7afd1e169b1962c27166346864d3401b2f20c4433ea303cb8b64"
Sep 16 12:50:46.021706 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:46.021664    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd3329512d5b7afd1e169b1962c27166346864d3401b2f20c4433ea303cb8b64"} err="failed to get container status \"fd3329512d5b7afd1e169b1962c27166346864d3401b2f20c4433ea303cb8b64\": rpc error: code = NotFound desc = could not find container \"fd3329512d5b7afd1e169b1962c27166346864d3401b2f20c4433ea303cb8b64\": container with ID starting with fd3329512d5b7afd1e169b1962c27166346864d3401b2f20c4433ea303cb8b64 not found: ID does not exist"
Sep 16 12:50:46.034488 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:46.034459    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-698dc77dc5-bwtpd"]
Sep 16 12:50:46.038848 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:46.038828    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-698dc77dc5-bwtpd"]
Sep 16 12:50:46.919329 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:50:46.919296    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1262edc9-7430-421f-b160-d00abac75a67" path="/var/lib/kubelet/pods/1262edc9-7430-421f-b160-d00abac75a67/volumes"
Sep 16 12:51:06.170756 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:06.170720    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:07.573810 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.573779    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:07.698157 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.698117    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"]
Sep 16 12:51:07.698636 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.698607    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1262edc9-7430-421f-b160-d00abac75a67" containerName="manager"
Sep 16 12:51:07.698636 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.698627    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="1262edc9-7430-421f-b160-d00abac75a67" containerName="manager"
Sep 16 12:51:07.698842 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.698711    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="1262edc9-7430-421f-b160-d00abac75a67" containerName="manager"
Sep 16 12:51:07.699014 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.698992    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:07.703472 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.703453    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:07.706115 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.706092    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 16 12:51:07.706256 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.706096    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 16 12:51:07.706256 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.706103    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nm49v\""
Sep 16 12:51:07.711592 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.711569    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"]
Sep 16 12:51:07.750727 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.750700    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d69af9a-61f8-4607-a29a-f0dfae863a92-openshift-service-ca\") pod \"maas-api-6d477c8649-bn45t\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") " pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:07.750868 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.750738    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d69af9a-61f8-4607-a29a-f0dfae863a92-metrics-certs\") pod \"maas-api-6d477c8649-bn45t\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") " pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:07.750868 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.750786    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d69af9a-61f8-4607-a29a-f0dfae863a92-maas-api-tls\") pod \"maas-api-6d477c8649-bn45t\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") " pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:07.750947 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.750871    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pdpg\" (UniqueName: \"kubernetes.io/projected/5d69af9a-61f8-4607-a29a-f0dfae863a92-kube-api-access-7pdpg\") pod \"maas-api-6d477c8649-bn45t\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") " pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:07.830883 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.830805    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:07.852049 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.852025    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d69af9a-61f8-4607-a29a-f0dfae863a92-metrics-certs\") pod \"maas-api-6d477c8649-bn45t\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") " pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:07.852184 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.852072    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d69af9a-61f8-4607-a29a-f0dfae863a92-maas-api-tls\") pod \"maas-api-6d477c8649-bn45t\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") " pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:07.852184 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.852099    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pdpg\" (UniqueName: \"kubernetes.io/projected/5d69af9a-61f8-4607-a29a-f0dfae863a92-kube-api-access-7pdpg\") pod \"maas-api-6d477c8649-bn45t\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") " pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:07.852184 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.852118    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d69af9a-61f8-4607-a29a-f0dfae863a92-openshift-service-ca\") pod \"maas-api-6d477c8649-bn45t\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") " pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:07.852836 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.852806    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d69af9a-61f8-4607-a29a-f0dfae863a92-openshift-service-ca\") pod \"maas-api-6d477c8649-bn45t\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") " pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:07.855122 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.855097    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d69af9a-61f8-4607-a29a-f0dfae863a92-maas-api-tls\") pod \"maas-api-6d477c8649-bn45t\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") " pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:07.855216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.855148    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d69af9a-61f8-4607-a29a-f0dfae863a92-metrics-certs\") pod \"maas-api-6d477c8649-bn45t\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") " pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:07.860312 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:07.860286    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pdpg\" (UniqueName: \"kubernetes.io/projected/5d69af9a-61f8-4607-a29a-f0dfae863a92-kube-api-access-7pdpg\") pod \"maas-api-6d477c8649-bn45t\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") " pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:08.017895 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.017693    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:08.149857 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.149771    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:08.259300 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.259268    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:08.315382 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.315352    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"]
Sep 16 12:51:08.316812 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:51:08.316786    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d69af9a_61f8_4607_a29a_f0dfae863a92.slice/crio-26192bac0dd5e00fd2f6da0fb7dd4a8f589fc8812a9a653d66f43b4409c6a2ae WatchSource:0}: Error finding container 26192bac0dd5e00fd2f6da0fb7dd4a8f589fc8812a9a653d66f43b4409c6a2ae: Status 404 returned error can't find the container with id 26192bac0dd5e00fd2f6da0fb7dd4a8f589fc8812a9a653d66f43b4409c6a2ae
Sep 16 12:51:08.324356 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.324330    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd"]
Sep 16 12:51:08.327136 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.327119    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd"
Sep 16 12:51:08.329666 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.329647    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 16 12:51:08.337854 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.337835    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd"]
Sep 16 12:51:08.356461 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.356429    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/619b0d74-890d-4627-8337-64acec84c753-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-hlmzd\" (UID: \"619b0d74-890d-4627-8337-64acec84c753\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd"
Sep 16 12:51:08.356616 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.356494    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmwn8\" (UniqueName: \"kubernetes.io/projected/619b0d74-890d-4627-8337-64acec84c753-kube-api-access-hmwn8\") pod \"payload-pre-processing-59fbc47bf8-hlmzd\" (UID: \"619b0d74-890d-4627-8337-64acec84c753\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd"
Sep 16 12:51:08.457468 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.457442    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/619b0d74-890d-4627-8337-64acec84c753-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-hlmzd\" (UID: \"619b0d74-890d-4627-8337-64acec84c753\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd"
Sep 16 12:51:08.457655 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.457506    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmwn8\" (UniqueName: \"kubernetes.io/projected/619b0d74-890d-4627-8337-64acec84c753-kube-api-access-hmwn8\") pod \"payload-pre-processing-59fbc47bf8-hlmzd\" (UID: \"619b0d74-890d-4627-8337-64acec84c753\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd"
Sep 16 12:51:08.458219 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.458195    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/619b0d74-890d-4627-8337-64acec84c753-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-hlmzd\" (UID: \"619b0d74-890d-4627-8337-64acec84c753\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd"
Sep 16 12:51:08.466115 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.466090    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k2d2c"]
Sep 16 12:51:08.468365 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.468351    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-k2d2c"
Sep 16 12:51:08.468445 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.468427    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmwn8\" (UniqueName: \"kubernetes.io/projected/619b0d74-890d-4627-8337-64acec84c753-kube-api-access-hmwn8\") pod \"payload-pre-processing-59fbc47bf8-hlmzd\" (UID: \"619b0d74-890d-4627-8337-64acec84c753\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd"
Sep 16 12:51:08.470709 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.470692    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vfmps\""
Sep 16 12:51:08.479749 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.479727    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k2d2c"]
Sep 16 12:51:08.558059 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.558019    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0444988-d22a-4a4e-ba47-111da27b871b-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-k2d2c\" (UID: \"e0444988-d22a-4a4e-ba47-111da27b871b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k2d2c"
Sep 16 12:51:08.558229 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.558185    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnprj\" (UniqueName: \"kubernetes.io/projected/e0444988-d22a-4a4e-ba47-111da27b871b-kube-api-access-tnprj\") pod \"payload-processing-5b54b7fbb7-k2d2c\" (UID: \"e0444988-d22a-4a4e-ba47-111da27b871b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k2d2c"
Sep 16 12:51:08.637461 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.637422    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd"
Sep 16 12:51:08.659249 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.659220    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnprj\" (UniqueName: \"kubernetes.io/projected/e0444988-d22a-4a4e-ba47-111da27b871b-kube-api-access-tnprj\") pod \"payload-processing-5b54b7fbb7-k2d2c\" (UID: \"e0444988-d22a-4a4e-ba47-111da27b871b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k2d2c"
Sep 16 12:51:08.659372 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.659270    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0444988-d22a-4a4e-ba47-111da27b871b-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-k2d2c\" (UID: \"e0444988-d22a-4a4e-ba47-111da27b871b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k2d2c"
Sep 16 12:51:08.659966 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.659945    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0444988-d22a-4a4e-ba47-111da27b871b-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-k2d2c\" (UID: \"e0444988-d22a-4a4e-ba47-111da27b871b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k2d2c"
Sep 16 12:51:08.670639 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.670614    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnprj\" (UniqueName: \"kubernetes.io/projected/e0444988-d22a-4a4e-ba47-111da27b871b-kube-api-access-tnprj\") pod \"payload-processing-5b54b7fbb7-k2d2c\" (UID: \"e0444988-d22a-4a4e-ba47-111da27b871b\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-k2d2c"
Sep 16 12:51:08.779955 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.779863    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-k2d2c"
Sep 16 12:51:08.920676 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:51:08.920644    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod619b0d74_890d_4627_8337_64acec84c753.slice/crio-66f0187d75960a02edc25f96e670c2ed3913d70498bc5f3d8214f0be26742b97 WatchSource:0}: Error finding container 66f0187d75960a02edc25f96e670c2ed3913d70498bc5f3d8214f0be26742b97: Status 404 returned error can't find the container with id 66f0187d75960a02edc25f96e670c2ed3913d70498bc5f3d8214f0be26742b97
Sep 16 12:51:08.922317 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:08.922298    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd"]
Sep 16 12:51:09.051924 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:09.051897    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-k2d2c"]
Sep 16 12:51:09.054137 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:51:09.054110    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0444988_d22a_4a4e_ba47_111da27b871b.slice/crio-253d243028bcebc9adf06b7a68d25af206872d85ef969469a049484699451210 WatchSource:0}: Error finding container 253d243028bcebc9adf06b7a68d25af206872d85ef969469a049484699451210: Status 404 returned error can't find the container with id 253d243028bcebc9adf06b7a68d25af206872d85ef969469a049484699451210
Sep 16 12:51:09.135546 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:09.135512    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd" event={"ID":"619b0d74-890d-4627-8337-64acec84c753","Type":"ContainerStarted","Data":"66f0187d75960a02edc25f96e670c2ed3913d70498bc5f3d8214f0be26742b97"}
Sep 16 12:51:09.136806 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:09.136779    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-k2d2c" event={"ID":"e0444988-d22a-4a4e-ba47-111da27b871b","Type":"ContainerStarted","Data":"253d243028bcebc9adf06b7a68d25af206872d85ef969469a049484699451210"}
Sep 16 12:51:09.137992 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:09.137972    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t" event={"ID":"5d69af9a-61f8-4607-a29a-f0dfae863a92","Type":"ContainerStarted","Data":"26192bac0dd5e00fd2f6da0fb7dd4a8f589fc8812a9a653d66f43b4409c6a2ae"}
Sep 16 12:51:11.152602 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:11.152524    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd" event={"ID":"619b0d74-890d-4627-8337-64acec84c753","Type":"ContainerStarted","Data":"91e9af3f4abab68da57c499ca47d0fe73bfbd52119d2cf7f6d5446da60d8e7f7"}
Sep 16 12:51:11.153050 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:11.152633    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd"
Sep 16 12:51:11.154416 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:11.154392    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-k2d2c" event={"ID":"e0444988-d22a-4a4e-ba47-111da27b871b","Type":"ContainerStarted","Data":"8ca76426b5a425d7d936bc75de005a370bf4aff1cd8ef8ff8c4417abf37b757e"}
Sep 16 12:51:11.154573 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:11.154444    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-k2d2c"
Sep 16 12:51:11.156261 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:11.156235    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t" event={"ID":"5d69af9a-61f8-4607-a29a-f0dfae863a92","Type":"ContainerStarted","Data":"2e98bdb06009f89b97c08f5e77980286e9e9c1cfb2783c0ad7d62fa6a2257e56"}
Sep 16 12:51:11.156378 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:11.156329    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:11.170832 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:11.170782    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd" podStartSLOduration=1.29928878 podStartE2EDuration="3.170762198s" totalImagesPullingTime="1.871473418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:51:11.170023002 +0000 UTC m=+754.734844093" watchObservedRunningTime="2026-09-16 12:51:11.170762198 +0000 UTC m=+754.735583302"
Sep 16 12:51:11.191760 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:11.191708    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t" podStartSLOduration=1.718511771 podStartE2EDuration="4.191690835s" totalImagesPullingTime="2.473179064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:51:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:51:11.187691532 +0000 UTC m=+754.752512622" watchObservedRunningTime="2026-09-16 12:51:11.191690835 +0000 UTC m=+754.756511928"
Sep 16 12:51:11.206247 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:11.206196    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-k2d2c" podStartSLOduration=1.471295458 podStartE2EDuration="3.206180797s" totalImagesPullingTime="1.734885339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:51:11.204353244 +0000 UTC m=+754.769174334" watchObservedRunningTime="2026-09-16 12:51:11.206180797 +0000 UTC m=+754.771001889"
Sep 16 12:51:11.735571 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:11.735536    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:11.789671 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:11.789643    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:17.166873 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:17.166845    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 12:51:18.150414 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:18.150377    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:18.248736 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:18.248704    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:22.163341 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:22.163288    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-k2d2c"
Sep 16 12:51:22.163755 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:22.163467    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-hlmzd"
Sep 16 12:51:30.574539 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:30.574508    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:35.367129 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:35.367092    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:52.262466 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.262431    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"]
Sep 16 12:51:52.268007 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.267985    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.271342 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.271318    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 16 12:51:52.271342 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.271360    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-q4h2f\""
Sep 16 12:51:52.271559 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.271362    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 16 12:51:52.271559 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.271432    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 16 12:51:52.279069 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.279046    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"]
Sep 16 12:51:52.283413 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.283395    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:51:52.408216 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.408179    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxwj9\" (UniqueName: \"kubernetes.io/projected/947dbb78-1634-42d7-ac14-01aefcfb8ef8-kube-api-access-fxwj9\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.408368 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.408240    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/947dbb78-1634-42d7-ac14-01aefcfb8ef8-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.408368 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.408315    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/947dbb78-1634-42d7-ac14-01aefcfb8ef8-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.408368 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.408343    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/947dbb78-1634-42d7-ac14-01aefcfb8ef8-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.408368 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.408363    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/947dbb78-1634-42d7-ac14-01aefcfb8ef8-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.408558 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.408380    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/947dbb78-1634-42d7-ac14-01aefcfb8ef8-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.508982 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.508951    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/947dbb78-1634-42d7-ac14-01aefcfb8ef8-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.508982 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.508983    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/947dbb78-1634-42d7-ac14-01aefcfb8ef8-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.509202 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.509002    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/947dbb78-1634-42d7-ac14-01aefcfb8ef8-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.509202 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.509134    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxwj9\" (UniqueName: \"kubernetes.io/projected/947dbb78-1634-42d7-ac14-01aefcfb8ef8-kube-api-access-fxwj9\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.509202 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.509197    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/947dbb78-1634-42d7-ac14-01aefcfb8ef8-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.509374 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.509273    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/947dbb78-1634-42d7-ac14-01aefcfb8ef8-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.509466 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.509445    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/947dbb78-1634-42d7-ac14-01aefcfb8ef8-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.509558 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.509522    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/947dbb78-1634-42d7-ac14-01aefcfb8ef8-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.509604 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.509566    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/947dbb78-1634-42d7-ac14-01aefcfb8ef8-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.511258 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.511224    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/947dbb78-1634-42d7-ac14-01aefcfb8ef8-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.511560 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.511543    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/947dbb78-1634-42d7-ac14-01aefcfb8ef8-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.517550 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.517496    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxwj9\" (UniqueName: \"kubernetes.io/projected/947dbb78-1634-42d7-ac14-01aefcfb8ef8-kube-api-access-fxwj9\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs\" (UID: \"947dbb78-1634-42d7-ac14-01aefcfb8ef8\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.578536 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.578515    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:51:52.870532 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:52.870502    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"]
Sep 16 12:51:52.871570 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:51:52.871543    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947dbb78_1634_42d7_ac14_01aefcfb8ef8.slice/crio-5bd3ca0d660c012708c086ab473de40eb064ebaafb832ed613f69f9939fe834c WatchSource:0}: Error finding container 5bd3ca0d660c012708c086ab473de40eb064ebaafb832ed613f69f9939fe834c: Status 404 returned error can't find the container with id 5bd3ca0d660c012708c086ab473de40eb064ebaafb832ed613f69f9939fe834c
Sep 16 12:51:53.364105 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:53.364045    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs" event={"ID":"947dbb78-1634-42d7-ac14-01aefcfb8ef8","Type":"ContainerStarted","Data":"5bd3ca0d660c012708c086ab473de40eb064ebaafb832ed613f69f9939fe834c"}
Sep 16 12:51:54.370686 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:54.370648    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs" event={"ID":"947dbb78-1634-42d7-ac14-01aefcfb8ef8","Type":"ContainerStarted","Data":"e82a70ace8d680bdfcf0ea332fd4d914cc812cdb1847177f71fb6a2bff33b6d4"}
Sep 16 12:51:54.391794 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:51:54.391743    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs" podStartSLOduration=1.4393356769999999 podStartE2EDuration="2.391727764s" totalImagesPullingTime="952.392087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:51:54.389120152 +0000 UTC m=+797.953941242" watchObservedRunningTime="2026-09-16 12:51:54.391727764 +0000 UTC m=+797.956548854"
Sep 16 12:52:02.579516 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:52:02.579407    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:52:02.579516 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:52:02.579499    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:52:02.592044 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:52:02.592026    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:52:03.432495 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:52:03.432448    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs"
Sep 16 12:52:10.883673 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:52:10.883630    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:52:21.504285 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:52:21.504254    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:52:36.437029 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:52:36.436992    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:52:36.502054 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:52:36.502015    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:52:38.977972 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:52:38.977940    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:52:47.704773 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:52:47.704735    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:52:55.513656 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:52:55.513616    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:52:55.588822 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:52:55.588790    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:53:12.392399 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:53:12.392366    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:08.225310 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:08.225278    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:15.142432 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:15.142398    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:15.241590 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:15.241560    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:16.256557 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:16.256517    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:16.354956 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:16.354874    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:38.287963 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.287925    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:38.387464 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.387434    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:38.492861 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.492826    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:38.667109 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.667070    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:38.754947 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.754911    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:38.792129 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.791377    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"]
Sep 16 12:54:38.796387 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.796363    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.798793 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.798772    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-586bab-openshift-default-dockercfg-zv7cs\""
Sep 16 12:54:38.805243 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.805220    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"]
Sep 16 12:54:38.826787 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.826764    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:38.835813 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.835783    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aae27201-47c6-4255-bdb9-c933273636db-istio-token\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.835923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.835824    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-istio-data\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.835923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.835846    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aae27201-47c6-4255-bdb9-c933273636db-istio-podinfo\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.835923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.835876    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mg8p\" (UniqueName: \"kubernetes.io/projected/aae27201-47c6-4255-bdb9-c933273636db-kube-api-access-8mg8p\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.835923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.835894    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-workload-socket\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.835923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.835913    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aae27201-47c6-4255-bdb9-c933273636db-istiod-ca-cert\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.836177 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.836032    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-credential-socket\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.836177 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.836115    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-workload-certs\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.836259 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.836176    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-istio-envoy\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.925177 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.925071    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:38.937217 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.937190    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-credential-socket\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.937444 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.937427    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-workload-certs\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.937596 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.937581    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-istio-envoy\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.937709 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.937686    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-credential-socket\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.937852 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.937817    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aae27201-47c6-4255-bdb9-c933273636db-istio-token\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.937852 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.937846    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-workload-certs\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.938036 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.937854    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-istio-data\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.938036 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.937903    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aae27201-47c6-4255-bdb9-c933273636db-istio-podinfo\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.938036 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.937948    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mg8p\" (UniqueName: \"kubernetes.io/projected/aae27201-47c6-4255-bdb9-c933273636db-kube-api-access-8mg8p\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.938036 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.937973    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-workload-socket\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.938036 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.937999    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aae27201-47c6-4255-bdb9-c933273636db-istiod-ca-cert\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.938391 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.938108    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-istio-data\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.938391 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.938343    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-workload-socket\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.938734 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.938705    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aae27201-47c6-4255-bdb9-c933273636db-istiod-ca-cert\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.940720 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.940696    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-istio-envoy\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.940841 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.940821    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aae27201-47c6-4255-bdb9-c933273636db-istio-podinfo\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.947369 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.947340    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aae27201-47c6-4255-bdb9-c933273636db-istio-token\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:38.947597 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:38.947576    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mg8p\" (UniqueName: \"kubernetes.io/projected/aae27201-47c6-4255-bdb9-c933273636db-kube-api-access-8mg8p\") pod \"e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") " pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:39.053721 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:39.053687    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:39.115890 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:39.115861    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:39.152690 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:39.152658    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:39.394334 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:39.394309    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"]
Sep 16 12:54:39.395969 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:54:39.395940    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae27201_47c6_4255_bdb9_c933273636db.slice/crio-eeb7b1e5c627ca5984e01a9f73fcc9894530d6c50dea00d0ab01d2baf0d2ceee WatchSource:0}: Error finding container eeb7b1e5c627ca5984e01a9f73fcc9894530d6c50dea00d0ab01d2baf0d2ceee: Status 404 returned error can't find the container with id eeb7b1e5c627ca5984e01a9f73fcc9894530d6c50dea00d0ab01d2baf0d2ceee
Sep 16 12:54:39.723438 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:39.723403    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:39.821561 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:39.821521    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:40.187816 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:40.187774    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:40.214087 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:40.214058    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" event={"ID":"aae27201-47c6-4255-bdb9-c933273636db","Type":"ContainerStarted","Data":"eeb7b1e5c627ca5984e01a9f73fcc9894530d6c50dea00d0ab01d2baf0d2ceee"}
Sep 16 12:54:41.424938 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:41.424868    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:41.543694 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:41.543661    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:41.631210 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:41.631173    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:42.606143 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.606106    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"]
Sep 16 12:54:42.610448 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.610428    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:42.610735 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.610692    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:54:42.610825 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.610764    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:54:42.610825 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.610794    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:54:42.613132 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.613055    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-7d0256-serving-cert\""
Sep 16 12:54:42.623204 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.623177    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"]
Sep 16 12:54:42.640528 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.640503    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:42.674198 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.674173    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-maas-api-tls\") pod \"maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:42.674301 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.674218    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-metrics-certs\") pod \"maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:42.674301 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.674251    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhhj8\" (UniqueName: \"kubernetes.io/projected/6212821b-473d-42b7-8bf5-b920f6cc7427-kube-api-access-zhhj8\") pod \"maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:42.674399 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.674375    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6212821b-473d-42b7-8bf5-b920f6cc7427-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:42.703638 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.703610    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:42.775257 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.775226    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-maas-api-tls\") pod \"maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:42.775513 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.775269    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-metrics-certs\") pod \"maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:42.775513 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.775303    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhhj8\" (UniqueName: \"kubernetes.io/projected/6212821b-473d-42b7-8bf5-b920f6cc7427-kube-api-access-zhhj8\") pod \"maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:42.775513 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:54:42.775389    2549 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-serving-cert: secret "maas-api-e2e-worker-w4-7d0256-serving-cert" not found
Sep 16 12:54:42.775513 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.775408    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6212821b-473d-42b7-8bf5-b920f6cc7427-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:42.775513 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:54:42.775467    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-maas-api-tls podName:6212821b-473d-42b7-8bf5-b920f6cc7427 nodeName:}" failed. No retries permitted until 2026-09-16 12:54:43.275444848 +0000 UTC m=+966.840265931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-maas-api-tls") pod "maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2" (UID: "6212821b-473d-42b7-8bf5-b920f6cc7427") : secret "maas-api-e2e-worker-w4-7d0256-serving-cert" not found
Sep 16 12:54:42.776129 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.776107    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6212821b-473d-42b7-8bf5-b920f6cc7427-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:42.777899 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.777876    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-metrics-certs\") pod \"maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:42.786161 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.786138    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhhj8\" (UniqueName: \"kubernetes.io/projected/6212821b-473d-42b7-8bf5-b920f6cc7427-kube-api-access-zhhj8\") pod \"maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:42.992186 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:42.992156    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:43.234666 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.234630    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" event={"ID":"aae27201-47c6-4255-bdb9-c933273636db","Type":"ContainerStarted","Data":"16daaafc011d9a1f1bb7bb635fc3c4532f9b64e05cb764df14c906235072d722"}
Sep 16 12:54:43.256605 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.256511    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" podStartSLOduration=2.044381809 podStartE2EDuration="5.256493267s" totalImagesPullingTime="3.212111458s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:54:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:54:43.2542292 +0000 UTC m=+966.819050292" watchObservedRunningTime="2026-09-16 12:54:43.256493267 +0000 UTC m=+966.821314358"
Sep 16 12:54:43.280103 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.280074    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-maas-api-tls\") pod \"maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:43.282546 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.282518    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-maas-api-tls\") pod \"maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:43.300819 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.300788    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:43.401163 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.401121    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"]
Sep 16 12:54:43.402720 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.402697    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:43.404868 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.404848    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"
Sep 16 12:54:43.406873 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.406853    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-7d0256\""
Sep 16 12:54:43.416232 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.416207    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"]
Sep 16 12:54:43.436517 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.436496    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"]
Sep 16 12:54:43.439926 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.439907    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"
Sep 16 12:54:43.442028 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.442012    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-7d0256-dockercfg-9h948\""
Sep 16 12:54:43.453210 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.453188    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"]
Sep 16 12:54:43.482489 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.482459    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/797ca2fd-20a5-4a75-b779-655605985b2c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd\" (UID: \"797ca2fd-20a5-4a75-b779-655605985b2c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"
Sep 16 12:54:43.482592 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.482511    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/897140a0-dccb-4a6c-9e18-45298edf10cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv\" (UID: \"897140a0-dccb-4a6c-9e18-45298edf10cf\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"
Sep 16 12:54:43.482592 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.482537    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx287\" (UniqueName: \"kubernetes.io/projected/897140a0-dccb-4a6c-9e18-45298edf10cf-kube-api-access-gx287\") pod \"payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv\" (UID: \"897140a0-dccb-4a6c-9e18-45298edf10cf\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"
Sep 16 12:54:43.482592 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.482571    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knsxv\" (UniqueName: \"kubernetes.io/projected/797ca2fd-20a5-4a75-b779-655605985b2c-kube-api-access-knsxv\") pod \"payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd\" (UID: \"797ca2fd-20a5-4a75-b779-655605985b2c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"
Sep 16 12:54:43.526432 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.526369    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:43.583725 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.583687    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knsxv\" (UniqueName: \"kubernetes.io/projected/797ca2fd-20a5-4a75-b779-655605985b2c-kube-api-access-knsxv\") pod \"payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd\" (UID: \"797ca2fd-20a5-4a75-b779-655605985b2c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"
Sep 16 12:54:43.583870 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.583814    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/797ca2fd-20a5-4a75-b779-655605985b2c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd\" (UID: \"797ca2fd-20a5-4a75-b779-655605985b2c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"
Sep 16 12:54:43.583870 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.583859    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/897140a0-dccb-4a6c-9e18-45298edf10cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv\" (UID: \"897140a0-dccb-4a6c-9e18-45298edf10cf\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"
Sep 16 12:54:43.583998 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.583890    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx287\" (UniqueName: \"kubernetes.io/projected/897140a0-dccb-4a6c-9e18-45298edf10cf-kube-api-access-gx287\") pod \"payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv\" (UID: \"897140a0-dccb-4a6c-9e18-45298edf10cf\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"
Sep 16 12:54:43.584948 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.584918    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/797ca2fd-20a5-4a75-b779-655605985b2c-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd\" (UID: \"797ca2fd-20a5-4a75-b779-655605985b2c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"
Sep 16 12:54:43.585088 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.584960    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/897140a0-dccb-4a6c-9e18-45298edf10cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv\" (UID: \"897140a0-dccb-4a6c-9e18-45298edf10cf\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"
Sep 16 12:54:43.592762 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.592464    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx287\" (UniqueName: \"kubernetes.io/projected/897140a0-dccb-4a6c-9e18-45298edf10cf-kube-api-access-gx287\") pod \"payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv\" (UID: \"897140a0-dccb-4a6c-9e18-45298edf10cf\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"
Sep 16 12:54:43.593120 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.593090    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knsxv\" (UniqueName: \"kubernetes.io/projected/797ca2fd-20a5-4a75-b779-655605985b2c-kube-api-access-knsxv\") pod \"payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd\" (UID: \"797ca2fd-20a5-4a75-b779-655605985b2c\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"
Sep 16 12:54:43.716129 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.716094    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"
Sep 16 12:54:43.748622 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.748591    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"
Sep 16 12:54:43.769109 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.769063    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:43.809250 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.809224    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"]
Sep 16 12:54:43.813334 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:54:43.812457    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6212821b_473d_42b7_8bf5_b920f6cc7427.slice/crio-509fd471460aa7bd98d05fa5f719ba9578faef1aae6f2daa352861a6a0f7cd50 WatchSource:0}: Error finding container 509fd471460aa7bd98d05fa5f719ba9578faef1aae6f2daa352861a6a0f7cd50: Status 404 returned error can't find the container with id 509fd471460aa7bd98d05fa5f719ba9578faef1aae6f2daa352861a6a0f7cd50
Sep 16 12:54:43.997000 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:54:43.996967    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod897140a0_dccb_4a6c_9e18_45298edf10cf.slice/crio-7ac7dad8e167ab591c518eeb8df8162b52cd0402521215143bda28d46f6280e8 WatchSource:0}: Error finding container 7ac7dad8e167ab591c518eeb8df8162b52cd0402521215143bda28d46f6280e8: Status 404 returned error can't find the container with id 7ac7dad8e167ab591c518eeb8df8162b52cd0402521215143bda28d46f6280e8
Sep 16 12:54:43.999602 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:43.999578    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"]
Sep 16 12:54:44.032687 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.032664    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"]
Sep 16 12:54:44.036343 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:54:44.036316    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod797ca2fd_20a5_4a75_b779_655605985b2c.slice/crio-6790af31ce7187dac4e33948eb6851468cd9657b989e7bc5992729ed067c562b WatchSource:0}: Error finding container 6790af31ce7187dac4e33948eb6851468cd9657b989e7bc5992729ed067c562b: Status 404 returned error can't find the container with id 6790af31ce7187dac4e33948eb6851468cd9657b989e7bc5992729ed067c562b
Sep 16 12:54:44.116365 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.116316    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:44.121580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.121555    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:44.244032 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.244003    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd" event={"ID":"797ca2fd-20a5-4a75-b779-655605985b2c","Type":"ContainerStarted","Data":"ec53d5c71557828eb598e94c4dcb0e52e736ffe0de82be353a6ad252281c603b"}
Sep 16 12:54:44.244165 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.244064    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd" event={"ID":"797ca2fd-20a5-4a75-b779-655605985b2c","Type":"ContainerStarted","Data":"6790af31ce7187dac4e33948eb6851468cd9657b989e7bc5992729ed067c562b"}
Sep 16 12:54:44.244165 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.244121    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"
Sep 16 12:54:44.246400 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.246345    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv" event={"ID":"897140a0-dccb-4a6c-9e18-45298edf10cf","Type":"ContainerStarted","Data":"ab889458af6bf586c35141e1bdb7ef4e00257b31ec298ad999dc81c1eef84396"}
Sep 16 12:54:44.246400 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.246397    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv" event={"ID":"897140a0-dccb-4a6c-9e18-45298edf10cf","Type":"ContainerStarted","Data":"7ac7dad8e167ab591c518eeb8df8162b52cd0402521215143bda28d46f6280e8"}
Sep 16 12:54:44.246592 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.246427    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"
Sep 16 12:54:44.248077 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.248024    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2" event={"ID":"6212821b-473d-42b7-8bf5-b920f6cc7427","Type":"ContainerStarted","Data":"509fd471460aa7bd98d05fa5f719ba9578faef1aae6f2daa352861a6a0f7cd50"}
Sep 16 12:54:44.248523 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.248503    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:44.249391 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.249370    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:54:44.263026 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.262980    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd" podStartSLOduration=1.262966571 podStartE2EDuration="1.262966571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:54:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:54:44.260574534 +0000 UTC m=+967.825395628" watchObservedRunningTime="2026-09-16 12:54:44.262966571 +0000 UTC m=+967.827787679"
Sep 16 12:54:44.296174 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.296108    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv" podStartSLOduration=1.296085702 podStartE2EDuration="1.296085702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:54:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:54:44.29485301 +0000 UTC m=+967.859674113" watchObservedRunningTime="2026-09-16 12:54:44.296085702 +0000 UTC m=+967.860906795"
Sep 16 12:54:44.712322 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.712287    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"]
Sep 16 12:54:44.716601 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.716577    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:44.720802 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.720772    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-490797-serving-cert\""
Sep 16 12:54:44.730449 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.730410    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"]
Sep 16 12:54:44.745451 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.745421    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:44.794885 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.794856    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c8021b-2482-4d7e-bf13-076091f52ff1-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:44.795012 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.794980    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1c8021b-2482-4d7e-bf13-076091f52ff1-metrics-certs\") pod \"maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:44.795062 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.795020    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c8021b-2482-4d7e-bf13-076091f52ff1-maas-api-tls\") pod \"maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:44.795062 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.795043    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8q9d\" (UniqueName: \"kubernetes.io/projected/b1c8021b-2482-4d7e-bf13-076091f52ff1-kube-api-access-p8q9d\") pod \"maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:44.806457 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.806430    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:44.896517 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.896472    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1c8021b-2482-4d7e-bf13-076091f52ff1-metrics-certs\") pod \"maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:44.896692 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.896530    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c8021b-2482-4d7e-bf13-076091f52ff1-maas-api-tls\") pod \"maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:44.896692 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.896554    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8q9d\" (UniqueName: \"kubernetes.io/projected/b1c8021b-2482-4d7e-bf13-076091f52ff1-kube-api-access-p8q9d\") pod \"maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:44.896692 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.896578    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c8021b-2482-4d7e-bf13-076091f52ff1-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:44.897272 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.897245    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c8021b-2482-4d7e-bf13-076091f52ff1-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:44.899059 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.899037    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1c8021b-2482-4d7e-bf13-076091f52ff1-metrics-certs\") pod \"maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:44.899193 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.899174    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c8021b-2482-4d7e-bf13-076091f52ff1-maas-api-tls\") pod \"maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:44.904839 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.904815    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8q9d\" (UniqueName: \"kubernetes.io/projected/b1c8021b-2482-4d7e-bf13-076091f52ff1-kube-api-access-p8q9d\") pod \"maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:44.904839 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:44.904859    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:45.034803 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:45.034717    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:45.258211 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:45.258138    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2" event={"ID":"6212821b-473d-42b7-8bf5-b920f6cc7427","Type":"ContainerStarted","Data":"bda44e087e317f65b1238297b2f22cd658855d80b2b56b5086a09cb4d5ad46f8"}
Sep 16 12:54:45.259023 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:45.258983    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:45.276566 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:45.276514    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2" podStartSLOduration=2.89716849 podStartE2EDuration="3.276494616s" totalImagesPullingTime="379.326126ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:54:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:54:45.274796634 +0000 UTC m=+968.839617726" watchObservedRunningTime="2026-09-16 12:54:45.276494616 +0000 UTC m=+968.841315703"
Sep 16 12:54:45.287663 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:45.287597    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:45.315374 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:45.315278    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"]
Sep 16 12:54:45.318029 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:54:45.318005    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c8021b_2482_4d7e_bf13_076091f52ff1.slice/crio-94e6e98adf77ffa0ddfe69daceb60e3fd05dde91746fcc4185d8887cafa795eb WatchSource:0}: Error finding container 94e6e98adf77ffa0ddfe69daceb60e3fd05dde91746fcc4185d8887cafa795eb: Status 404 returned error can't find the container with id 94e6e98adf77ffa0ddfe69daceb60e3fd05dde91746fcc4185d8887cafa795eb
Sep 16 12:54:45.366860 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:45.366835    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:45.449502 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:45.448094    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:45.511212 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:45.511162    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:45.959294 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:45.959266    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:46.264768 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.264675    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm" event={"ID":"b1c8021b-2482-4d7e-bf13-076091f52ff1","Type":"ContainerStarted","Data":"ccc83f0575d27e5d255bdc8eed601c912a7318d18ebfa42e5f017df22443d06c"}
Sep 16 12:54:46.264768 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.264738    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm" event={"ID":"b1c8021b-2482-4d7e-bf13-076091f52ff1","Type":"ContainerStarted","Data":"94e6e98adf77ffa0ddfe69daceb60e3fd05dde91746fcc4185d8887cafa795eb"}
Sep 16 12:54:46.264987 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.264940    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:46.283537 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.283466    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm" podStartSLOduration=1.962730494 podStartE2EDuration="2.283446195s" totalImagesPullingTime="320.715701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:54:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:54:46.282857544 +0000 UTC m=+969.847678629" watchObservedRunningTime="2026-09-16 12:54:46.283446195 +0000 UTC m=+969.848267287"
Sep 16 12:54:46.744728 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.744696    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"]
Sep 16 12:54:46.748729 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.748702    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:46.751045 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.751024    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-586bab-serving-cert\""
Sep 16 12:54:46.761952 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.761926    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"]
Sep 16 12:54:46.778520 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.778460    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:46.812912 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.812875    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-maas-api-tls\") pod \"maas-api-e2e-inf-a-586bab-5dbc849557-4688x\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:46.813061 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.812927    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a8343d-5f92-4c69-b2fa-d812b14f2216-openshift-service-ca\") pod \"maas-api-e2e-inf-a-586bab-5dbc849557-4688x\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:46.813061 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.812954    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-metrics-certs\") pod \"maas-api-e2e-inf-a-586bab-5dbc849557-4688x\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:46.813154 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.813057    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdw5b\" (UniqueName: \"kubernetes.io/projected/a3a8343d-5f92-4c69-b2fa-d812b14f2216-kube-api-access-tdw5b\") pod \"maas-api-e2e-inf-a-586bab-5dbc849557-4688x\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:46.878373 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.878339    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:46.913838 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.913801    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a8343d-5f92-4c69-b2fa-d812b14f2216-openshift-service-ca\") pod \"maas-api-e2e-inf-a-586bab-5dbc849557-4688x\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:46.913975 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.913844    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-metrics-certs\") pod \"maas-api-e2e-inf-a-586bab-5dbc849557-4688x\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:46.913975 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.913885    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdw5b\" (UniqueName: \"kubernetes.io/projected/a3a8343d-5f92-4c69-b2fa-d812b14f2216-kube-api-access-tdw5b\") pod \"maas-api-e2e-inf-a-586bab-5dbc849557-4688x\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:46.913975 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.913957    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-maas-api-tls\") pod \"maas-api-e2e-inf-a-586bab-5dbc849557-4688x\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:46.914156 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:54:46.914130    2549 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-serving-cert: secret "maas-api-e2e-inf-a-586bab-serving-cert" not found
Sep 16 12:54:46.914210 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:54:46.914200    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-maas-api-tls podName:a3a8343d-5f92-4c69-b2fa-d812b14f2216 nodeName:}" failed. No retries permitted until 2026-09-16 12:54:47.414180862 +0000 UTC m=+970.979001937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-maas-api-tls") pod "maas-api-e2e-inf-a-586bab-5dbc849557-4688x" (UID: "a3a8343d-5f92-4c69-b2fa-d812b14f2216") : secret "maas-api-e2e-inf-a-586bab-serving-cert" not found
Sep 16 12:54:46.914653 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.914632    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a8343d-5f92-4c69-b2fa-d812b14f2216-openshift-service-ca\") pod \"maas-api-e2e-inf-a-586bab-5dbc849557-4688x\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:46.916240 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.916209    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-metrics-certs\") pod \"maas-api-e2e-inf-a-586bab-5dbc849557-4688x\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:46.925235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:46.925212    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdw5b\" (UniqueName: \"kubernetes.io/projected/a3a8343d-5f92-4c69-b2fa-d812b14f2216-kube-api-access-tdw5b\") pod \"maas-api-e2e-inf-a-586bab-5dbc849557-4688x\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:47.110761 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.110648    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:47.371821 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.371710    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:47.419330 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.419300    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-maas-api-tls\") pod \"maas-api-e2e-inf-a-586bab-5dbc849557-4688x\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:47.421776 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.421751    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-maas-api-tls\") pod \"maas-api-e2e-inf-a-586bab-5dbc849557-4688x\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:47.473012 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.472972    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:47.478899 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.478871    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"]
Sep 16 12:54:47.482576 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.482557    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"
Sep 16 12:54:47.484931 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.484915    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-586bab\""
Sep 16 12:54:47.493768 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.493748    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"]
Sep 16 12:54:47.520813 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.520789    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b65c3ad3-e9a1-4118-8bc1-0ddb1188be20-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn\" (UID: \"b65c3ad3-e9a1-4118-8bc1-0ddb1188be20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"
Sep 16 12:54:47.520910 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.520827    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-528kp\" (UniqueName: \"kubernetes.io/projected/b65c3ad3-e9a1-4118-8bc1-0ddb1188be20-kube-api-access-528kp\") pod \"payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn\" (UID: \"b65c3ad3-e9a1-4118-8bc1-0ddb1188be20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"
Sep 16 12:54:47.621391 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.621359    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b65c3ad3-e9a1-4118-8bc1-0ddb1188be20-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn\" (UID: \"b65c3ad3-e9a1-4118-8bc1-0ddb1188be20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"
Sep 16 12:54:47.621580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.621405    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-528kp\" (UniqueName: \"kubernetes.io/projected/b65c3ad3-e9a1-4118-8bc1-0ddb1188be20-kube-api-access-528kp\") pod \"payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn\" (UID: \"b65c3ad3-e9a1-4118-8bc1-0ddb1188be20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"
Sep 16 12:54:47.622103 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.622056    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b65c3ad3-e9a1-4118-8bc1-0ddb1188be20-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn\" (UID: \"b65c3ad3-e9a1-4118-8bc1-0ddb1188be20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"
Sep 16 12:54:47.630043 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.630024    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-528kp\" (UniqueName: \"kubernetes.io/projected/b65c3ad3-e9a1-4118-8bc1-0ddb1188be20-kube-api-access-528kp\") pod \"payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn\" (UID: \"b65c3ad3-e9a1-4118-8bc1-0ddb1188be20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"
Sep 16 12:54:47.661929 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.661895    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:47.795546 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.795510    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"
Sep 16 12:54:47.840131 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.840096    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:47.944891 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.944868    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"]
Sep 16 12:54:47.947331 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:54:47.947306    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3a8343d_5f92_4c69_b2fa_d812b14f2216.slice/crio-08bc7a35232b3f88306632de41a8e0e40b0fb8d3e723f470f30ceebe0cccef13 WatchSource:0}: Error finding container 08bc7a35232b3f88306632de41a8e0e40b0fb8d3e723f470f30ceebe0cccef13: Status 404 returned error can't find the container with id 08bc7a35232b3f88306632de41a8e0e40b0fb8d3e723f470f30ceebe0cccef13
Sep 16 12:54:47.961145 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:47.961121    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:48.061935 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:48.061905    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:48.071700 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:48.071676    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"]
Sep 16 12:54:48.073640 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:54:48.073613    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb65c3ad3_e9a1_4118_8bc1_0ddb1188be20.slice/crio-00322132b06692027979c724070bb77b09a4e63d0af0d3407a935b35566a7429 WatchSource:0}: Error finding container 00322132b06692027979c724070bb77b09a4e63d0af0d3407a935b35566a7429: Status 404 returned error can't find the container with id 00322132b06692027979c724070bb77b09a4e63d0af0d3407a935b35566a7429
Sep 16 12:54:48.204606 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:48.204518    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:48.279110 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:48.278948    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x" event={"ID":"a3a8343d-5f92-4c69-b2fa-d812b14f2216","Type":"ContainerStarted","Data":"08bc7a35232b3f88306632de41a8e0e40b0fb8d3e723f470f30ceebe0cccef13"}
Sep 16 12:54:48.280773 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:48.280749    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn" event={"ID":"b65c3ad3-e9a1-4118-8bc1-0ddb1188be20","Type":"ContainerStarted","Data":"dd6faa2bab89b615e4184c8fd3446e2f212c8da300fd246211934b27daaa8973"}
Sep 16 12:54:48.280901 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:48.280803    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn" event={"ID":"b65c3ad3-e9a1-4118-8bc1-0ddb1188be20","Type":"ContainerStarted","Data":"00322132b06692027979c724070bb77b09a4e63d0af0d3407a935b35566a7429"}
Sep 16 12:54:48.281013 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:48.280993    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"
Sep 16 12:54:48.300364 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:48.300324    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn" podStartSLOduration=1.300309516 podStartE2EDuration="1.300309516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:54:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:54:48.298024878 +0000 UTC m=+971.862845970" watchObservedRunningTime="2026-09-16 12:54:48.300309516 +0000 UTC m=+971.865130607"
Sep 16 12:54:48.541576 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:48.541494    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:48.760857 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:48.760821    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:48.886299 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:48.886193    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:48.986825 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:48.986793    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:49.199393 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:49.199350    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:49.291247 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:49.291210    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x" event={"ID":"a3a8343d-5f92-4c69-b2fa-d812b14f2216","Type":"ContainerStarted","Data":"26addaa42adf13d29c38104f84ebcef4e352082928bc6d235519532d8e5b59fe"}
Sep 16 12:54:49.315312 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:49.315256    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x" podStartSLOduration=2.99034405 podStartE2EDuration="3.315239358s" totalImagesPullingTime="324.895308ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:54:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:54:49.313285504 +0000 UTC m=+972.878106594" watchObservedRunningTime="2026-09-16 12:54:49.315239358 +0000 UTC m=+972.880060445"
Sep 16 12:54:49.435248 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:49.435163    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:49.838954 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:49.838924    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:50.297127 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:50.297069    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:50.668714 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:50.668683    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:50.990542 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:50.990443    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:51.089957 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:51.089924    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:51.800224 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:51.800186    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:52.278724 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:52.278696    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 12:54:52.278904 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:52.278881    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 12:54:52.573196 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:52.573090    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:52.672309 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:52.672271    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:52.772643 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:52.772605    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:53.676390 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:53.676344    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:54.624114 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.624068    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"]
Sep 16 12:54:54.628405 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.628381    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:54.630491 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.630458    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-a24d8b-serving-cert\""
Sep 16 12:54:54.642774 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.642753    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"]
Sep 16 12:54:54.667509 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.667451    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:54.691633 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.691606    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbcz7\" (UniqueName: \"kubernetes.io/projected/7bd2560b-6dcc-433e-9236-16b9134e6f5c-kube-api-access-jbcz7\") pod \"maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:54.691926 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.691642    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-maas-api-tls\") pod \"maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:54.691926 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.691717    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bd2560b-6dcc-433e-9236-16b9134e6f5c-openshift-service-ca\") pod \"maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:54.691926 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.691802    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-metrics-certs\") pod \"maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:54.768357 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.768322    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:54.792615 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.792584    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-metrics-certs\") pod \"maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:54.792780 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.792686    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbcz7\" (UniqueName: \"kubernetes.io/projected/7bd2560b-6dcc-433e-9236-16b9134e6f5c-kube-api-access-jbcz7\") pod \"maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:54.792780 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.792718    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-maas-api-tls\") pod \"maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:54.792780 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.792751    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bd2560b-6dcc-433e-9236-16b9134e6f5c-openshift-service-ca\") pod \"maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:54.792952 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:54:54.792870    2549 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-serving-cert: secret "maas-api-e2e-autores-a24d8b-serving-cert" not found
Sep 16 12:54:54.792952 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:54:54.792940    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-maas-api-tls podName:7bd2560b-6dcc-433e-9236-16b9134e6f5c nodeName:}" failed. No retries permitted until 2026-09-16 12:54:55.292921641 +0000 UTC m=+978.857742732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-maas-api-tls") pod "maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd" (UID: "7bd2560b-6dcc-433e-9236-16b9134e6f5c") : secret "maas-api-e2e-autores-a24d8b-serving-cert" not found
Sep 16 12:54:54.793527 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.793501    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bd2560b-6dcc-433e-9236-16b9134e6f5c-openshift-service-ca\") pod \"maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:54.795413 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.795386    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-metrics-certs\") pod \"maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:54.802576 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:54.802549    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbcz7\" (UniqueName: \"kubernetes.io/projected/7bd2560b-6dcc-433e-9236-16b9134e6f5c-kube-api-access-jbcz7\") pod \"maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:55.036282 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:55.036239    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:55.260373 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:55.260345    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"
Sep 16 12:54:55.260890 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:55.260860    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"
Sep 16 12:54:55.297192 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:55.297107    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-maas-api-tls\") pod \"maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:55.299821 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:55.299796    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-maas-api-tls\") pod \"maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:55.400393 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:55.400350    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:55.505326 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:55.505299    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:55.542818 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:55.542745    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:55.822858 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:55.822829    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"]
Sep 16 12:54:55.824256 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:54:55.824222    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd2560b_6dcc_433e_9236_16b9134e6f5c.slice/crio-f94bcaf394db950508a7a3d45de06b3fdbda950e819c24ba1cad220e3922d72a WatchSource:0}: Error finding container f94bcaf394db950508a7a3d45de06b3fdbda950e819c24ba1cad220e3922d72a: Status 404 returned error can't find the container with id f94bcaf394db950508a7a3d45de06b3fdbda950e819c24ba1cad220e3922d72a
Sep 16 12:54:55.841093 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:55.841062    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:56.143333 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:56.143250    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:56.242626 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:56.242593    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:56.308582 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:56.308559    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 12:54:56.339065 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:56.339029    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd" event={"ID":"7bd2560b-6dcc-433e-9236-16b9134e6f5c","Type":"ContainerStarted","Data":"50061e10d91588a2e05a134a0ccfa0138189564f55034a8fd9be05686d11b86f"}
Sep 16 12:54:56.339228 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:56.339093    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd" event={"ID":"7bd2560b-6dcc-433e-9236-16b9134e6f5c","Type":"ContainerStarted","Data":"f94bcaf394db950508a7a3d45de06b3fdbda950e819c24ba1cad220e3922d72a"}
Sep 16 12:54:56.339301 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:56.339282    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:54:56.357026 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:56.356926    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd" podStartSLOduration=1.9394394080000001 podStartE2EDuration="2.356905768s" totalImagesPullingTime="417.46636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:54:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:54:56.356521761 +0000 UTC m=+979.921342853" watchObservedRunningTime="2026-09-16 12:54:56.356905768 +0000 UTC m=+979.921726859"
Sep 16 12:54:56.592944 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:56.592899    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:56.682095 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:56.682063    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:56.770313 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:56.770283    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:56.878168 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:56.878088    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:56.977765 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:56.977732    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:57.077825 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.077789    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:57.359801 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.359769    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:57.513441 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.513408    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:57.620415 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.620303    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:57.730421 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.730389    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"]
Sep 16 12:54:57.734194 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.734169    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"
Sep 16 12:54:57.742068 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.742048    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-79dbf9e9-dockercfg-t4wpp\""
Sep 16 12:54:57.742170 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.742093    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:57.746904 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.746886    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-79dbf9e9\""
Sep 16 12:54:57.770539 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.770511    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"]
Sep 16 12:54:57.821969 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.821937    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr4bn\" (UniqueName: \"kubernetes.io/projected/75845eb8-e010-4a65-9eac-bd366b2696b9-kube-api-access-kr4bn\") pod \"payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j\" (UID: \"75845eb8-e010-4a65-9eac-bd366b2696b9\") " pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"
Sep 16 12:54:57.822114 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.822039    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75845eb8-e010-4a65-9eac-bd366b2696b9-plugins-config-volume\") pod \"payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j\" (UID: \"75845eb8-e010-4a65-9eac-bd366b2696b9\") " pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"
Sep 16 12:54:57.860705 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.860671    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:57.922750 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.922721    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr4bn\" (UniqueName: \"kubernetes.io/projected/75845eb8-e010-4a65-9eac-bd366b2696b9-kube-api-access-kr4bn\") pod \"payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j\" (UID: \"75845eb8-e010-4a65-9eac-bd366b2696b9\") " pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"
Sep 16 12:54:57.923100 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.922777    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75845eb8-e010-4a65-9eac-bd366b2696b9-plugins-config-volume\") pod \"payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j\" (UID: \"75845eb8-e010-4a65-9eac-bd366b2696b9\") " pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"
Sep 16 12:54:57.923472 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.923452    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75845eb8-e010-4a65-9eac-bd366b2696b9-plugins-config-volume\") pod \"payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j\" (UID: \"75845eb8-e010-4a65-9eac-bd366b2696b9\") " pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"
Sep 16 12:54:57.934531 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:57.934502    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr4bn\" (UniqueName: \"kubernetes.io/projected/75845eb8-e010-4a65-9eac-bd366b2696b9-kube-api-access-kr4bn\") pod \"payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j\" (UID: \"75845eb8-e010-4a65-9eac-bd366b2696b9\") " pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"
Sep 16 12:54:58.022880 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:58.022849    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:58.044909 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:58.044881    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"
Sep 16 12:54:58.268584 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:58.268501    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:58.330256 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:58.330224    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"]
Sep 16 12:54:58.332059 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:54:58.332030    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75845eb8_e010_4a65_9eac_bd366b2696b9.slice/crio-a24b459d70924320482c145bf0dcaa340d66570b5828944367c7bb5dcbeeedb6 WatchSource:0}: Error finding container a24b459d70924320482c145bf0dcaa340d66570b5828944367c7bb5dcbeeedb6: Status 404 returned error can't find the container with id a24b459d70924320482c145bf0dcaa340d66570b5828944367c7bb5dcbeeedb6
Sep 16 12:54:58.351901 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:58.351864    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j" event={"ID":"75845eb8-e010-4a65-9eac-bd366b2696b9","Type":"ContainerStarted","Data":"a24b459d70924320482c145bf0dcaa340d66570b5828944367c7bb5dcbeeedb6"}
Sep 16 12:54:58.983119 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:58.983086    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:54:59.293750 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:59.293654    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"
Sep 16 12:54:59.359984 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:59.359952    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j" event={"ID":"75845eb8-e010-4a65-9eac-bd366b2696b9","Type":"ContainerStarted","Data":"cde9123b3d3394e6d9a75026dde2471958c89f07fbe5de9b09019c2f4446391a"}
Sep 16 12:54:59.360172 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:59.360039    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"
Sep 16 12:54:59.378090 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:59.378040    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j" podStartSLOduration=2.378024873 podStartE2EDuration="2.378024873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:54:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:54:59.375972185 +0000 UTC m=+982.940793279" watchObservedRunningTime="2026-09-16 12:54:59.378024873 +0000 UTC m=+982.942845964"
Sep 16 12:54:59.759982 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:54:59.759944    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:00.018129 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:00.018043    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:00.348792 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:00.348701    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:00.467535 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:00.467503    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:00.675236 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:00.675208    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:00.863671 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:00.863635    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:01.071461 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:01.071373    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:01.350424 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:01.350343    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:02.154344 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:02.154309    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:02.351305 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:02.351272    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:55:03.018109 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:03.018019    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:03.243282 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:03.243250    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:03.848302 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:03.848266    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:03.943261 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:03.943233    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:04.292309 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:04.292273    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:05.458179 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:05.458145    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:06.286452 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:06.286417    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:07.355650 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:07.355612    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:08.226232 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:08.226199    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:09.331429 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.331387    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"]
Sep 16 12:55:09.337758 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.337625    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:09.340036 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.340008    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-89d6bf-serving-cert\""
Sep 16 12:55:09.362559 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.362531    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"]
Sep 16 12:55:09.373330 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.372927    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:09.431973 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.431944    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-maas-api-tls\") pod \"maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:09.432131 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.431981    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c056e39-59b3-4324-8dfb-0dc41b30be30-openshift-service-ca\") pod \"maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:09.432131 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.432074    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-metrics-certs\") pod \"maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:09.432227 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.432130    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cd7q\" (UniqueName: \"kubernetes.io/projected/3c056e39-59b3-4324-8dfb-0dc41b30be30-kube-api-access-4cd7q\") pod \"maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:09.436663 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.436633    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:09.533048 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.533010    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-maas-api-tls\") pod \"maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:09.533048 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.533049    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c056e39-59b3-4324-8dfb-0dc41b30be30-openshift-service-ca\") pod \"maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:09.533261 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.533092    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-metrics-certs\") pod \"maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:09.533261 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.533137    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cd7q\" (UniqueName: \"kubernetes.io/projected/3c056e39-59b3-4324-8dfb-0dc41b30be30-kube-api-access-4cd7q\") pod \"maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:09.533261 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:55:09.533161    2549 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-serving-cert: secret "maas-api-e2e-inf-b-89d6bf-serving-cert" not found
Sep 16 12:55:09.533261 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:55:09.533239    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-maas-api-tls podName:3c056e39-59b3-4324-8dfb-0dc41b30be30 nodeName:}" failed. No retries permitted until 2026-09-16 12:55:10.033218147 +0000 UTC m=+993.598039235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-maas-api-tls") pod "maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj" (UID: "3c056e39-59b3-4324-8dfb-0dc41b30be30") : secret "maas-api-e2e-inf-b-89d6bf-serving-cert" not found
Sep 16 12:55:09.533778 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.533751    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c056e39-59b3-4324-8dfb-0dc41b30be30-openshift-service-ca\") pod \"maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:09.535565 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.535545    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-metrics-certs\") pod \"maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:09.544511 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.544445    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cd7q\" (UniqueName: \"kubernetes.io/projected/3c056e39-59b3-4324-8dfb-0dc41b30be30-kube-api-access-4cd7q\") pod \"maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:09.670743 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.670713    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:09.968559 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:09.968029    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:10.061026 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:10.060320    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-maas-api-tls\") pod \"maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:10.067156 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:10.067124    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:10.072751 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:10.072723    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-maas-api-tls\") pod \"maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:10.265562 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:10.265450    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:10.375099 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:10.374685    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"
Sep 16 12:55:10.470615 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:10.470580    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:10.571756 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:10.571133    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"]
Sep 16 12:55:10.574329 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:55:10.574293    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c056e39_59b3_4324_8dfb_0dc41b30be30.slice/crio-1513e9efe1118843bcb3dd1fb21ec85674fa5767f5c98f62bf0b07d9cc818170 WatchSource:0}: Error finding container 1513e9efe1118843bcb3dd1fb21ec85674fa5767f5c98f62bf0b07d9cc818170: Status 404 returned error can't find the container with id 1513e9efe1118843bcb3dd1fb21ec85674fa5767f5c98f62bf0b07d9cc818170
Sep 16 12:55:11.432572 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:11.432532    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj" event={"ID":"3c056e39-59b3-4324-8dfb-0dc41b30be30","Type":"ContainerStarted","Data":"0a73e944f2b566394a8cabfa10d70fcf3509672f7afdaad08d52525c5b72ffbd"}
Sep 16 12:55:11.433061 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:11.432601    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj" event={"ID":"3c056e39-59b3-4324-8dfb-0dc41b30be30","Type":"ContainerStarted","Data":"1513e9efe1118843bcb3dd1fb21ec85674fa5767f5c98f62bf0b07d9cc818170"}
Sep 16 12:55:11.433061 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:11.432672    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:11.437412 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:11.437369    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:11.452470 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:11.452425    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj" podStartSLOduration=2.050507248 podStartE2EDuration="2.452408226s" totalImagesPullingTime="401.900978ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:55:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:55:11.450304536 +0000 UTC m=+995.015125628" watchObservedRunningTime="2026-09-16 12:55:11.452408226 +0000 UTC m=+995.017229317"
Sep 16 12:55:12.266491 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:12.266431    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:12.412321 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:12.412285    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:12.965838 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:12.965811    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:13.839924 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:13.839891    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:14.306851 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:14.306511    2549 patch_prober.go:28] interesting pod/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:34348->10.134.0.44:15021: read: connection reset by peer" start-of-body=
Sep 16 12:55:14.306851 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:14.306584    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" podUID="aae27201-47c6-4255-bdb9-c933273636db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": read tcp 10.134.0.2:34348->10.134.0.44:15021: read: connection reset by peer"
Sep 16 12:55:14.453319 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:14.453287    2549 generic.go:356] "Generic (PLEG): container finished" podID="aae27201-47c6-4255-bdb9-c933273636db" containerID="16daaafc011d9a1f1bb7bb635fc3c4532f9b64e05cb764df14c906235072d722" exitCode=0
Sep 16 12:55:14.453510 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:14.453366    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" event={"ID":"aae27201-47c6-4255-bdb9-c933273636db","Type":"ContainerDied","Data":"16daaafc011d9a1f1bb7bb635fc3c4532f9b64e05cb764df14c906235072d722"}
Sep 16 12:55:14.453836 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:14.453817    2549 scope.go:117] "RemoveContainer" containerID="16daaafc011d9a1f1bb7bb635fc3c4532f9b64e05cb764df14c906235072d722"
Sep 16 12:55:14.454965 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:14.454937    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:55:14.455030 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:14.455005    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:55:14.455069 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:14.455042    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:55:14.594603 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:14.594528    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:15.416686 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:15.416653    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:15.460784 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:15.460754    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" event={"ID":"aae27201-47c6-4255-bdb9-c933273636db","Type":"ContainerStarted","Data":"4130e2f34e62b79f37fd1bd784223696690fd50ccbd635bc4812aa6dd66d6b9a"}
Sep 16 12:55:16.116557 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:16.116513    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:55:16.116731 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:16.116705    2549 patch_prober.go:28] interesting pod/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:55:16.116795 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:16.116773    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" podUID="aae27201-47c6-4255-bdb9-c933273636db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:55:16.254055 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:16.254009    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:17.117201 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:17.117169    2549 patch_prober.go:28] interesting pod/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:55:17.117632 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:17.117221    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" podUID="aae27201-47c6-4255-bdb9-c933273636db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:55:17.203625 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:17.203586    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:17.447724 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:17.447693    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 12:55:18.045854 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:18.045815    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:18.117223 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:18.117172    2549 patch_prober.go:28] interesting pod/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:55:18.117642 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:18.117268    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" podUID="aae27201-47c6-4255-bdb9-c933273636db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:55:19.043409 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:19.043376    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:19.117093 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:19.117053    2549 patch_prober.go:28] interesting pod/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:55:19.117255 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:19.117129    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" podUID="aae27201-47c6-4255-bdb9-c933273636db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:55:20.116601 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:20.116563    2549 patch_prober.go:28] interesting pod/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:55:20.116780 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:20.116619    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" podUID="aae27201-47c6-4255-bdb9-c933273636db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:55:21.116735 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:21.116698    2549 patch_prober.go:28] interesting pod/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 16 12:55:21.117146 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:21.116761    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" podUID="aae27201-47c6-4255-bdb9-c933273636db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 16 12:55:21.947423 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:21.947388    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:21.987065 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:21.987030    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"]
Sep 16 12:55:21.987516 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:21.987473    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j" podUID="75845eb8-e010-4a65-9eac-bd366b2696b9" containerName="payload-processing" containerID="cri-o://cde9123b3d3394e6d9a75026dde2471958c89f07fbe5de9b09019c2f4446391a" gracePeriod=30
Sep 16 12:55:22.045397 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.045367    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:22.120780 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.120752    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:55:22.121161 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.121140    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:55:22.121941 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.121920    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 12:55:22.146535 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.146467    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:22.246411 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.246372    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:22.255556 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.255521    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"
Sep 16 12:55:22.288739 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.288706    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75845eb8-e010-4a65-9eac-bd366b2696b9-plugins-config-volume\") pod \"75845eb8-e010-4a65-9eac-bd366b2696b9\" (UID: \"75845eb8-e010-4a65-9eac-bd366b2696b9\") "
Sep 16 12:55:22.288898 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.288783    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr4bn\" (UniqueName: \"kubernetes.io/projected/75845eb8-e010-4a65-9eac-bd366b2696b9-kube-api-access-kr4bn\") pod \"75845eb8-e010-4a65-9eac-bd366b2696b9\" (UID: \"75845eb8-e010-4a65-9eac-bd366b2696b9\") "
Sep 16 12:55:22.289079 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.289055    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75845eb8-e010-4a65-9eac-bd366b2696b9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "75845eb8-e010-4a65-9eac-bd366b2696b9" (UID: "75845eb8-e010-4a65-9eac-bd366b2696b9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:55:22.289169 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.289147    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75845eb8-e010-4a65-9eac-bd366b2696b9-plugins-config-volume\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:55:22.292631 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.292547    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75845eb8-e010-4a65-9eac-bd366b2696b9-kube-api-access-kr4bn" (OuterVolumeSpecName: "kube-api-access-kr4bn") pod "75845eb8-e010-4a65-9eac-bd366b2696b9" (UID: "75845eb8-e010-4a65-9eac-bd366b2696b9"). InnerVolumeSpecName "kube-api-access-kr4bn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:55:22.324237 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.324200    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:22.389824 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.389787    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr4bn\" (UniqueName: \"kubernetes.io/projected/75845eb8-e010-4a65-9eac-bd366b2696b9-kube-api-access-kr4bn\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:55:22.506954 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.506872    2549 generic.go:356] "Generic (PLEG): container finished" podID="75845eb8-e010-4a65-9eac-bd366b2696b9" containerID="cde9123b3d3394e6d9a75026dde2471958c89f07fbe5de9b09019c2f4446391a" exitCode=0
Sep 16 12:55:22.506954 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.506930    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"
Sep 16 12:55:22.506954 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.506937    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j" event={"ID":"75845eb8-e010-4a65-9eac-bd366b2696b9","Type":"ContainerDied","Data":"cde9123b3d3394e6d9a75026dde2471958c89f07fbe5de9b09019c2f4446391a"}
Sep 16 12:55:22.507302 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.507000    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j" event={"ID":"75845eb8-e010-4a65-9eac-bd366b2696b9","Type":"ContainerDied","Data":"a24b459d70924320482c145bf0dcaa340d66570b5828944367c7bb5dcbeeedb6"}
Sep 16 12:55:22.507302 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.507032    2549 scope.go:117] "RemoveContainer" containerID="cde9123b3d3394e6d9a75026dde2471958c89f07fbe5de9b09019c2f4446391a"
Sep 16 12:55:22.518664 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.518646    2549 scope.go:117] "RemoveContainer" containerID="cde9123b3d3394e6d9a75026dde2471958c89f07fbe5de9b09019c2f4446391a"
Sep 16 12:55:22.518887 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:55:22.518870    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cde9123b3d3394e6d9a75026dde2471958c89f07fbe5de9b09019c2f4446391a\": container with ID starting with cde9123b3d3394e6d9a75026dde2471958c89f07fbe5de9b09019c2f4446391a not found: ID does not exist" containerID="cde9123b3d3394e6d9a75026dde2471958c89f07fbe5de9b09019c2f4446391a"
Sep 16 12:55:22.518949 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.518892    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cde9123b3d3394e6d9a75026dde2471958c89f07fbe5de9b09019c2f4446391a"} err="failed to get container status \"cde9123b3d3394e6d9a75026dde2471958c89f07fbe5de9b09019c2f4446391a\": rpc error: code = NotFound desc = could not find container \"cde9123b3d3394e6d9a75026dde2471958c89f07fbe5de9b09019c2f4446391a\": container with ID starting with cde9123b3d3394e6d9a75026dde2471958c89f07fbe5de9b09019c2f4446391a not found: ID does not exist"
Sep 16 12:55:22.522218 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.522199    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:22.538906 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.538878    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"]
Sep 16 12:55:22.543715 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.543690    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-79dbf9e9-8f68b4b69-pnl4j"]
Sep 16 12:55:22.619242 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.619209    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:22.824335 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.824251    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:22.920584 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.920546    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75845eb8-e010-4a65-9eac-bd366b2696b9" path="/var/lib/kubelet/pods/75845eb8-e010-4a65-9eac-bd366b2696b9/volumes"
Sep 16 12:55:22.948945 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:22.948919    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:23.074053 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:23.074016    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:23.333861 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:23.333831    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:23.563247 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:23.563209    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:23.663396 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:23.663369    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:23.775406 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:23.775366    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:24.482149 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:24.482108    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:25.254157 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:25.254118    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:26.170156 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:26.170090    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:26.448276 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:26.448180    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:26.546700 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:26.546664    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:27.047795 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:27.047763    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:27.826967 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:27.826920    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:28.532813 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:28.532782    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:28.685234 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:28.685204    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:29.250973 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:29.250944    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:29.494290 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:29.494263    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:29.625576 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:29.625462    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:29.726332 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:29.726302    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:29.840766 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:29.840737    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:30.144128 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:30.144097    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:30.240721 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:30.240695    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:30.342007 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:30.341976    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:30.728250 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:30.728196    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:30.795536 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:30.795505    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:31.295751 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:31.295709    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:32.011305 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:32.011277    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:32.784563 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:32.784532    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:35.987711 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:35.987676    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:36.086379 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:36.086347    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:49.975607 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:49.975546    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:50.766544 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:50.766470    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:52.446400 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:52.446369    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:53.298385 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:53.298354    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:54.033495 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:54.033449    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:54.851550 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:54.851514    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:55.651845 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:55.651808    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:56.552881 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:56.552846    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:57.543855 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:57.543820    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:58.306012 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:58.305984    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:55:59.250357 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:55:59.250324    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:00.108620 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:00.108588    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:00.855769 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:00.855739    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:01.717942 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:01.717899    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:02.430798 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:02.430769    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:07.579901 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:07.579868    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:08.862903 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:08.862872    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:09.002879 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:09.002829    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:09.306427 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:09.306392    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:09.574707 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:09.574620    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:09.703608 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:09.703577    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:10.720797 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:10.720763    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:11.649470 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:11.649436    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:11.745624 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:11.745596    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:12.648240 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:12.648208    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:13.564103 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:13.564070    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:14.281670 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:14.281640    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:14.348740 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:14.348708    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:14.532937 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:14.532859    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:14.768854 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:14.768823    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:14.868843 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:14.868771    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:15.326749 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:15.326715    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:16.135806 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:16.135770    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:16.848838 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:16.848802    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:17.652533 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:17.652489    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:29.251981 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:29.251895    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:35.345848 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:35.345815    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:36.711310 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:36.711277    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:37.636256 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:37.636223    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:38.536490 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:38.536452    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:39.260436 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:39.260397    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:40.038524 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:40.038459    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:40.862310 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:40.862282    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:41.685995 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:41.685960    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:42.540046 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:42.540004    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:43.247664 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:43.247620    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:43.855939 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:43.855905    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:43.956166 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:43.956133    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:44.056355 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:44.056326    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:44.122917 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:44.122832    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:45.033829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:45.033786    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:45.248470 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:45.248426    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:45.680687 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:45.680656    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:45.971024 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:45.970934    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:46.055401 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:46.055352    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:46.425696 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:46.425646    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:46.739885 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:46.739814    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:47.634153 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:47.634114    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:48.554414 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:48.554381    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:48.772942 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:48.772911    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:48.871994 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:48.871913    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:49.439951 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:49.439923    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:50.546947 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:50.546907    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:51.059387 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:51.059355    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:51.327632 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:51.327547    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:52.156702 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:52.156673    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:52.968739 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:52.968707    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:53.766066 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:53.766036    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:53.826134 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:53.826098    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:53.927052 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:53.927022    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:54.246136 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.246104    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:54.327320 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.327286    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:56:54.393859 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.393825    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"]
Sep 16 12:56:54.394287 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.394274    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75845eb8-e010-4a65-9eac-bd366b2696b9" containerName="payload-processing"
Sep 16 12:56:54.394333 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.394290    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="75845eb8-e010-4a65-9eac-bd366b2696b9" containerName="payload-processing"
Sep 16 12:56:54.394376 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.394366    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="75845eb8-e010-4a65-9eac-bd366b2696b9" containerName="payload-processing"
Sep 16 12:56:54.396386 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.396370    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"
Sep 16 12:56:54.398802 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.398776    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-d0f5a035\""
Sep 16 12:56:54.399185 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.398836    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-d0f5a035-dockercfg-cbmq8\""
Sep 16 12:56:54.405718 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.405692    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"]
Sep 16 12:56:54.490794 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.490745    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e900e1f6-94f0-429b-87f3-1ac1b3684925-plugins-config-volume\") pod \"payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp\" (UID: \"e900e1f6-94f0-429b-87f3-1ac1b3684925\") " pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"
Sep 16 12:56:54.491254 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.491228    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crzpt\" (UniqueName: \"kubernetes.io/projected/e900e1f6-94f0-429b-87f3-1ac1b3684925-kube-api-access-crzpt\") pod \"payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp\" (UID: \"e900e1f6-94f0-429b-87f3-1ac1b3684925\") " pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"
Sep 16 12:56:54.592730 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.592640    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e900e1f6-94f0-429b-87f3-1ac1b3684925-plugins-config-volume\") pod \"payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp\" (UID: \"e900e1f6-94f0-429b-87f3-1ac1b3684925\") " pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"
Sep 16 12:56:54.592730 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.592716    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crzpt\" (UniqueName: \"kubernetes.io/projected/e900e1f6-94f0-429b-87f3-1ac1b3684925-kube-api-access-crzpt\") pod \"payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp\" (UID: \"e900e1f6-94f0-429b-87f3-1ac1b3684925\") " pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"
Sep 16 12:56:54.593330 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.593310    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e900e1f6-94f0-429b-87f3-1ac1b3684925-plugins-config-volume\") pod \"payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp\" (UID: \"e900e1f6-94f0-429b-87f3-1ac1b3684925\") " pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"
Sep 16 12:56:54.601268 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.601249    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crzpt\" (UniqueName: \"kubernetes.io/projected/e900e1f6-94f0-429b-87f3-1ac1b3684925-kube-api-access-crzpt\") pod \"payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp\" (UID: \"e900e1f6-94f0-429b-87f3-1ac1b3684925\") " pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"
Sep 16 12:56:54.708567 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.708531    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"
Sep 16 12:56:54.983360 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:54.983332    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"]
Sep 16 12:56:54.984519 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:56:54.984486    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode900e1f6_94f0_429b_87f3_1ac1b3684925.slice/crio-5730ed812b132f18d83e9f25ca11dd53fefa5d3d08e4c89b85b7d7dd0f88b095 WatchSource:0}: Error finding container 5730ed812b132f18d83e9f25ca11dd53fefa5d3d08e4c89b85b7d7dd0f88b095: Status 404 returned error can't find the container with id 5730ed812b132f18d83e9f25ca11dd53fefa5d3d08e4c89b85b7d7dd0f88b095
Sep 16 12:56:55.028330 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:55.028299    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp" event={"ID":"e900e1f6-94f0-429b-87f3-1ac1b3684925","Type":"ContainerStarted","Data":"5730ed812b132f18d83e9f25ca11dd53fefa5d3d08e4c89b85b7d7dd0f88b095"}
Sep 16 12:56:56.035662 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:56.035629    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp" event={"ID":"e900e1f6-94f0-429b-87f3-1ac1b3684925","Type":"ContainerStarted","Data":"e42290df76b252a14c774e2b98040dd367a55fe6a980b6bf59656bd19f61a3e0"}
Sep 16 12:56:56.036054 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:56.035686    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"
Sep 16 12:56:56.052384 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:56:56.052334    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp" podStartSLOduration=2.052319929 podStartE2EDuration="2.052319929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:56:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:56:56.052270104 +0000 UTC m=+1099.617091250" watchObservedRunningTime="2026-09-16 12:56:56.052319929 +0000 UTC m=+1099.617141019"
Sep 16 12:57:07.044079 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:07.044047    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"
Sep 16 12:57:13.774203 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:13.774167    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:16.098448 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:16.098413    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:17.221731 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:17.221690    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:17.931673 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:17.931640    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:18.755455 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:18.755417    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:19.673702 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:19.673671    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:20.328679 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:20.328648    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:21.104048 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:21.104014    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:21.851660 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:21.851628    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:22.843689 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:22.843655    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:23.561780 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:23.561742    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:24.454626 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:24.454589    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:30.196198 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:30.196155    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:30.876416 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:30.876389    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:30.949114 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:30.949077    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"]
Sep 16 12:57:30.949346 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:30.949319    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp" podUID="e900e1f6-94f0-429b-87f3-1ac1b3684925" containerName="payload-processing" containerID="cri-o://e42290df76b252a14c774e2b98040dd367a55fe6a980b6bf59656bd19f61a3e0" gracePeriod=30
Sep 16 12:57:30.993371 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:30.993343    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:31.095376 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.095344    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:31.197202 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.197178    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"
Sep 16 12:57:31.233974 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.233945    2549 generic.go:356] "Generic (PLEG): container finished" podID="e900e1f6-94f0-429b-87f3-1ac1b3684925" containerID="e42290df76b252a14c774e2b98040dd367a55fe6a980b6bf59656bd19f61a3e0" exitCode=0
Sep 16 12:57:31.234132 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.233986    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"
Sep 16 12:57:31.234132 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.234008    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp" event={"ID":"e900e1f6-94f0-429b-87f3-1ac1b3684925","Type":"ContainerDied","Data":"e42290df76b252a14c774e2b98040dd367a55fe6a980b6bf59656bd19f61a3e0"}
Sep 16 12:57:31.234132 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.234059    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp" event={"ID":"e900e1f6-94f0-429b-87f3-1ac1b3684925","Type":"ContainerDied","Data":"5730ed812b132f18d83e9f25ca11dd53fefa5d3d08e4c89b85b7d7dd0f88b095"}
Sep 16 12:57:31.234132 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.234085    2549 scope.go:117] "RemoveContainer" containerID="e42290df76b252a14c774e2b98040dd367a55fe6a980b6bf59656bd19f61a3e0"
Sep 16 12:57:31.244764 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.244746    2549 scope.go:117] "RemoveContainer" containerID="e42290df76b252a14c774e2b98040dd367a55fe6a980b6bf59656bd19f61a3e0"
Sep 16 12:57:31.245062 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:57:31.245046    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e42290df76b252a14c774e2b98040dd367a55fe6a980b6bf59656bd19f61a3e0\": container with ID starting with e42290df76b252a14c774e2b98040dd367a55fe6a980b6bf59656bd19f61a3e0 not found: ID does not exist" containerID="e42290df76b252a14c774e2b98040dd367a55fe6a980b6bf59656bd19f61a3e0"
Sep 16 12:57:31.245117 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.245072    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e42290df76b252a14c774e2b98040dd367a55fe6a980b6bf59656bd19f61a3e0"} err="failed to get container status \"e42290df76b252a14c774e2b98040dd367a55fe6a980b6bf59656bd19f61a3e0\": rpc error: code = NotFound desc = could not find container \"e42290df76b252a14c774e2b98040dd367a55fe6a980b6bf59656bd19f61a3e0\": container with ID starting with e42290df76b252a14c774e2b98040dd367a55fe6a980b6bf59656bd19f61a3e0 not found: ID does not exist"
Sep 16 12:57:31.252123 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.252096    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:31.283401 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.283378    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crzpt\" (UniqueName: \"kubernetes.io/projected/e900e1f6-94f0-429b-87f3-1ac1b3684925-kube-api-access-crzpt\") pod \"e900e1f6-94f0-429b-87f3-1ac1b3684925\" (UID: \"e900e1f6-94f0-429b-87f3-1ac1b3684925\") "
Sep 16 12:57:31.283543 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.283428    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e900e1f6-94f0-429b-87f3-1ac1b3684925-plugins-config-volume\") pod \"e900e1f6-94f0-429b-87f3-1ac1b3684925\" (UID: \"e900e1f6-94f0-429b-87f3-1ac1b3684925\") "
Sep 16 12:57:31.283819 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.283797    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e900e1f6-94f0-429b-87f3-1ac1b3684925-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e900e1f6-94f0-429b-87f3-1ac1b3684925" (UID: "e900e1f6-94f0-429b-87f3-1ac1b3684925"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:57:31.285563 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.285534    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e900e1f6-94f0-429b-87f3-1ac1b3684925-kube-api-access-crzpt" (OuterVolumeSpecName: "kube-api-access-crzpt") pod "e900e1f6-94f0-429b-87f3-1ac1b3684925" (UID: "e900e1f6-94f0-429b-87f3-1ac1b3684925"). InnerVolumeSpecName "kube-api-access-crzpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:57:31.315580 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.315550    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:31.384295 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.384243    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crzpt\" (UniqueName: \"kubernetes.io/projected/e900e1f6-94f0-429b-87f3-1ac1b3684925-kube-api-access-crzpt\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:57:31.384295 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.384284    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e900e1f6-94f0-429b-87f3-1ac1b3684925-plugins-config-volume\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:57:31.458576 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.458449    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:31.560629 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.560595    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"]
Sep 16 12:57:31.569402 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.569367    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d0f5a035-559b69fcd5-qctgp"]
Sep 16 12:57:31.746746 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:31.746657    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:32.179209 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:32.179182    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:32.268164 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:32.268131    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:32.368888 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:32.368850    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:32.772236 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:32.772199    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:32.920602 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:32.920575    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e900e1f6-94f0-429b-87f3-1ac1b3684925" path="/var/lib/kubelet/pods/e900e1f6-94f0-429b-87f3-1ac1b3684925/volumes"
Sep 16 12:57:33.545863 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:33.545831    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:33.815366 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:33.815281    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:34.282566 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:34.282535    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:35.159299 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:35.159267    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:35.927694 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:35.927661    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:37.567188 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:37.567155    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:39.997250 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:39.997221    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:40.101336 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:40.101302    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:40.198080 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:40.198046    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:40.298752 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:40.298672    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:40.732904 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:40.732870    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:47.749416 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:47.749381    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:48.639060 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:48.639025    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:49.468126 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:49.468089    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:50.279740 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:50.279709    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:51.148277 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:51.148247    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:51.882699 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:51.882671    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:51.950360 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:51.950329    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:52.855226 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:52.855191    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:57.902034 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:57.902001    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"]
Sep 16 12:57:57.902470 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:57.902222    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd" podUID="7bd2560b-6dcc-433e-9236-16b9134e6f5c" containerName="maas-api" containerID="cri-o://50061e10d91588a2e05a134a0ccfa0138189564f55034a8fd9be05686d11b86f" gracePeriod=30
Sep 16 12:57:57.949173 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:57.949141    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:58.048939 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.048898    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:58.149547 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.149514    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:58.151669 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.151646    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:57:58.248326 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.248289    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:58.321440 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.321408    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-metrics-certs\") pod \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") "
Sep 16 12:57:58.321645 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.321454    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bd2560b-6dcc-433e-9236-16b9134e6f5c-openshift-service-ca\") pod \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") "
Sep 16 12:57:58.321645 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.321540    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbcz7\" (UniqueName: \"kubernetes.io/projected/7bd2560b-6dcc-433e-9236-16b9134e6f5c-kube-api-access-jbcz7\") pod \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") "
Sep 16 12:57:58.321732 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.321666    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-maas-api-tls\") pod \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\" (UID: \"7bd2560b-6dcc-433e-9236-16b9134e6f5c\") "
Sep 16 12:57:58.321910 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.321886    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7bd2560b-6dcc-433e-9236-16b9134e6f5c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7bd2560b-6dcc-433e-9236-16b9134e6f5c" (UID: "7bd2560b-6dcc-433e-9236-16b9134e6f5c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 12:57:58.322069 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.322050    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7bd2560b-6dcc-433e-9236-16b9134e6f5c-openshift-service-ca\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:57:58.323937 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.323913    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7bd2560b-6dcc-433e-9236-16b9134e6f5c" (UID: "7bd2560b-6dcc-433e-9236-16b9134e6f5c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:57:58.324078 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.323932    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7bd2560b-6dcc-433e-9236-16b9134e6f5c" (UID: "7bd2560b-6dcc-433e-9236-16b9134e6f5c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 12:57:58.324078 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.323933    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bd2560b-6dcc-433e-9236-16b9134e6f5c-kube-api-access-jbcz7" (OuterVolumeSpecName: "kube-api-access-jbcz7") pod "7bd2560b-6dcc-433e-9236-16b9134e6f5c" (UID: "7bd2560b-6dcc-433e-9236-16b9134e6f5c"). InnerVolumeSpecName "kube-api-access-jbcz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 12:57:58.387373 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.387342    2549 generic.go:356] "Generic (PLEG): container finished" podID="7bd2560b-6dcc-433e-9236-16b9134e6f5c" containerID="50061e10d91588a2e05a134a0ccfa0138189564f55034a8fd9be05686d11b86f" exitCode=0
Sep 16 12:57:58.387556 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.387391    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"
Sep 16 12:57:58.387556 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.387425    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd" event={"ID":"7bd2560b-6dcc-433e-9236-16b9134e6f5c","Type":"ContainerDied","Data":"50061e10d91588a2e05a134a0ccfa0138189564f55034a8fd9be05686d11b86f"}
Sep 16 12:57:58.387556 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.387494    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd" event={"ID":"7bd2560b-6dcc-433e-9236-16b9134e6f5c","Type":"ContainerDied","Data":"f94bcaf394db950508a7a3d45de06b3fdbda950e819c24ba1cad220e3922d72a"}
Sep 16 12:57:58.387556 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.387499    2549 scope.go:117] "RemoveContainer" containerID="50061e10d91588a2e05a134a0ccfa0138189564f55034a8fd9be05686d11b86f"
Sep 16 12:57:58.400453 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.400435    2549 scope.go:117] "RemoveContainer" containerID="50061e10d91588a2e05a134a0ccfa0138189564f55034a8fd9be05686d11b86f"
Sep 16 12:57:58.400749 ip-10-0-128-195 kubenswrapper[2549]: E0916 12:57:58.400729    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50061e10d91588a2e05a134a0ccfa0138189564f55034a8fd9be05686d11b86f\": container with ID starting with 50061e10d91588a2e05a134a0ccfa0138189564f55034a8fd9be05686d11b86f not found: ID does not exist" containerID="50061e10d91588a2e05a134a0ccfa0138189564f55034a8fd9be05686d11b86f"
Sep 16 12:57:58.400820 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.400757    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50061e10d91588a2e05a134a0ccfa0138189564f55034a8fd9be05686d11b86f"} err="failed to get container status \"50061e10d91588a2e05a134a0ccfa0138189564f55034a8fd9be05686d11b86f\": rpc error: code = NotFound desc = could not find container \"50061e10d91588a2e05a134a0ccfa0138189564f55034a8fd9be05686d11b86f\": container with ID starting with 50061e10d91588a2e05a134a0ccfa0138189564f55034a8fd9be05686d11b86f not found: ID does not exist"
Sep 16 12:57:58.416657 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.416632    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"]
Sep 16 12:57:58.423308 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.423291    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbcz7\" (UniqueName: \"kubernetes.io/projected/7bd2560b-6dcc-433e-9236-16b9134e6f5c-kube-api-access-jbcz7\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:57:58.423370 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.423310    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-maas-api-tls\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:57:58.423370 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.423321    2549 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7bd2560b-6dcc-433e-9236-16b9134e6f5c-metrics-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 12:57:58.429367 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.429346    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-a24d8b-6cd5f65f46-kjxcd"]
Sep 16 12:57:58.549666 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.549586    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:58.651933 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.651901    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:57:58.920917 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:58.920884    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bd2560b-6dcc-433e-9236-16b9134e6f5c" path="/var/lib/kubelet/pods/7bd2560b-6dcc-433e-9236-16b9134e6f5c/volumes"
Sep 16 12:57:59.578721 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:57:59.578693    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:00.340400 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:00.340367    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:01.049311 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:01.049277    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:01.943875 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:01.943846    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:03.650746 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:03.650716    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:06.636388 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:06.636359    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:10.255701 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:10.255667    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:10.523760 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:10.523676    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:11.019409 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.019380    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:11.118078 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.118049    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:11.327754 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.327678    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"]
Sep 16 12:58:11.328103 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.328085    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bd2560b-6dcc-433e-9236-16b9134e6f5c" containerName="maas-api"
Sep 16 12:58:11.328103 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.328096    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bd2560b-6dcc-433e-9236-16b9134e6f5c" containerName="maas-api"
Sep 16 12:58:11.328183 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.328118    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e900e1f6-94f0-429b-87f3-1ac1b3684925" containerName="payload-processing"
Sep 16 12:58:11.328183 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.328124    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="e900e1f6-94f0-429b-87f3-1ac1b3684925" containerName="payload-processing"
Sep 16 12:58:11.328262 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.328185    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bd2560b-6dcc-433e-9236-16b9134e6f5c" containerName="maas-api"
Sep 16 12:58:11.328262 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.328198    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="e900e1f6-94f0-429b-87f3-1ac1b3684925" containerName="payload-processing"
Sep 16 12:58:11.331172 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.331155    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.335609 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.335574    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-envoy\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.335609 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.335607    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istiod-ca-cert\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.335796 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.335628    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-token\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.335796 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.335658    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-podinfo\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.335796 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.335714    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-workload-socket\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.335796 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.335733    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-workload-certs\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.335796 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.335767    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tptdn\" (UniqueName: \"kubernetes.io/projected/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-kube-api-access-tptdn\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.335796 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.335783    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-data\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.336123 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.335823    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-credential-socket\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.336309 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.336295    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-7087d2-openshift-default-dockercfg-g86z5\""
Sep 16 12:58:11.357799 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.357767    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"]
Sep 16 12:58:11.358884 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.358858    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:11.436506 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.436444    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-podinfo\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.436697 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.436521    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-workload-socket\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.436697 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.436550    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-workload-certs\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.436697 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.436639    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tptdn\" (UniqueName: \"kubernetes.io/projected/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-kube-api-access-tptdn\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.436697 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.436685    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-data\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.436930 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.436775    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-credential-socket\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.436930 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.436811    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-envoy\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.436930 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.436840    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istiod-ca-cert\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.436930 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.436876    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-token\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.437170 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.437144    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-data\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.437407 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.437380    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-credential-socket\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.437714 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.437464    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-workload-socket\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.437714 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.437540    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-workload-certs\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.437929 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.437712    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istiod-ca-cert\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.439441 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.439422    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-envoy\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.439669 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.439651    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-podinfo\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.464637 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.464619    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tptdn\" (UniqueName: \"kubernetes.io/projected/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-kube-api-access-tptdn\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.466209 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.466188    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-token\") pod \"e2e-explicit-7087d2-openshift-default-778677f888-cdk2v\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") " pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.641419 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.641329    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:11.929501 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.929458    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"]
Sep 16 12:58:11.931522 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:58:11.931493    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4004965c_9b7c_4570_abe5_1ffb8a5cdb9c.slice/crio-7e3cf343d8654ead75db693e708fcd8a12f769597a2b233334f34d8e8fbc2759 WatchSource:0}: Error finding container 7e3cf343d8654ead75db693e708fcd8a12f769597a2b233334f34d8e8fbc2759: Status 404 returned error can't find the container with id 7e3cf343d8654ead75db693e708fcd8a12f769597a2b233334f34d8e8fbc2759
Sep 16 12:58:11.933880 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.933838    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:58:11.933955 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.933926    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:58:11.933994 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:11.933964    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:58:12.063964 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:12.063928    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:12.471304 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:12.471266    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v" event={"ID":"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c","Type":"ContainerStarted","Data":"3d935ebbbb724b0b51acf8601a8e65d7e6da2d629a381667ba5402b201807972"}
Sep 16 12:58:12.471739 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:12.471323    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v" event={"ID":"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c","Type":"ContainerStarted","Data":"7e3cf343d8654ead75db693e708fcd8a12f769597a2b233334f34d8e8fbc2759"}
Sep 16 12:58:12.493253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:12.493199    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v" podStartSLOduration=1.493185473 podStartE2EDuration="1.493185473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:58:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:58:12.490773444 +0000 UTC m=+1176.055594546" watchObservedRunningTime="2026-09-16 12:58:12.493185473 +0000 UTC m=+1176.058006630"
Sep 16 12:58:12.641842 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:12.641806    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:12.643349 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:12.643327    2549 patch_prober.go:28] interesting pod/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 12:58:12.643416 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:12.643387    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v" podUID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 12:58:13.282923 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:13.282893    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:13.385414 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:13.385376    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:13.483626 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:13.483595    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:13.645759 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:13.645675    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:13.757957 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:13.757923    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:14.421804 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:14.421768    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:14.483332 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:14.483301    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:14.484310 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:14.484286    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:14.534510 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:14.534469    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:14.685413 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:14.685331    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:15.547512 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:15.547471    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:16.755117 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:16.755090    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:17.641896 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:17.641858    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:18.355015 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:18.354989    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:18.456561 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:18.456531    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:18.554346 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:18.554316    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:18.950488 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:18.950452    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:19.048053 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:19.048021    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:22.660957 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:22.660920    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:29.536886 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:29.536848    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:35.782809 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:35.782773    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:35.896430 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:35.896397    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:35.988623 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:35.988594    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:39.086210 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:39.086178    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:40.668966 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:40.668932    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:41.861502 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:41.860424    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:42.752041 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:42.751995    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:43.545263 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:43.545224    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:44.489631 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:44.489597    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:44.589373 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:44.589344    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:45.330684 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:45.330648    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:46.506661 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:46.506590    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:47.291227 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:47.291192    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:49.707824 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:49.707794    2549 generic.go:356] "Generic (PLEG): container finished" podID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerID="3d935ebbbb724b0b51acf8601a8e65d7e6da2d629a381667ba5402b201807972" exitCode=0
Sep 16 12:58:49.708238 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:49.707868    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v" event={"ID":"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c","Type":"ContainerDied","Data":"3d935ebbbb724b0b51acf8601a8e65d7e6da2d629a381667ba5402b201807972"}
Sep 16 12:58:49.708238 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:49.708234    2549 scope.go:117] "RemoveContainer" containerID="3d935ebbbb724b0b51acf8601a8e65d7e6da2d629a381667ba5402b201807972"
Sep 16 12:58:49.709343 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:49.709311    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:58:49.709470 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:49.709396    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:58:49.709470 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:49.709442    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:58:50.715253 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:50.715218    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v" event={"ID":"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c","Type":"ContainerStarted","Data":"45130682a214caac90d5f9435cdfb6a72a826021b872692fb8127715ce325e74"}
Sep 16 12:58:51.641807 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:51.641768    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:51.641978 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:51.641922    2549 patch_prober.go:28] interesting pod/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 12:58:51.641978 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:51.641967    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v" podUID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 12:58:52.642121 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:52.642083    2549 patch_prober.go:28] interesting pod/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 12:58:52.642521 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:52.642142    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v" podUID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 12:58:53.302888 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:53.302850    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:53.408411 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:53.408376    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:53.507810 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:53.507770    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:53.607788 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:53.607700    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:53.642123 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:53.642089    2549 patch_prober.go:28] interesting pod/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 12:58:53.642268 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:53.642146    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v" podUID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 12:58:54.254890 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:54.254854    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:54.356329 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:54.356297    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:54.452858 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:54.452821    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:54.642309 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:54.642226    2549 patch_prober.go:28] interesting pod/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 12:58:54.642309 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:54.642285    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v" podUID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 12:58:55.642745 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:55.642707    2549 patch_prober.go:28] interesting pod/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 16 12:58:55.643104 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:55.642768    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v" podUID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 16 12:58:56.010849 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:56.010818    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:58:56.645463 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:56.645432    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:56.645845 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:56.645810    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:58:56.646397 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:58:56.646381    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 12:59:02.267674 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:02.267640    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:02.388377 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:02.388340    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:02.966981 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:02.966949    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:09.225335 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.225304    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:09.323636 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.323601    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:09.495948 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.495870    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:09.815526 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.815430    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"]
Sep 16 12:59:09.819857 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.819829    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.822162 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.822140    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e937b400-openshift-default-dockercfg-l9ctw\""
Sep 16 12:59:09.831924 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.831901    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"]
Sep 16 12:59:09.840058 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.840031    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-envoy\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.840170 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.840071    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pmsr\" (UniqueName: \"kubernetes.io/projected/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-kube-api-access-5pmsr\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.840170 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.840106    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istiod-ca-cert\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.840170 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.840146    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-credential-socket\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.840392 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.840179    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-data\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.840392 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.840203    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-workload-certs\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.840392 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.840236    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-podinfo\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.840392 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.840308    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-token\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.840631 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.840407    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-workload-socket\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.860954 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.860926    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:09.941582 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.941553    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-workload-socket\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.941745 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.941592    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-envoy\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.941745 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.941610    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pmsr\" (UniqueName: \"kubernetes.io/projected/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-kube-api-access-5pmsr\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.941745 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.941628    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istiod-ca-cert\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.941745 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.941658    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-credential-socket\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.941745 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.941696    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-data\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.941745 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.941723    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-workload-certs\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.942093 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.941754    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-podinfo\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.942093 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.941836    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-token\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.942093 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.942040    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-workload-socket\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.942244 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.942229    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-credential-socket\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.942324 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.942297    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-data\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.942501 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.942466    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-workload-certs\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.942623 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.942601    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istiod-ca-cert\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.943937 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.943915    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-envoy\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.944237 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.944218    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-podinfo\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.950597 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.950572    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pmsr\" (UniqueName: \"kubernetes.io/projected/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-kube-api-access-5pmsr\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:09.950843 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:09.950827    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-token\") pod \"e2e-mt-e937b400-openshift-default-744c594c48-x8n49\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") " pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:10.132599 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:10.132515    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:10.176464 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:10.176434    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:10.418230 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:10.418200    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"]
Sep 16 12:59:10.419711 ip-10-0-128-195 kubenswrapper[2549]: W0916 12:59:10.419680    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec4e50f_a7f1_44ef_8b6e_9bd56c717f19.slice/crio-0afc444928ffec6a1da5626735feeed874e5c87e937910cdc4d824f62e4edaa6 WatchSource:0}: Error finding container 0afc444928ffec6a1da5626735feeed874e5c87e937910cdc4d824f62e4edaa6: Status 404 returned error can't find the container with id 0afc444928ffec6a1da5626735feeed874e5c87e937910cdc4d824f62e4edaa6
Sep 16 12:59:10.422106 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:10.422051    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:59:10.422219 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:10.422149    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:59:10.422219 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:10.422197    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:59:10.831664 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:10.831580    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49" event={"ID":"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19","Type":"ContainerStarted","Data":"4663f548cfaad410c8598eb1b3bc6ed0336ba13622690d9c678fee3453949cd7"}
Sep 16 12:59:10.831664 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:10.831640    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49" event={"ID":"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19","Type":"ContainerStarted","Data":"0afc444928ffec6a1da5626735feeed874e5c87e937910cdc4d824f62e4edaa6"}
Sep 16 12:59:10.854193 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:10.854144    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49" podStartSLOduration=1.8541246980000001 podStartE2EDuration="1.854124698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 12:59:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 12:59:10.853128461 +0000 UTC m=+1234.417949553" watchObservedRunningTime="2026-09-16 12:59:10.854124698 +0000 UTC m=+1234.418945790"
Sep 16 12:59:11.133235 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:11.133155    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:11.138305 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:11.138281    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:11.837326 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:11.837300    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:11.838083 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:11.838064    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:15.850428 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:15.850392    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:15.961707 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:15.961669    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:16.056071 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:16.056045    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:16.962660 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:16.962630    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:17.064133 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:17.064101    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:17.797428 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:17.797394    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:18.663665 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:18.663632    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:19.334866 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:19.334832    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:20.146729 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:20.146694    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:20.210724 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:20.210694    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:20.340012 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:20.339984    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:20.643144 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:20.643115    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:20.748432 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:20.748400    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:42.565619 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:42.565583    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:42.878684 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:42.878593    2549 patch_prober.go:28] interesting pod/e2e-mt-e937b400-openshift-default-744c594c48-x8n49 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 12:59:42.878684 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:42.878654    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49" podUID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 12:59:43.360276 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:43.360243    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:44.023683 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:44.023651    2549 generic.go:356] "Generic (PLEG): container finished" podID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerID="4663f548cfaad410c8598eb1b3bc6ed0336ba13622690d9c678fee3453949cd7" exitCode=0
Sep 16 12:59:44.024149 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:44.023732    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49" event={"ID":"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19","Type":"ContainerDied","Data":"4663f548cfaad410c8598eb1b3bc6ed0336ba13622690d9c678fee3453949cd7"}
Sep 16 12:59:44.024149 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:44.024114    2549 scope.go:117] "RemoveContainer" containerID="4663f548cfaad410c8598eb1b3bc6ed0336ba13622690d9c678fee3453949cd7"
Sep 16 12:59:44.025260 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:44.025233    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:59:44.025318 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:44.025304    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:59:44.025364 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:44.025341    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 12:59:44.409582 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:44.409541    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:45.034220 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:45.034183    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49" event={"ID":"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19","Type":"ContainerStarted","Data":"8239becfe5f1d1fe3ba1d3f88417a7fa68d5160abc4b9e8de566866ad88b5a0e"}
Sep 16 12:59:45.133615 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:45.133578    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:45.133891 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:45.133867    2549 patch_prober.go:28] interesting pod/e2e-mt-e937b400-openshift-default-744c594c48-x8n49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 16 12:59:45.133941 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:45.133924    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49" podUID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 16 12:59:45.170902 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:45.170785    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:46.082168 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:46.082135    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:46.133449 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:46.133407    2549 patch_prober.go:28] interesting pod/e2e-mt-e937b400-openshift-default-744c594c48-x8n49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 16 12:59:46.133658 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:46.133517    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49" podUID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 16 12:59:46.292273 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:46.292215    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:46.964039 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:46.963934    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:47.057108 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:47.057073    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:47.133790 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:47.133756    2549 patch_prober.go:28] interesting pod/e2e-mt-e937b400-openshift-default-744c594c48-x8n49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 16 12:59:47.134186 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:47.133809    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49" podUID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 16 12:59:47.446650 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:47.446615    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:47.838075 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:47.837999    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:48.132959 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:48.132877    2549 patch_prober.go:28] interesting pod/e2e-mt-e937b400-openshift-default-744c594c48-x8n49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 16 12:59:48.132959 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:48.132929    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49" podUID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 16 12:59:49.133186 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:49.133154    2549 patch_prober.go:28] interesting pod/e2e-mt-e937b400-openshift-default-744c594c48-x8n49 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 16 12:59:49.133594 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:49.133206    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49" podUID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 16 12:59:49.597679 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:49.597629    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:50.146579 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:50.146545    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:50.147176 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:50.147155    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:50.148328 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:50.148307    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 12:59:53.641104 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:53.641073    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:53.701840 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:53.701809    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:54.831829 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:54.831798    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:55.654654 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:55.654620    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:56.447092 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:56.447043    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:57.261667 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:57.261623    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:58.249987 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:58.249953    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:59.100539 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:59.100502    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 12:59:59.879678 ip-10-0-128-195 kubenswrapper[2549]: I0916 12:59:59.879641    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:05.321032 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:05.320998    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:05.643351 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:05.643271    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:06.000732 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:06.000675    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:06.566681 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:06.566647    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:07.371110 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:07.371063    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:07.915246 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:07.915213    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:08.834090 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:08.834054    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:09.508012 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:09.507975    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:10.313144 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:10.313108    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:11.859845 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:11.859795    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:12.110567 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:12.110494    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"]
Sep 16 13:00:12.110802 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:12.110774    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49" podUID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerName="istio-proxy" containerID="cri-o://8239becfe5f1d1fe3ba1d3f88417a7fa68d5160abc4b9e8de566866ad88b5a0e" gracePeriod=30
Sep 16 13:00:12.761905 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:12.761876    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:12.860015 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:12.859977    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:12.982619 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:12.982565    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:16.384384 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:16.384303    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:17.230833 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.230802    2549 generic.go:356] "Generic (PLEG): container finished" podID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerID="8239becfe5f1d1fe3ba1d3f88417a7fa68d5160abc4b9e8de566866ad88b5a0e" exitCode=0
Sep 16 13:00:17.230943 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.230844    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49" event={"ID":"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19","Type":"ContainerDied","Data":"8239becfe5f1d1fe3ba1d3f88417a7fa68d5160abc4b9e8de566866ad88b5a0e"}
Sep 16 13:00:17.230943 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.230901    2549 scope.go:117] "RemoveContainer" containerID="4663f548cfaad410c8598eb1b3bc6ed0336ba13622690d9c678fee3453949cd7"
Sep 16 13:00:17.362574 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.362549    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 13:00:17.488881 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.488851    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istiod-ca-cert\") pod \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") "
Sep 16 13:00:17.489259 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.488901    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-podinfo\") pod \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") "
Sep 16 13:00:17.489259 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.488976    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-envoy\") pod \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") "
Sep 16 13:00:17.489259 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.489030    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-credential-socket\") pod \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") "
Sep 16 13:00:17.489259 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.489054    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-workload-certs\") pod \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") "
Sep 16 13:00:17.489259 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.489103    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-data\") pod \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") "
Sep 16 13:00:17.489259 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.489135    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-token\") pod \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") "
Sep 16 13:00:17.489259 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.489165    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pmsr\" (UniqueName: \"kubernetes.io/projected/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-kube-api-access-5pmsr\") pod \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") "
Sep 16 13:00:17.489259 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.489190    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-workload-socket\") pod \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\" (UID: \"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19\") "
Sep 16 13:00:17.489745 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.489264    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" (UID: "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:00:17.489745 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.489358    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" (UID: "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:00:17.489745 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.489376    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" (UID: "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:00:17.489745 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.489580    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" (UID: "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:00:17.489745 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.489599    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istiod-ca-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:17.489745 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.489620    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-credential-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:17.489745 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.489638    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-workload-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:17.489745 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.489699    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" (UID: "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:00:17.491256 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.491233    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" (UID: "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:00:17.491256 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.491244    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" (UID: "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:00:17.491446 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.491359    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-kube-api-access-5pmsr" (OuterVolumeSpecName: "kube-api-access-5pmsr") pod "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" (UID: "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19"). InnerVolumeSpecName "kube-api-access-5pmsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:00:17.491446 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.491369    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" (UID: "9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:00:17.590898 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.590863    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-envoy\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:17.590898 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.590892    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-data\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:17.590898 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.590901    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-token\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:17.591130 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.590910    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pmsr\" (UniqueName: \"kubernetes.io/projected/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-kube-api-access-5pmsr\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:17.591130 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.590920    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-workload-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:17.591130 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:17.590929    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19-istio-podinfo\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:18.237585 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:18.237545    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49" event={"ID":"9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19","Type":"ContainerDied","Data":"0afc444928ffec6a1da5626735feeed874e5c87e937910cdc4d824f62e4edaa6"}
Sep 16 13:00:18.237779 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:18.237605    2549 scope.go:117] "RemoveContainer" containerID="8239becfe5f1d1fe3ba1d3f88417a7fa68d5160abc4b9e8de566866ad88b5a0e"
Sep 16 13:00:18.237779 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:18.237565    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"
Sep 16 13:00:18.260245 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:18.260215    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"]
Sep 16 13:00:18.266733 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:18.266711    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e937b400-openshift-default-744c594c48-x8n49"]
Sep 16 13:00:18.811221 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:18.811187    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:18.882393 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:18.882353    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:18.920598 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:18.920569    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" path="/var/lib/kubelet/pods/9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19/volumes"
Sep 16 13:00:18.990065 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:18.990037    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:19.997876 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:19.997843    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:20.100884 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:20.100857    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:22.759984 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:22.759946    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:23.675236 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:23.675201    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:23.773388 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:23.773351    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:24.387573 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:24.387536    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:25.229678 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:25.229644    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:25.953104 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:25.953077    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:26.127061 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:26.127026    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:26.223582 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:26.223496    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:26.554274 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:26.554201    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:26.724700 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:26.724657    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:27.052017 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.051982    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:27.331846 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.331763    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"]
Sep 16 13:00:27.332236 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.332220    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerName="istio-proxy"
Sep 16 13:00:27.332236 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.332237    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerName="istio-proxy"
Sep 16 13:00:27.332376 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.332247    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerName="istio-proxy"
Sep 16 13:00:27.332376 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.332253    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerName="istio-proxy"
Sep 16 13:00:27.332376 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.332339    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerName="istio-proxy"
Sep 16 13:00:27.332376 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.332347    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec4e50f-a7f1-44ef-8b6e-9bd56c717f19" containerName="istio-proxy"
Sep 16 13:00:27.335764 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.335739    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.338177 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.338151    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-863d9d-openshift-default-dockercfg-9scqk\""
Sep 16 13:00:27.349330 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.349302    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"]
Sep 16 13:00:27.364051 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.364020    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:27.480627 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.480590    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-workload-socket\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.480627 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.480627    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-podinfo\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.480880 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.480663    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-token\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.480880 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.480710    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-data\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.480880 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.480731    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-envoy\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.480880 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.480793    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29v2r\" (UniqueName: \"kubernetes.io/projected/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-kube-api-access-29v2r\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.480880 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.480834    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-workload-certs\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.480880 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.480858    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-credential-socket\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.481187 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.480897    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istiod-ca-cert\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.582367 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.582286    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-workload-socket\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.582367 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.582322    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-podinfo\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.582367 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.582351    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-token\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.582916 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.582383    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-data\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.582916 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.582402    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-envoy\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.582916 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.582431    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29v2r\" (UniqueName: \"kubernetes.io/projected/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-kube-api-access-29v2r\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.582916 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.582562    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-workload-certs\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.582916 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.582596    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-credential-socket\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.582916 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.582626    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istiod-ca-cert\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.582916 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.582840    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-data\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.583207 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.583083    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-workload-socket\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.583207 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.583139    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-workload-certs\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.583277 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.583246    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-credential-socket\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.583353 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.583337    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istiod-ca-cert\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.585254 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.585226    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-envoy\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.585466 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.585447    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-podinfo\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.591245 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.591219    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-token\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.591413 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.591391    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29v2r\" (UniqueName: \"kubernetes.io/projected/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-kube-api-access-29v2r\") pod \"e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") " pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.648727 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.648690    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:27.741790 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.741733    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:27.841968 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.841880    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:27.929028 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.929004    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"]
Sep 16 13:00:27.930779 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:00:27.930750    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402d8bc2_dc12_4c04_8b2b_a9bfdab320db.slice/crio-874fc313d95bb4edca48ea9f299d980c745003d83eed453adad728e6788d9525 WatchSource:0}: Error finding container 874fc313d95bb4edca48ea9f299d980c745003d83eed453adad728e6788d9525: Status 404 returned error can't find the container with id 874fc313d95bb4edca48ea9f299d980c745003d83eed453adad728e6788d9525
Sep 16 13:00:27.933022 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.932988    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:00:27.933095 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.933059    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:00:27.933095 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:27.933086    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:00:28.299408 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:28.299375    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh" event={"ID":"402d8bc2-dc12-4c04-8b2b-a9bfdab320db","Type":"ContainerStarted","Data":"6249c1bc19482960c0297140fd5fc91ce16d49aad77f9e99d1477cced0e353ea"}
Sep 16 13:00:28.299600 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:28.299428    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh" event={"ID":"402d8bc2-dc12-4c04-8b2b-a9bfdab320db","Type":"ContainerStarted","Data":"874fc313d95bb4edca48ea9f299d980c745003d83eed453adad728e6788d9525"}
Sep 16 13:00:28.323038 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:28.322989    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh" podStartSLOduration=1.322975038 podStartE2EDuration="1.322975038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:00:28.320420067 +0000 UTC m=+1311.885241158" watchObservedRunningTime="2026-09-16 13:00:28.322975038 +0000 UTC m=+1311.887796128"
Sep 16 13:00:28.649378 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:28.649300    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:29.529674 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:29.529638    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:29.653978 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:29.653949    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:30.282412 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:30.282383    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:30.310358 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:30.310326    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:30.311333 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:30.311306    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:00:30.376024 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:30.375984    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:30.600461 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:30.600378    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:31.499941 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:31.499897    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:32.378317 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:32.378285    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:33.174639 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:33.174599    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:34.058928 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:34.058899    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:35.046014 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:35.045983    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:35.141402 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:35.141363    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:35.654426 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:35.654393    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:35.754943 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:35.754910    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:35.853624 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:35.853580    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:36.057710 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.057661    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"]
Sep 16 13:00:36.062054 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.062029    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"
Sep 16 13:00:36.067119 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.067095    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-863d9d-dockercfg-xkfl4\""
Sep 16 13:00:36.067254 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.067134    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-863d9d\""
Sep 16 13:00:36.091798 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.091773    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"]
Sep 16 13:00:36.165010 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.164974    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk4lv\" (UniqueName: \"kubernetes.io/projected/a81b8c91-8d11-47b9-92dd-1642599c6159-kube-api-access-xk4lv\") pod \"payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw\" (UID: \"a81b8c91-8d11-47b9-92dd-1642599c6159\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"
Sep 16 13:00:36.165170 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.165027    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81b8c91-8d11-47b9-92dd-1642599c6159-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw\" (UID: \"a81b8c91-8d11-47b9-92dd-1642599c6159\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"
Sep 16 13:00:36.265892 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.265858    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk4lv\" (UniqueName: \"kubernetes.io/projected/a81b8c91-8d11-47b9-92dd-1642599c6159-kube-api-access-xk4lv\") pod \"payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw\" (UID: \"a81b8c91-8d11-47b9-92dd-1642599c6159\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"
Sep 16 13:00:36.266043 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.265906    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81b8c91-8d11-47b9-92dd-1642599c6159-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw\" (UID: \"a81b8c91-8d11-47b9-92dd-1642599c6159\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"
Sep 16 13:00:36.266625 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.266606    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81b8c91-8d11-47b9-92dd-1642599c6159-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw\" (UID: \"a81b8c91-8d11-47b9-92dd-1642599c6159\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"
Sep 16 13:00:36.285495 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.285464    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk4lv\" (UniqueName: \"kubernetes.io/projected/a81b8c91-8d11-47b9-92dd-1642599c6159-kube-api-access-xk4lv\") pod \"payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw\" (UID: \"a81b8c91-8d11-47b9-92dd-1642599c6159\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"
Sep 16 13:00:36.316136 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.316061    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:36.376101 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.376065    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"
Sep 16 13:00:36.514229 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.514183    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:36.627150 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.627078    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:36.671532 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.671506    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"]
Sep 16 13:00:36.671991 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:00:36.671962    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81b8c91_8d11_47b9_92dd_1642599c6159.slice/crio-4ee64a2c7f1bec4b5b1343383b852810d43366ad0c84128fb7060b13c21a72aa WatchSource:0}: Error finding container 4ee64a2c7f1bec4b5b1343383b852810d43366ad0c84128fb7060b13c21a72aa: Status 404 returned error can't find the container with id 4ee64a2c7f1bec4b5b1343383b852810d43366ad0c84128fb7060b13c21a72aa
Sep 16 13:00:36.727721 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.727700    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:36.854276 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:36.854240    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:37.353552 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:37.353424    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw" event={"ID":"a81b8c91-8d11-47b9-92dd-1642599c6159","Type":"ContainerStarted","Data":"d8e268c1191f29c0df798a951dd4beab4cf39abf01f4724b340df22136961902"}
Sep 16 13:00:37.354218 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:37.354191    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw" event={"ID":"a81b8c91-8d11-47b9-92dd-1642599c6159","Type":"ContainerStarted","Data":"4ee64a2c7f1bec4b5b1343383b852810d43366ad0c84128fb7060b13c21a72aa"}
Sep 16 13:00:37.354394 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:37.354377    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"
Sep 16 13:00:37.391145 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:37.391092    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw" podStartSLOduration=2.391076234 podStartE2EDuration="2.391076234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:00:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:00:37.390826214 +0000 UTC m=+1320.955647306" watchObservedRunningTime="2026-09-16 13:00:37.391076234 +0000 UTC m=+1320.955897379"
Sep 16 13:00:37.451921 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:37.451885    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:37.554139 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:37.554098    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:38.230978 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:38.230945    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:39.241397 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:39.241367    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:40.523511 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:40.523462    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:41.045042 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:41.045008    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:41.842732 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:41.842693    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:42.383129 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:42.383093    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:42.964961 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:42.964930    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:43.562095 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:43.562060    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:44.434132 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:44.434102    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:44.535351 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:44.535317    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:44.705226 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:44.705151    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"]
Sep 16 13:00:44.705393 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:44.705371    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v" podUID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerName="istio-proxy" containerID="cri-o://45130682a214caac90d5f9435cdfb6a72a826021b872692fb8127715ce325e74" gracePeriod=30
Sep 16 13:00:44.831638 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:44.831609    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:45.192604 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:45.192573    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:45.522225 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:45.522126    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:46.010047 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:46.010016    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:47.354313 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:47.354272    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:47.970209 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:47.970164    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:48.071448 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:48.071416    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:49.369952 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:49.369923    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"
Sep 16 13:00:49.958461 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:49.958440    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 13:00:50.097010 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.096938    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-envoy\") pod \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") "
Sep 16 13:00:50.097010 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.096966    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-workload-socket\") pod \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") "
Sep 16 13:00:50.097010 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.096994    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istiod-ca-cert\") pod \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") "
Sep 16 13:00:50.097268 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097024    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-credential-socket\") pod \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") "
Sep 16 13:00:50.097268 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097059    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-data\") pod \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") "
Sep 16 13:00:50.097268 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097153    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-podinfo\") pod \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") "
Sep 16 13:00:50.097268 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097219    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-workload-certs\") pod \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") "
Sep 16 13:00:50.097268 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097249    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tptdn\" (UniqueName: \"kubernetes.io/projected/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-kube-api-access-tptdn\") pod \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") "
Sep 16 13:00:50.097570 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097291    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-token\") pod \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\" (UID: \"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c\") "
Sep 16 13:00:50.097570 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097250    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" (UID: "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:00:50.097570 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097371    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" (UID: "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:00:50.097570 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097346    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" (UID: "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:00:50.097570 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097431    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-data" (OuterVolumeSpecName: "istio-data") pod "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" (UID: "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:00:50.097838 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097656    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-workload-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:50.097838 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097679    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istiod-ca-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:50.097838 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097721    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-credential-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:50.097838 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097735    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-data\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:50.097838 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.097738    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" (UID: "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:00:50.099222 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.099186    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" (UID: "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:00:50.099222 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.099203    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" (UID: "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:00:50.099404 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.099293    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-token" (OuterVolumeSpecName: "istio-token") pod "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" (UID: "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:00:50.099404 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.099356    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-kube-api-access-tptdn" (OuterVolumeSpecName: "kube-api-access-tptdn") pod "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" (UID: "4004965c-9b7c-4570-abe5-1ffb8a5cdb9c"). InnerVolumeSpecName "kube-api-access-tptdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:00:50.199019 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.198992    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-envoy\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:50.199019 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.199014    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-podinfo\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:50.199019 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.199023    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-workload-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:50.199195 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.199032    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tptdn\" (UniqueName: \"kubernetes.io/projected/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-kube-api-access-tptdn\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:50.199195 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.199042    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c-istio-token\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:00:50.434327 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.434290    2549 generic.go:356] "Generic (PLEG): container finished" podID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerID="45130682a214caac90d5f9435cdfb6a72a826021b872692fb8127715ce325e74" exitCode=0
Sep 16 13:00:50.434706 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.434343    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"
Sep 16 13:00:50.434706 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.434366    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v" event={"ID":"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c","Type":"ContainerDied","Data":"45130682a214caac90d5f9435cdfb6a72a826021b872692fb8127715ce325e74"}
Sep 16 13:00:50.434706 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.434418    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v" event={"ID":"4004965c-9b7c-4570-abe5-1ffb8a5cdb9c","Type":"ContainerDied","Data":"7e3cf343d8654ead75db693e708fcd8a12f769597a2b233334f34d8e8fbc2759"}
Sep 16 13:00:50.434706 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.434438    2549 scope.go:117] "RemoveContainer" containerID="45130682a214caac90d5f9435cdfb6a72a826021b872692fb8127715ce325e74"
Sep 16 13:00:50.444166 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.444149    2549 scope.go:117] "RemoveContainer" containerID="3d935ebbbb724b0b51acf8601a8e65d7e6da2d629a381667ba5402b201807972"
Sep 16 13:00:50.452161 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.452145    2549 scope.go:117] "RemoveContainer" containerID="45130682a214caac90d5f9435cdfb6a72a826021b872692fb8127715ce325e74"
Sep 16 13:00:50.452437 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:00:50.452415    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45130682a214caac90d5f9435cdfb6a72a826021b872692fb8127715ce325e74\": container with ID starting with 45130682a214caac90d5f9435cdfb6a72a826021b872692fb8127715ce325e74 not found: ID does not exist" containerID="45130682a214caac90d5f9435cdfb6a72a826021b872692fb8127715ce325e74"
Sep 16 13:00:50.452540 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.452444    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45130682a214caac90d5f9435cdfb6a72a826021b872692fb8127715ce325e74"} err="failed to get container status \"45130682a214caac90d5f9435cdfb6a72a826021b872692fb8127715ce325e74\": rpc error: code = NotFound desc = could not find container \"45130682a214caac90d5f9435cdfb6a72a826021b872692fb8127715ce325e74\": container with ID starting with 45130682a214caac90d5f9435cdfb6a72a826021b872692fb8127715ce325e74 not found: ID does not exist"
Sep 16 13:00:50.452540 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.452462    2549 scope.go:117] "RemoveContainer" containerID="3d935ebbbb724b0b51acf8601a8e65d7e6da2d629a381667ba5402b201807972"
Sep 16 13:00:50.452723 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:00:50.452704    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d935ebbbb724b0b51acf8601a8e65d7e6da2d629a381667ba5402b201807972\": container with ID starting with 3d935ebbbb724b0b51acf8601a8e65d7e6da2d629a381667ba5402b201807972 not found: ID does not exist" containerID="3d935ebbbb724b0b51acf8601a8e65d7e6da2d629a381667ba5402b201807972"
Sep 16 13:00:50.452763 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.452730    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d935ebbbb724b0b51acf8601a8e65d7e6da2d629a381667ba5402b201807972"} err="failed to get container status \"3d935ebbbb724b0b51acf8601a8e65d7e6da2d629a381667ba5402b201807972\": rpc error: code = NotFound desc = could not find container \"3d935ebbbb724b0b51acf8601a8e65d7e6da2d629a381667ba5402b201807972\": container with ID starting with 3d935ebbbb724b0b51acf8601a8e65d7e6da2d629a381667ba5402b201807972 not found: ID does not exist"
Sep 16 13:00:50.459974 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.459951    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"]
Sep 16 13:00:50.465064 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.465045    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-7087d2-openshift-default-778677f888-cdk2v"]
Sep 16 13:00:50.922600 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:50.922561    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" path="/var/lib/kubelet/pods/4004965c-9b7c-4570-abe5-1ffb8a5cdb9c/volumes"
Sep 16 13:00:56.417719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:56.417686    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:58.346195 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:58.346156    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:59.086515 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:59.086464    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:00:59.919070 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:00:59.919034    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:00.424631 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:00.424599    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:00.808773 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:00.808683    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:00.905720 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:00.905651    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:01.299227 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:01.299196    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:01.352681 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:01.352646    2549 patch_prober.go:28] interesting pod/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 13:01:01.352851 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:01.352718    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh" podUID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 13:01:01.518602 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:01.518518    2549 generic.go:356] "Generic (PLEG): container finished" podID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerID="6249c1bc19482960c0297140fd5fc91ce16d49aad77f9e99d1477cced0e353ea" exitCode=0
Sep 16 13:01:01.518755 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:01.518606    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh" event={"ID":"402d8bc2-dc12-4c04-8b2b-a9bfdab320db","Type":"ContainerDied","Data":"6249c1bc19482960c0297140fd5fc91ce16d49aad77f9e99d1477cced0e353ea"}
Sep 16 13:01:01.519155 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:01.519139    2549 scope.go:117] "RemoveContainer" containerID="6249c1bc19482960c0297140fd5fc91ce16d49aad77f9e99d1477cced0e353ea"
Sep 16 13:01:01.520275 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:01.520243    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:01:01.520363 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:01.520317    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:01:01.520363 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:01.520359    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:01:01.647888 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:01.647854    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:01.873693 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:01.873614    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:02.533451 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:02.527335    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh" event={"ID":"402d8bc2-dc12-4c04-8b2b-a9bfdab320db","Type":"ContainerStarted","Data":"086eab63d36f1eb2ce4c4148d783e0cac145ff9470bb928a8a303036b9efafc8"}
Sep 16 13:01:02.649410 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:02.649374    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:01:02.649751 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:02.649715    2549 patch_prober.go:28] interesting pod/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 16 13:01:02.649853 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:02.649798    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh" podUID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 16 13:01:02.841671 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:02.841580    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:03.649222 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:03.649185    2549 patch_prober.go:28] interesting pod/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 16 13:01:03.649809 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:03.649775    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh" podUID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 16 13:01:03.960302 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:03.960267    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:04.314034 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:04.313944    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:04.400621 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:04.400591    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:04.649411 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:04.649316    2549 patch_prober.go:28] interesting pod/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 16 13:01:04.650583 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:04.650547    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh" podUID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 16 13:01:05.105212 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:05.105188    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:05.649941 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:05.649898    2549 patch_prober.go:28] interesting pod/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 16 13:01:05.650439 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:05.649967    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh" podUID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 16 13:01:05.763311 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:05.763274    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:06.468016 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:06.467977    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:06.649624 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:06.649587    2549 patch_prober.go:28] interesting pod/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 16 13:01:06.649939 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:06.649910    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh" podUID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 16 13:01:07.630688 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:07.630653    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:07.654439 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:07.654411    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:01:07.654855 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:07.654817    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:01:07.655624 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:07.655605    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:01:08.489636 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:08.489601    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:09.285190 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:09.285160    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:11.967614 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:11.967578    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:12.270667 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:12.270589    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:13.162117 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:13.162083    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:13.989312 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:13.989276    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:14.282241 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:14.282162    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:14.382154 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:14.382125    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:15.848696 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:15.848664    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:16.550165 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.550124    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"]
Sep 16 13:01:16.550689 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.550656    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x" podUID="a3a8343d-5f92-4c69-b2fa-d812b14f2216" containerName="maas-api" containerID="cri-o://26addaa42adf13d29c38104f84ebcef4e352082928bc6d235519532d8e5b59fe" gracePeriod=30
Sep 16 13:01:16.584815 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.584781    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:16.616898 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.616861    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"]
Sep 16 13:01:16.617138 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.617113    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn" podUID="b65c3ad3-e9a1-4118-8bc1-0ddb1188be20" containerName="payload-pre-processing" containerID="cri-o://dd6faa2bab89b615e4184c8fd3446e2f212c8da300fd246211934b27daaa8973" gracePeriod=30
Sep 16 13:01:16.682383 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.682338    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:16.882172 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.882140    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 13:01:16.891528 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.891500    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:16.920114 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.920085    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"
Sep 16 13:01:16.960647 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.960614    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-maas-api-tls\") pod \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") "
Sep 16 13:01:16.960836 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.960671    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b65c3ad3-e9a1-4118-8bc1-0ddb1188be20-plugins-config-volume\") pod \"b65c3ad3-e9a1-4118-8bc1-0ddb1188be20\" (UID: \"b65c3ad3-e9a1-4118-8bc1-0ddb1188be20\") "
Sep 16 13:01:16.960836 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.960744    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a8343d-5f92-4c69-b2fa-d812b14f2216-openshift-service-ca\") pod \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") "
Sep 16 13:01:16.960836 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.960809    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdw5b\" (UniqueName: \"kubernetes.io/projected/a3a8343d-5f92-4c69-b2fa-d812b14f2216-kube-api-access-tdw5b\") pod \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") "
Sep 16 13:01:16.961025 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.960848    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-528kp\" (UniqueName: \"kubernetes.io/projected/b65c3ad3-e9a1-4118-8bc1-0ddb1188be20-kube-api-access-528kp\") pod \"b65c3ad3-e9a1-4118-8bc1-0ddb1188be20\" (UID: \"b65c3ad3-e9a1-4118-8bc1-0ddb1188be20\") "
Sep 16 13:01:16.961025 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.960897    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-metrics-certs\") pod \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\" (UID: \"a3a8343d-5f92-4c69-b2fa-d812b14f2216\") "
Sep 16 13:01:16.961154 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.961121    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b65c3ad3-e9a1-4118-8bc1-0ddb1188be20-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b65c3ad3-e9a1-4118-8bc1-0ddb1188be20" (UID: "b65c3ad3-e9a1-4118-8bc1-0ddb1188be20"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:01:16.961273 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.961242    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b65c3ad3-e9a1-4118-8bc1-0ddb1188be20-plugins-config-volume\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:16.961543 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.961497    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3a8343d-5f92-4c69-b2fa-d812b14f2216-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a3a8343d-5f92-4c69-b2fa-d812b14f2216" (UID: "a3a8343d-5f92-4c69-b2fa-d812b14f2216"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:01:16.963316 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.963288    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b65c3ad3-e9a1-4118-8bc1-0ddb1188be20-kube-api-access-528kp" (OuterVolumeSpecName: "kube-api-access-528kp") pod "b65c3ad3-e9a1-4118-8bc1-0ddb1188be20" (UID: "b65c3ad3-e9a1-4118-8bc1-0ddb1188be20"). InnerVolumeSpecName "kube-api-access-528kp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:01:16.963404 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.963346    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a3a8343d-5f92-4c69-b2fa-d812b14f2216" (UID: "a3a8343d-5f92-4c69-b2fa-d812b14f2216"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:01:16.963404 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.963360    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3a8343d-5f92-4c69-b2fa-d812b14f2216-kube-api-access-tdw5b" (OuterVolumeSpecName: "kube-api-access-tdw5b") pod "a3a8343d-5f92-4c69-b2fa-d812b14f2216" (UID: "a3a8343d-5f92-4c69-b2fa-d812b14f2216"). InnerVolumeSpecName "kube-api-access-tdw5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:01:16.963556 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.963410    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a3a8343d-5f92-4c69-b2fa-d812b14f2216" (UID: "a3a8343d-5f92-4c69-b2fa-d812b14f2216"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:01:16.986471 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:16.986446    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:17.062714 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.062677    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdw5b\" (UniqueName: \"kubernetes.io/projected/a3a8343d-5f92-4c69-b2fa-d812b14f2216-kube-api-access-tdw5b\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:17.062714 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.062706    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-528kp\" (UniqueName: \"kubernetes.io/projected/b65c3ad3-e9a1-4118-8bc1-0ddb1188be20-kube-api-access-528kp\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:17.062714 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.062716    2549 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-metrics-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:17.062944 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.062725    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a3a8343d-5f92-4c69-b2fa-d812b14f2216-maas-api-tls\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:17.062944 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.062733    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3a8343d-5f92-4c69-b2fa-d812b14f2216-openshift-service-ca\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:17.209630 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.209601    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:17.331301 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.331263    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:17.628135 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.628096    2549 generic.go:356] "Generic (PLEG): container finished" podID="a3a8343d-5f92-4c69-b2fa-d812b14f2216" containerID="26addaa42adf13d29c38104f84ebcef4e352082928bc6d235519532d8e5b59fe" exitCode=0
Sep 16 13:01:17.628297 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.628144    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"
Sep 16 13:01:17.628297 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.628139    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x" event={"ID":"a3a8343d-5f92-4c69-b2fa-d812b14f2216","Type":"ContainerDied","Data":"26addaa42adf13d29c38104f84ebcef4e352082928bc6d235519532d8e5b59fe"}
Sep 16 13:01:17.628297 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.628286    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x" event={"ID":"a3a8343d-5f92-4c69-b2fa-d812b14f2216","Type":"ContainerDied","Data":"08bc7a35232b3f88306632de41a8e0e40b0fb8d3e723f470f30ceebe0cccef13"}
Sep 16 13:01:17.628445 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.628321    2549 scope.go:117] "RemoveContainer" containerID="26addaa42adf13d29c38104f84ebcef4e352082928bc6d235519532d8e5b59fe"
Sep 16 13:01:17.629759 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.629619    2549 generic.go:356] "Generic (PLEG): container finished" podID="b65c3ad3-e9a1-4118-8bc1-0ddb1188be20" containerID="dd6faa2bab89b615e4184c8fd3446e2f212c8da300fd246211934b27daaa8973" exitCode=0
Sep 16 13:01:17.629759 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.629662    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"
Sep 16 13:01:17.629759 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.629642    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn" event={"ID":"b65c3ad3-e9a1-4118-8bc1-0ddb1188be20","Type":"ContainerDied","Data":"dd6faa2bab89b615e4184c8fd3446e2f212c8da300fd246211934b27daaa8973"}
Sep 16 13:01:17.629895 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.629778    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn" event={"ID":"b65c3ad3-e9a1-4118-8bc1-0ddb1188be20","Type":"ContainerDied","Data":"00322132b06692027979c724070bb77b09a4e63d0af0d3407a935b35566a7429"}
Sep 16 13:01:17.638583 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.638549    2549 scope.go:117] "RemoveContainer" containerID="26addaa42adf13d29c38104f84ebcef4e352082928bc6d235519532d8e5b59fe"
Sep 16 13:01:17.638881 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:17.638844    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26addaa42adf13d29c38104f84ebcef4e352082928bc6d235519532d8e5b59fe\": container with ID starting with 26addaa42adf13d29c38104f84ebcef4e352082928bc6d235519532d8e5b59fe not found: ID does not exist" containerID="26addaa42adf13d29c38104f84ebcef4e352082928bc6d235519532d8e5b59fe"
Sep 16 13:01:17.638978 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.638876    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26addaa42adf13d29c38104f84ebcef4e352082928bc6d235519532d8e5b59fe"} err="failed to get container status \"26addaa42adf13d29c38104f84ebcef4e352082928bc6d235519532d8e5b59fe\": rpc error: code = NotFound desc = could not find container \"26addaa42adf13d29c38104f84ebcef4e352082928bc6d235519532d8e5b59fe\": container with ID starting with 26addaa42adf13d29c38104f84ebcef4e352082928bc6d235519532d8e5b59fe not found: ID does not exist"
Sep 16 13:01:17.638978 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.638898    2549 scope.go:117] "RemoveContainer" containerID="dd6faa2bab89b615e4184c8fd3446e2f212c8da300fd246211934b27daaa8973"
Sep 16 13:01:17.647333 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.647315    2549 scope.go:117] "RemoveContainer" containerID="dd6faa2bab89b615e4184c8fd3446e2f212c8da300fd246211934b27daaa8973"
Sep 16 13:01:17.647649 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:17.647629    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd6faa2bab89b615e4184c8fd3446e2f212c8da300fd246211934b27daaa8973\": container with ID starting with dd6faa2bab89b615e4184c8fd3446e2f212c8da300fd246211934b27daaa8973 not found: ID does not exist" containerID="dd6faa2bab89b615e4184c8fd3446e2f212c8da300fd246211934b27daaa8973"
Sep 16 13:01:17.647740 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.647656    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd6faa2bab89b615e4184c8fd3446e2f212c8da300fd246211934b27daaa8973"} err="failed to get container status \"dd6faa2bab89b615e4184c8fd3446e2f212c8da300fd246211934b27daaa8973\": rpc error: code = NotFound desc = could not find container \"dd6faa2bab89b615e4184c8fd3446e2f212c8da300fd246211934b27daaa8973\": container with ID starting with dd6faa2bab89b615e4184c8fd3446e2f212c8da300fd246211934b27daaa8973 not found: ID does not exist"
Sep 16 13:01:17.660658 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.660616    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"]
Sep 16 13:01:17.664286 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.664266    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-586bab-6b6985c758-f5nrn"]
Sep 16 13:01:17.677240 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.677217    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"]
Sep 16 13:01:17.679496 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:17.679464    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-586bab-5dbc849557-4688x"]
Sep 16 13:01:18.118372 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:18.118328    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:18.920375 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:18.920342    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3a8343d-5f92-4c69-b2fa-d812b14f2216" path="/var/lib/kubelet/pods/a3a8343d-5f92-4c69-b2fa-d812b14f2216/volumes"
Sep 16 13:01:18.920744 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:18.920730    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b65c3ad3-e9a1-4118-8bc1-0ddb1188be20" path="/var/lib/kubelet/pods/b65c3ad3-e9a1-4118-8bc1-0ddb1188be20/volumes"
Sep 16 13:01:19.161469 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:19.161439    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:20.052913 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:20.052880    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:20.859162 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:20.859116    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:21.708826 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:21.708795    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:22.770990 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:22.770946    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:23.644923 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:23.644884    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:24.088800 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:24.088759    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:24.192242 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:24.192211    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:24.370588 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:24.370500    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"]
Sep 16 13:01:24.370751 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:24.370715    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" podUID="aae27201-47c6-4255-bdb9-c933273636db" containerName="istio-proxy" containerID="cri-o://4130e2f34e62b79f37fd1bd784223696690fd50ccbd635bc4812aa6dd66d6b9a" gracePeriod=30
Sep 16 13:01:24.382217 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:24.382187    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:24.455148 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:24.455121    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:25.296561 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.296527    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7541-b03e5a"]
Sep 16 13:01:25.296971 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.296957    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerName="istio-proxy"
Sep 16 13:01:25.297015 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.296972    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerName="istio-proxy"
Sep 16 13:01:25.297015 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.296985    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3a8343d-5f92-4c69-b2fa-d812b14f2216" containerName="maas-api"
Sep 16 13:01:25.297015 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.296991    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3a8343d-5f92-4c69-b2fa-d812b14f2216" containerName="maas-api"
Sep 16 13:01:25.297015 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.297007    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerName="istio-proxy"
Sep 16 13:01:25.297015 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.297012    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerName="istio-proxy"
Sep 16 13:01:25.297171 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.297034    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b65c3ad3-e9a1-4118-8bc1-0ddb1188be20" containerName="payload-pre-processing"
Sep 16 13:01:25.297171 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.297042    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b65c3ad3-e9a1-4118-8bc1-0ddb1188be20" containerName="payload-pre-processing"
Sep 16 13:01:25.297171 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.297100    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerName="istio-proxy"
Sep 16 13:01:25.297171 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.297109    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3a8343d-5f92-4c69-b2fa-d812b14f2216" containerName="maas-api"
Sep 16 13:01:25.297171 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.297117    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="4004965c-9b7c-4570-abe5-1ffb8a5cdb9c" containerName="istio-proxy"
Sep 16 13:01:25.297171 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.297124    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="b65c3ad3-e9a1-4118-8bc1-0ddb1188be20" containerName="payload-pre-processing"
Sep 16 13:01:25.300611 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.300594    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-b03e5a"
Sep 16 13:01:25.303404 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.303380    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-z9lzx\""
Sep 16 13:01:25.307609 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.307588    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7541-b03e5a"]
Sep 16 13:01:25.332793 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.332772    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnntf\" (UniqueName: \"kubernetes.io/projected/731af5d9-7657-419e-aa29-828a1c4393a6-kube-api-access-jnntf\") pod \"test-curl-7541-b03e5a\" (UID: \"731af5d9-7657-419e-aa29-828a1c4393a6\") " pod="opendatahub/test-curl-7541-b03e5a"
Sep 16 13:01:25.434099 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.434071    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnntf\" (UniqueName: \"kubernetes.io/projected/731af5d9-7657-419e-aa29-828a1c4393a6-kube-api-access-jnntf\") pod \"test-curl-7541-b03e5a\" (UID: \"731af5d9-7657-419e-aa29-828a1c4393a6\") " pod="opendatahub/test-curl-7541-b03e5a"
Sep 16 13:01:25.442487 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.442451    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnntf\" (UniqueName: \"kubernetes.io/projected/731af5d9-7657-419e-aa29-828a1c4393a6-kube-api-access-jnntf\") pod \"test-curl-7541-b03e5a\" (UID: \"731af5d9-7657-419e-aa29-828a1c4393a6\") " pod="opendatahub/test-curl-7541-b03e5a"
Sep 16 13:01:25.612257 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.612177    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-b03e5a"
Sep 16 13:01:25.708367 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.708332    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:25.889384 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.889360    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7541-b03e5a"]
Sep 16 13:01:25.891082 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:01:25.891058    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod731af5d9_7657_419e_aa29_828a1c4393a6.slice/crio-9694d7057cdee460ce365641cd07de8bf9f7a9ae0a90c405e94ea095ef838abf WatchSource:0}: Error finding container 9694d7057cdee460ce365641cd07de8bf9f7a9ae0a90c405e94ea095ef838abf: Status 404 returned error can't find the container with id 9694d7057cdee460ce365641cd07de8bf9f7a9ae0a90c405e94ea095ef838abf
Sep 16 13:01:25.893153 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:25.893134    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 13:01:26.684442 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:26.684403    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7541-b03e5a" event={"ID":"731af5d9-7657-419e-aa29-828a1c4393a6","Type":"ContainerStarted","Data":"9694d7057cdee460ce365641cd07de8bf9f7a9ae0a90c405e94ea095ef838abf"}
Sep 16 13:01:26.728651 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:26.728596    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:27.498164 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:27.498126    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:28.492329 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:28.492299    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:29.259045 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.259008    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:29.620840 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.620793    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 13:01:29.675441 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.675411    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-istio-data\") pod \"aae27201-47c6-4255-bdb9-c933273636db\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") "
Sep 16 13:01:29.675618 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.675503    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mg8p\" (UniqueName: \"kubernetes.io/projected/aae27201-47c6-4255-bdb9-c933273636db-kube-api-access-8mg8p\") pod \"aae27201-47c6-4255-bdb9-c933273636db\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") "
Sep 16 13:01:29.675618 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.675523    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aae27201-47c6-4255-bdb9-c933273636db-istio-token\") pod \"aae27201-47c6-4255-bdb9-c933273636db\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") "
Sep 16 13:01:29.675618 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.675544    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-credential-socket\") pod \"aae27201-47c6-4255-bdb9-c933273636db\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") "
Sep 16 13:01:29.675618 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.675565    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aae27201-47c6-4255-bdb9-c933273636db-istio-podinfo\") pod \"aae27201-47c6-4255-bdb9-c933273636db\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") "
Sep 16 13:01:29.675851 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.675632    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-workload-certs\") pod \"aae27201-47c6-4255-bdb9-c933273636db\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") "
Sep 16 13:01:29.675851 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.675673    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-istio-envoy\") pod \"aae27201-47c6-4255-bdb9-c933273636db\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") "
Sep 16 13:01:29.675851 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.675701    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-istio-data" (OuterVolumeSpecName: "istio-data") pod "aae27201-47c6-4255-bdb9-c933273636db" (UID: "aae27201-47c6-4255-bdb9-c933273636db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:01:29.675851 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.675724    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-workload-socket\") pod \"aae27201-47c6-4255-bdb9-c933273636db\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") "
Sep 16 13:01:29.675851 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.675765    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aae27201-47c6-4255-bdb9-c933273636db-istiod-ca-cert\") pod \"aae27201-47c6-4255-bdb9-c933273636db\" (UID: \"aae27201-47c6-4255-bdb9-c933273636db\") "
Sep 16 13:01:29.676232 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.675860    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aae27201-47c6-4255-bdb9-c933273636db" (UID: "aae27201-47c6-4255-bdb9-c933273636db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:01:29.676232 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.675998    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aae27201-47c6-4255-bdb9-c933273636db" (UID: "aae27201-47c6-4255-bdb9-c933273636db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:01:29.676232 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.676160    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aae27201-47c6-4255-bdb9-c933273636db" (UID: "aae27201-47c6-4255-bdb9-c933273636db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:01:29.676397 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.676232    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-istio-data\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:29.676397 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.676251    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-credential-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:29.676397 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.676266    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-workload-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:29.676397 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.676262    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aae27201-47c6-4255-bdb9-c933273636db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aae27201-47c6-4255-bdb9-c933273636db" (UID: "aae27201-47c6-4255-bdb9-c933273636db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:01:29.677805 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.677775    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aae27201-47c6-4255-bdb9-c933273636db-kube-api-access-8mg8p" (OuterVolumeSpecName: "kube-api-access-8mg8p") pod "aae27201-47c6-4255-bdb9-c933273636db" (UID: "aae27201-47c6-4255-bdb9-c933273636db"). InnerVolumeSpecName "kube-api-access-8mg8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:01:29.677948 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.677933    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aae27201-47c6-4255-bdb9-c933273636db" (UID: "aae27201-47c6-4255-bdb9-c933273636db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:01:29.678147 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.678124    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aae27201-47c6-4255-bdb9-c933273636db-istio-token" (OuterVolumeSpecName: "istio-token") pod "aae27201-47c6-4255-bdb9-c933273636db" (UID: "aae27201-47c6-4255-bdb9-c933273636db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:01:29.678147 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.678125    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aae27201-47c6-4255-bdb9-c933273636db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aae27201-47c6-4255-bdb9-c933273636db" (UID: "aae27201-47c6-4255-bdb9-c933273636db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:01:29.707589 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.707562    2549 generic.go:356] "Generic (PLEG): container finished" podID="aae27201-47c6-4255-bdb9-c933273636db" containerID="4130e2f34e62b79f37fd1bd784223696690fd50ccbd635bc4812aa6dd66d6b9a" exitCode=0
Sep 16 13:01:29.707703 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.707612    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" event={"ID":"aae27201-47c6-4255-bdb9-c933273636db","Type":"ContainerDied","Data":"4130e2f34e62b79f37fd1bd784223696690fd50ccbd635bc4812aa6dd66d6b9a"}
Sep 16 13:01:29.707703 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.707618    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"
Sep 16 13:01:29.707703 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.707662    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr" event={"ID":"aae27201-47c6-4255-bdb9-c933273636db","Type":"ContainerDied","Data":"eeb7b1e5c627ca5984e01a9f73fcc9894530d6c50dea00d0ab01d2baf0d2ceee"}
Sep 16 13:01:29.707703 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.707693    2549 scope.go:117] "RemoveContainer" containerID="4130e2f34e62b79f37fd1bd784223696690fd50ccbd635bc4812aa6dd66d6b9a"
Sep 16 13:01:29.717023 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.717007    2549 scope.go:117] "RemoveContainer" containerID="16daaafc011d9a1f1bb7bb635fc3c4532f9b64e05cb764df14c906235072d722"
Sep 16 13:01:29.726130 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.726112    2549 scope.go:117] "RemoveContainer" containerID="4130e2f34e62b79f37fd1bd784223696690fd50ccbd635bc4812aa6dd66d6b9a"
Sep 16 13:01:29.726388 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:29.726370    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4130e2f34e62b79f37fd1bd784223696690fd50ccbd635bc4812aa6dd66d6b9a\": container with ID starting with 4130e2f34e62b79f37fd1bd784223696690fd50ccbd635bc4812aa6dd66d6b9a not found: ID does not exist" containerID="4130e2f34e62b79f37fd1bd784223696690fd50ccbd635bc4812aa6dd66d6b9a"
Sep 16 13:01:29.726437 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.726397    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4130e2f34e62b79f37fd1bd784223696690fd50ccbd635bc4812aa6dd66d6b9a"} err="failed to get container status \"4130e2f34e62b79f37fd1bd784223696690fd50ccbd635bc4812aa6dd66d6b9a\": rpc error: code = NotFound desc = could not find container \"4130e2f34e62b79f37fd1bd784223696690fd50ccbd635bc4812aa6dd66d6b9a\": container with ID starting with 4130e2f34e62b79f37fd1bd784223696690fd50ccbd635bc4812aa6dd66d6b9a not found: ID does not exist"
Sep 16 13:01:29.726437 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.726416    2549 scope.go:117] "RemoveContainer" containerID="16daaafc011d9a1f1bb7bb635fc3c4532f9b64e05cb764df14c906235072d722"
Sep 16 13:01:29.726659 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:29.726643    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16daaafc011d9a1f1bb7bb635fc3c4532f9b64e05cb764df14c906235072d722\": container with ID starting with 16daaafc011d9a1f1bb7bb635fc3c4532f9b64e05cb764df14c906235072d722 not found: ID does not exist" containerID="16daaafc011d9a1f1bb7bb635fc3c4532f9b64e05cb764df14c906235072d722"
Sep 16 13:01:29.726702 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.726665    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16daaafc011d9a1f1bb7bb635fc3c4532f9b64e05cb764df14c906235072d722"} err="failed to get container status \"16daaafc011d9a1f1bb7bb635fc3c4532f9b64e05cb764df14c906235072d722\": rpc error: code = NotFound desc = could not find container \"16daaafc011d9a1f1bb7bb635fc3c4532f9b64e05cb764df14c906235072d722\": container with ID starting with 16daaafc011d9a1f1bb7bb635fc3c4532f9b64e05cb764df14c906235072d722 not found: ID does not exist"
Sep 16 13:01:29.730651 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.730629    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"]
Sep 16 13:01:29.735331 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.735309    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-586bab-openshift-default-5df69d64c8-ms9pr"]
Sep 16 13:01:29.777382 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.777354    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aae27201-47c6-4255-bdb9-c933273636db-istio-podinfo\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:29.777382 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.777378    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-workload-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:29.777536 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.777392    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aae27201-47c6-4255-bdb9-c933273636db-istio-envoy\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:29.777536 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.777403    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aae27201-47c6-4255-bdb9-c933273636db-istiod-ca-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:29.777536 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.777415    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mg8p\" (UniqueName: \"kubernetes.io/projected/aae27201-47c6-4255-bdb9-c933273636db-kube-api-access-8mg8p\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:29.777536 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:29.777427    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aae27201-47c6-4255-bdb9-c933273636db-istio-token\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:30.012258 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:30.012227    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:30.841654 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:30.841618    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:30.922826 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:30.922792    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aae27201-47c6-4255-bdb9-c933273636db" path="/var/lib/kubelet/pods/aae27201-47c6-4255-bdb9-c933273636db/volumes"
Sep 16 13:01:31.647280 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:31.647249    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:32.734565 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:32.734527    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7541-b03e5a" event={"ID":"731af5d9-7657-419e-aa29-828a1c4393a6","Type":"ContainerStarted","Data":"8d9458e281794cd7edb12400901c9d2c542601466624f56a929312dd3092e8e4"}
Sep 16 13:01:32.766508 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:32.766393    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7541-b03e5a" podStartSLOduration=1.169520495 podStartE2EDuration="7.766378151s" totalImagesPullingTime="6.596857656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:01:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:01:32.763085728 +0000 UTC m=+1376.327906820" watchObservedRunningTime="2026-09-16 13:01:32.766378151 +0000 UTC m=+1376.331199273"
Sep 16 13:01:33.474751 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.474664    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7541-b03e5a"]
Sep 16 13:01:33.480130 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.480103    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7541-b03e5a"]
Sep 16 13:01:33.621789 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.621754    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7541-b196ab"]
Sep 16 13:01:33.622170 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.622158    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae27201-47c6-4255-bdb9-c933273636db" containerName="istio-proxy"
Sep 16 13:01:33.622224 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.622172    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae27201-47c6-4255-bdb9-c933273636db" containerName="istio-proxy"
Sep 16 13:01:33.622224 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.622184    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aae27201-47c6-4255-bdb9-c933273636db" containerName="istio-proxy"
Sep 16 13:01:33.622224 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.622189    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="aae27201-47c6-4255-bdb9-c933273636db" containerName="istio-proxy"
Sep 16 13:01:33.622224 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.622202    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="731af5d9-7657-419e-aa29-828a1c4393a6" containerName="test-curl-7541-b03e5a"
Sep 16 13:01:33.622224 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.622208    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="731af5d9-7657-419e-aa29-828a1c4393a6" containerName="test-curl-7541-b03e5a"
Sep 16 13:01:33.622379 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.622276    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="aae27201-47c6-4255-bdb9-c933273636db" containerName="istio-proxy"
Sep 16 13:01:33.622379 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.622286    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="731af5d9-7657-419e-aa29-828a1c4393a6" containerName="test-curl-7541-b03e5a"
Sep 16 13:01:33.622379 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.622292    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="aae27201-47c6-4255-bdb9-c933273636db" containerName="istio-proxy"
Sep 16 13:01:33.624677 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.624662    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:33.634899 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.634871    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7541-b196ab"]
Sep 16 13:01:33.713082 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.713053    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tssct\" (UniqueName: \"kubernetes.io/projected/ba812e35-977c-4f2b-9121-de2b04569265-kube-api-access-tssct\") pod \"test-curl-7541-b196ab\" (UID: \"ba812e35-977c-4f2b-9121-de2b04569265\") " pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:33.740081 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:33.740017    2549 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7541-b03e5a" container="test-curl-7541-b03e5a"
Sep 16 13:01:33.813802 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.813773    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tssct\" (UniqueName: \"kubernetes.io/projected/ba812e35-977c-4f2b-9121-de2b04569265-kube-api-access-tssct\") pod \"test-curl-7541-b196ab\" (UID: \"ba812e35-977c-4f2b-9121-de2b04569265\") " pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:33.824887 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.824864    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tssct\" (UniqueName: \"kubernetes.io/projected/ba812e35-977c-4f2b-9121-de2b04569265-kube-api-access-tssct\") pod \"test-curl-7541-b196ab\" (UID: \"ba812e35-977c-4f2b-9121-de2b04569265\") " pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:33.933948 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:33.933918    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:34.210797 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:34.210773    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7541-b196ab"]
Sep 16 13:01:34.211961 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:01:34.211934    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba812e35_977c_4f2b_9121_de2b04569265.slice/crio-8a8d9696b5e564bff9a1831f997b935594c2cf5121a487bf949316f00c6c35bc WatchSource:0}: Error finding container 8a8d9696b5e564bff9a1831f997b935594c2cf5121a487bf949316f00c6c35bc: Status 404 returned error can't find the container with id 8a8d9696b5e564bff9a1831f997b935594c2cf5121a487bf949316f00c6c35bc
Sep 16 13:01:34.746982 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:34.746947    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7541-b196ab" event={"ID":"ba812e35-977c-4f2b-9121-de2b04569265","Type":"ContainerStarted","Data":"09272bdb80178df8446e25fda4a9f737aefb58b3cad75f4b02e32cb04872c4ee"}
Sep 16 13:01:34.747368 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:34.746993    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7541-b196ab" event={"ID":"ba812e35-977c-4f2b-9121-de2b04569265","Type":"ContainerStarted","Data":"8a8d9696b5e564bff9a1831f997b935594c2cf5121a487bf949316f00c6c35bc"}
Sep 16 13:01:34.747368 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:34.747123    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7541-b03e5a" podUID="731af5d9-7657-419e-aa29-828a1c4393a6" containerName="test-curl-7541-b03e5a" containerID="cri-o://8d9458e281794cd7edb12400901c9d2c542601466624f56a929312dd3092e8e4" gracePeriod=2
Sep 16 13:01:34.767292 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:34.767244    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7541-b196ab" podStartSLOduration=1.767228318 podStartE2EDuration="1.767228318s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:01:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:01:34.767149233 +0000 UTC m=+1378.331970325" watchObservedRunningTime="2026-09-16 13:01:34.767228318 +0000 UTC m=+1378.332049408"
Sep 16 13:01:34.769233 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:34.769208    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-b03e5a\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="731af5d9-7657-419e-aa29-828a1c4393a6" pod="opendatahub/test-curl-7541-b03e5a"
Sep 16 13:01:35.063248 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.063175    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:35.463980 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.463944    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7541-b196ab"]
Sep 16 13:01:35.467273 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.467243    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7541-b196ab"]
Sep 16 13:01:35.599903 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.599868    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7541-2a60ed"]
Sep 16 13:01:35.600277 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.600262    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba812e35-977c-4f2b-9121-de2b04569265" containerName="test-curl-7541-b196ab"
Sep 16 13:01:35.600277 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.600275    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba812e35-977c-4f2b-9121-de2b04569265" containerName="test-curl-7541-b196ab"
Sep 16 13:01:35.600495 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.600344    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba812e35-977c-4f2b-9121-de2b04569265" containerName="test-curl-7541-b196ab"
Sep 16 13:01:35.602573 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.602555    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-2a60ed"
Sep 16 13:01:35.613320 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.613299    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7541-2a60ed"]
Sep 16 13:01:35.741363 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.741276    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqz9z\" (UniqueName: \"kubernetes.io/projected/87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a-kube-api-access-pqz9z\") pod \"test-curl-7541-2a60ed\" (UID: \"87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a\") " pod="opendatahub/test-curl-7541-2a60ed"
Sep 16 13:01:35.752212 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:35.752174    2549 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7541-b196ab" container="test-curl-7541-b196ab"
Sep 16 13:01:35.811515 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.811468    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"]
Sep 16 13:01:35.811733 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.811714    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj" podUID="3c056e39-59b3-4324-8dfb-0dc41b30be30" containerName="maas-api" containerID="cri-o://0a73e944f2b566394a8cabfa10d70fcf3509672f7afdaad08d52525c5b72ffbd" gracePeriod=30
Sep 16 13:01:35.834684 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.834636    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:35.841817 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.841791    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqz9z\" (UniqueName: \"kubernetes.io/projected/87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a-kube-api-access-pqz9z\") pod \"test-curl-7541-2a60ed\" (UID: \"87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a\") " pod="opendatahub/test-curl-7541-2a60ed"
Sep 16 13:01:35.851306 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.851276    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqz9z\" (UniqueName: \"kubernetes.io/projected/87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a-kube-api-access-pqz9z\") pod \"test-curl-7541-2a60ed\" (UID: \"87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a\") " pod="opendatahub/test-curl-7541-2a60ed"
Sep 16 13:01:35.912112 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.912081    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-2a60ed"
Sep 16 13:01:35.939104 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:35.938897    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:36.035516 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.035487    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:36.095529 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.095139    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 13:01:36.129455 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.129421    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:36.190421 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.190393    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7541-2a60ed"]
Sep 16 13:01:36.191927 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:01:36.191904    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87cf1226_5a53_4b4d_8bcc_d8c2d0a4e19a.slice/crio-4b84a2e1b44d7b9c70f8be8ee095521258e681447e47793fd6f180f10dd77c89 WatchSource:0}: Error finding container 4b84a2e1b44d7b9c70f8be8ee095521258e681447e47793fd6f180f10dd77c89: Status 404 returned error can't find the container with id 4b84a2e1b44d7b9c70f8be8ee095521258e681447e47793fd6f180f10dd77c89
Sep 16 13:01:36.204594 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.204562    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:36.245028 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.245001    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-metrics-certs\") pod \"3c056e39-59b3-4324-8dfb-0dc41b30be30\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") "
Sep 16 13:01:36.245164 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.245063    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c056e39-59b3-4324-8dfb-0dc41b30be30-openshift-service-ca\") pod \"3c056e39-59b3-4324-8dfb-0dc41b30be30\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") "
Sep 16 13:01:36.245228 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.245119    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cd7q\" (UniqueName: \"kubernetes.io/projected/3c056e39-59b3-4324-8dfb-0dc41b30be30-kube-api-access-4cd7q\") pod \"3c056e39-59b3-4324-8dfb-0dc41b30be30\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") "
Sep 16 13:01:36.245403 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.245379    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-maas-api-tls\") pod \"3c056e39-59b3-4324-8dfb-0dc41b30be30\" (UID: \"3c056e39-59b3-4324-8dfb-0dc41b30be30\") "
Sep 16 13:01:36.245575 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.245543    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c056e39-59b3-4324-8dfb-0dc41b30be30-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c056e39-59b3-4324-8dfb-0dc41b30be30" (UID: "3c056e39-59b3-4324-8dfb-0dc41b30be30"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:01:36.245990 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.245965    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c056e39-59b3-4324-8dfb-0dc41b30be30-openshift-service-ca\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:36.247921 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.247841    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3c056e39-59b3-4324-8dfb-0dc41b30be30" (UID: "3c056e39-59b3-4324-8dfb-0dc41b30be30"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:01:36.248134 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.248112    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c056e39-59b3-4324-8dfb-0dc41b30be30-kube-api-access-4cd7q" (OuterVolumeSpecName: "kube-api-access-4cd7q") pod "3c056e39-59b3-4324-8dfb-0dc41b30be30" (UID: "3c056e39-59b3-4324-8dfb-0dc41b30be30"). InnerVolumeSpecName "kube-api-access-4cd7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:01:36.248240 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.248212    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c056e39-59b3-4324-8dfb-0dc41b30be30" (UID: "3c056e39-59b3-4324-8dfb-0dc41b30be30"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:01:36.347122 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.347028    2549 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-metrics-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:36.347122 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.347056    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cd7q\" (UniqueName: \"kubernetes.io/projected/3c056e39-59b3-4324-8dfb-0dc41b30be30-kube-api-access-4cd7q\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:36.347122 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.347066    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c056e39-59b3-4324-8dfb-0dc41b30be30-maas-api-tls\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:36.545085 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.545052    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:36.649583 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.649504    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:36.759402 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.759373    2549 generic.go:356] "Generic (PLEG): container finished" podID="3c056e39-59b3-4324-8dfb-0dc41b30be30" containerID="0a73e944f2b566394a8cabfa10d70fcf3509672f7afdaad08d52525c5b72ffbd" exitCode=0
Sep 16 13:01:36.759778 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.759417    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"
Sep 16 13:01:36.759778 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.759468    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj" event={"ID":"3c056e39-59b3-4324-8dfb-0dc41b30be30","Type":"ContainerDied","Data":"0a73e944f2b566394a8cabfa10d70fcf3509672f7afdaad08d52525c5b72ffbd"}
Sep 16 13:01:36.759778 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.759555    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj" event={"ID":"3c056e39-59b3-4324-8dfb-0dc41b30be30","Type":"ContainerDied","Data":"1513e9efe1118843bcb3dd1fb21ec85674fa5767f5c98f62bf0b07d9cc818170"}
Sep 16 13:01:36.759778 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.759590    2549 scope.go:117] "RemoveContainer" containerID="0a73e944f2b566394a8cabfa10d70fcf3509672f7afdaad08d52525c5b72ffbd"
Sep 16 13:01:36.765922 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.765297    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7541-2a60ed" event={"ID":"87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a","Type":"ContainerStarted","Data":"390fec4ac0690ec20da2c16cfa4633d46610bb5357476a5aa9a59e2ea679bb34"}
Sep 16 13:01:36.765922 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.765336    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7541-2a60ed" event={"ID":"87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a","Type":"ContainerStarted","Data":"4b84a2e1b44d7b9c70f8be8ee095521258e681447e47793fd6f180f10dd77c89"}
Sep 16 13:01:36.765922 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.765347    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7541-b196ab" podUID="ba812e35-977c-4f2b-9121-de2b04569265" containerName="test-curl-7541-b196ab" containerID="cri-o://09272bdb80178df8446e25fda4a9f737aefb58b3cad75f4b02e32cb04872c4ee" gracePeriod=2
Sep 16 13:01:36.785155 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:36.784890    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-b196ab\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="ba812e35-977c-4f2b-9121-de2b04569265" pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:36.786173 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.786122    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7541-2a60ed" podStartSLOduration=1.78610515 podStartE2EDuration="1.78610515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:01:36.782636399 +0000 UTC m=+1380.347457492" watchObservedRunningTime="2026-09-16 13:01:36.78610515 +0000 UTC m=+1380.350926261"
Sep 16 13:01:36.787017 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:36.786939    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-b196ab\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="ba812e35-977c-4f2b-9121-de2b04569265" pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:36.788766 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:36.788742    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-b196ab\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="ba812e35-977c-4f2b-9121-de2b04569265" pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:36.789361 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.789343    2549 scope.go:117] "RemoveContainer" containerID="0a73e944f2b566394a8cabfa10d70fcf3509672f7afdaad08d52525c5b72ffbd"
Sep 16 13:01:36.789719 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:36.789698    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a73e944f2b566394a8cabfa10d70fcf3509672f7afdaad08d52525c5b72ffbd\": container with ID starting with 0a73e944f2b566394a8cabfa10d70fcf3509672f7afdaad08d52525c5b72ffbd not found: ID does not exist" containerID="0a73e944f2b566394a8cabfa10d70fcf3509672f7afdaad08d52525c5b72ffbd"
Sep 16 13:01:36.789775 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.789729    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a73e944f2b566394a8cabfa10d70fcf3509672f7afdaad08d52525c5b72ffbd"} err="failed to get container status \"0a73e944f2b566394a8cabfa10d70fcf3509672f7afdaad08d52525c5b72ffbd\": rpc error: code = NotFound desc = could not find container \"0a73e944f2b566394a8cabfa10d70fcf3509672f7afdaad08d52525c5b72ffbd\": container with ID starting with 0a73e944f2b566394a8cabfa10d70fcf3509672f7afdaad08d52525c5b72ffbd not found: ID does not exist"
Sep 16 13:01:36.803326 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.803302    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"]
Sep 16 13:01:36.809609 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.809585    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-89d6bf-78f699c84f-t62jj"]
Sep 16 13:01:36.895878 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.895856    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-b03e5a"
Sep 16 13:01:36.898350 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:36.898326    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-b196ab\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="ba812e35-977c-4f2b-9121-de2b04569265" pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:36.919394 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:36.919361    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-b196ab\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="ba812e35-977c-4f2b-9121-de2b04569265" pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:36.921145 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:36.921123    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c056e39-59b3-4324-8dfb-0dc41b30be30" path="/var/lib/kubelet/pods/3c056e39-59b3-4324-8dfb-0dc41b30be30/volumes"
Sep 16 13:01:37.053702 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.053675    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnntf\" (UniqueName: \"kubernetes.io/projected/731af5d9-7657-419e-aa29-828a1c4393a6-kube-api-access-jnntf\") pod \"731af5d9-7657-419e-aa29-828a1c4393a6\" (UID: \"731af5d9-7657-419e-aa29-828a1c4393a6\") "
Sep 16 13:01:37.055562 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.055539    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/731af5d9-7657-419e-aa29-828a1c4393a6-kube-api-access-jnntf" (OuterVolumeSpecName: "kube-api-access-jnntf") pod "731af5d9-7657-419e-aa29-828a1c4393a6" (UID: "731af5d9-7657-419e-aa29-828a1c4393a6"). InnerVolumeSpecName "kube-api-access-jnntf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:01:37.154934 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.154901    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnntf\" (UniqueName: \"kubernetes.io/projected/731af5d9-7657-419e-aa29-828a1c4393a6-kube-api-access-jnntf\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:37.463472 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.463439    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7541-2a60ed"]
Sep 16 13:01:37.468751 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.468674    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7541-2a60ed"]
Sep 16 13:01:37.618961 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.618925    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7541-a0e545"]
Sep 16 13:01:37.619372 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.619357    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c056e39-59b3-4324-8dfb-0dc41b30be30" containerName="maas-api"
Sep 16 13:01:37.619416 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.619374    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c056e39-59b3-4324-8dfb-0dc41b30be30" containerName="maas-api"
Sep 16 13:01:37.619416 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.619399    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a" containerName="test-curl-7541-2a60ed"
Sep 16 13:01:37.619416 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.619404    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a" containerName="test-curl-7541-2a60ed"
Sep 16 13:01:37.619555 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.619485    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a" containerName="test-curl-7541-2a60ed"
Sep 16 13:01:37.619555 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.619498    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c056e39-59b3-4324-8dfb-0dc41b30be30" containerName="maas-api"
Sep 16 13:01:37.622566 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.622541    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-a0e545"
Sep 16 13:01:37.623684 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.623656    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:37.639054 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.639027    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7541-a0e545"]
Sep 16 13:01:37.760355 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.760277    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsm2q\" (UniqueName: \"kubernetes.io/projected/91b17b49-a967-49ce-a0e8-3154fd8aa2a7-kube-api-access-tsm2q\") pod \"test-curl-7541-a0e545\" (UID: \"91b17b49-a967-49ce-a0e8-3154fd8aa2a7\") " pod="opendatahub/test-curl-7541-a0e545"
Sep 16 13:01:37.771665 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.771631    2549 generic.go:356] "Generic (PLEG): container finished" podID="731af5d9-7657-419e-aa29-828a1c4393a6" containerID="8d9458e281794cd7edb12400901c9d2c542601466624f56a929312dd3092e8e4" exitCode=137
Sep 16 13:01:37.771774 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.771708    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-b03e5a"
Sep 16 13:01:37.771810 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.771711    2549 scope.go:117] "RemoveContainer" containerID="8d9458e281794cd7edb12400901c9d2c542601466624f56a929312dd3092e8e4"
Sep 16 13:01:37.772009 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:37.771993    2549 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7541-2a60ed" container="test-curl-7541-2a60ed"
Sep 16 13:01:37.781276 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.781259    2549 scope.go:117] "RemoveContainer" containerID="8d9458e281794cd7edb12400901c9d2c542601466624f56a929312dd3092e8e4"
Sep 16 13:01:37.781555 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:37.781537    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d9458e281794cd7edb12400901c9d2c542601466624f56a929312dd3092e8e4\": container with ID starting with 8d9458e281794cd7edb12400901c9d2c542601466624f56a929312dd3092e8e4 not found: ID does not exist" containerID="8d9458e281794cd7edb12400901c9d2c542601466624f56a929312dd3092e8e4"
Sep 16 13:01:37.781606 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.781564    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d9458e281794cd7edb12400901c9d2c542601466624f56a929312dd3092e8e4"} err="failed to get container status \"8d9458e281794cd7edb12400901c9d2c542601466624f56a929312dd3092e8e4\": rpc error: code = NotFound desc = could not find container \"8d9458e281794cd7edb12400901c9d2c542601466624f56a929312dd3092e8e4\": container with ID starting with 8d9458e281794cd7edb12400901c9d2c542601466624f56a929312dd3092e8e4 not found: ID does not exist"
Sep 16 13:01:37.861612 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.861589    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsm2q\" (UniqueName: \"kubernetes.io/projected/91b17b49-a967-49ce-a0e8-3154fd8aa2a7-kube-api-access-tsm2q\") pod \"test-curl-7541-a0e545\" (UID: \"91b17b49-a967-49ce-a0e8-3154fd8aa2a7\") " pod="opendatahub/test-curl-7541-a0e545"
Sep 16 13:01:37.870681 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.870653    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsm2q\" (UniqueName: \"kubernetes.io/projected/91b17b49-a967-49ce-a0e8-3154fd8aa2a7-kube-api-access-tsm2q\") pod \"test-curl-7541-a0e545\" (UID: \"91b17b49-a967-49ce-a0e8-3154fd8aa2a7\") " pod="opendatahub/test-curl-7541-a0e545"
Sep 16 13:01:37.931743 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:37.931712    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-a0e545"
Sep 16 13:01:38.208815 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:38.208789    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7541-a0e545"]
Sep 16 13:01:38.209675 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:01:38.209646    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91b17b49_a967_49ce_a0e8_3154fd8aa2a7.slice/crio-c0ae0dfd36bad329820a74f8aa39f49b492010abc4da13ebb9704e523f8445b0 WatchSource:0}: Error finding container c0ae0dfd36bad329820a74f8aa39f49b492010abc4da13ebb9704e523f8445b0: Status 404 returned error can't find the container with id c0ae0dfd36bad329820a74f8aa39f49b492010abc4da13ebb9704e523f8445b0
Sep 16 13:01:38.445257 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:38.445227    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:38.778834 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:38.778800    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7541-a0e545" event={"ID":"91b17b49-a967-49ce-a0e8-3154fd8aa2a7","Type":"ContainerStarted","Data":"3a723506bc175b5c2b874f7648f6294cbe619af340d876bf4e9e77f7abb8e8c2"}
Sep 16 13:01:38.779200 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:38.778856    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7541-a0e545" event={"ID":"91b17b49-a967-49ce-a0e8-3154fd8aa2a7","Type":"ContainerStarted","Data":"c0ae0dfd36bad329820a74f8aa39f49b492010abc4da13ebb9704e523f8445b0"}
Sep 16 13:01:38.779899 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:38.779876    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7541-2a60ed" podUID="87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a" containerName="test-curl-7541-2a60ed" containerID="cri-o://390fec4ac0690ec20da2c16cfa4633d46610bb5357476a5aa9a59e2ea679bb34" gracePeriod=2
Sep 16 13:01:38.802270 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:38.802228    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-2a60ed\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a" pod="opendatahub/test-curl-7541-2a60ed"
Sep 16 13:01:38.803043 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:38.803006    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7541-a0e545" podStartSLOduration=1.802990971 podStartE2EDuration="1.802990971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:01:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:01:38.799882518 +0000 UTC m=+1382.364703606" watchObservedRunningTime="2026-09-16 13:01:38.802990971 +0000 UTC m=+1382.367812110"
Sep 16 13:01:38.936021 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:38.935988    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="731af5d9-7657-419e-aa29-828a1c4393a6" path="/var/lib/kubelet/pods/731af5d9-7657-419e-aa29-828a1c4393a6/volumes"
Sep 16 13:01:38.955252 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:38.955231    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:39.072096 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:39.072018    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tssct\" (UniqueName: \"kubernetes.io/projected/ba812e35-977c-4f2b-9121-de2b04569265-kube-api-access-tssct\") pod \"ba812e35-977c-4f2b-9121-de2b04569265\" (UID: \"ba812e35-977c-4f2b-9121-de2b04569265\") "
Sep 16 13:01:39.074132 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:39.074103    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba812e35-977c-4f2b-9121-de2b04569265-kube-api-access-tssct" (OuterVolumeSpecName: "kube-api-access-tssct") pod "ba812e35-977c-4f2b-9121-de2b04569265" (UID: "ba812e35-977c-4f2b-9121-de2b04569265"). InnerVolumeSpecName "kube-api-access-tssct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:01:39.173457 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:39.173412    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tssct\" (UniqueName: \"kubernetes.io/projected/ba812e35-977c-4f2b-9121-de2b04569265-kube-api-access-tssct\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:39.466517 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:39.466459    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:39.473966 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:39.473939    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7541-a0e545"]
Sep 16 13:01:39.481253 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:39.481227    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7541-a0e545"]
Sep 16 13:01:39.786314 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:39.786225    2549 generic.go:356] "Generic (PLEG): container finished" podID="ba812e35-977c-4f2b-9121-de2b04569265" containerID="09272bdb80178df8446e25fda4a9f737aefb58b3cad75f4b02e32cb04872c4ee" exitCode=137
Sep 16 13:01:39.786314 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:39.786271    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:39.786822 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:39.786324    2549 scope.go:117] "RemoveContainer" containerID="09272bdb80178df8446e25fda4a9f737aefb58b3cad75f4b02e32cb04872c4ee"
Sep 16 13:01:39.786822 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:39.786648    2549 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7541-a0e545" container="test-curl-7541-a0e545"
Sep 16 13:01:39.795664 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:39.795645    2549 scope.go:117] "RemoveContainer" containerID="09272bdb80178df8446e25fda4a9f737aefb58b3cad75f4b02e32cb04872c4ee"
Sep 16 13:01:39.795924 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:39.795907    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09272bdb80178df8446e25fda4a9f737aefb58b3cad75f4b02e32cb04872c4ee\": container with ID starting with 09272bdb80178df8446e25fda4a9f737aefb58b3cad75f4b02e32cb04872c4ee not found: ID does not exist" containerID="09272bdb80178df8446e25fda4a9f737aefb58b3cad75f4b02e32cb04872c4ee"
Sep 16 13:01:39.795970 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:39.795934    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09272bdb80178df8446e25fda4a9f737aefb58b3cad75f4b02e32cb04872c4ee"} err="failed to get container status \"09272bdb80178df8446e25fda4a9f737aefb58b3cad75f4b02e32cb04872c4ee\": rpc error: code = NotFound desc = could not find container \"09272bdb80178df8446e25fda4a9f737aefb58b3cad75f4b02e32cb04872c4ee\": container with ID starting with 09272bdb80178df8446e25fda4a9f737aefb58b3cad75f4b02e32cb04872c4ee not found: ID does not exist"
Sep 16 13:01:39.796309 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:39.796289    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-b196ab\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="ba812e35-977c-4f2b-9121-de2b04569265" pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:40.199366 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.199333    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:40.380291 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.380253    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:40.513572 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.508945    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"]
Sep 16 13:01:40.513572 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.509544    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91b17b49-a967-49ce-a0e8-3154fd8aa2a7" containerName="test-curl-7541-a0e545"
Sep 16 13:01:40.513572 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.509565    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="91b17b49-a967-49ce-a0e8-3154fd8aa2a7" containerName="test-curl-7541-a0e545"
Sep 16 13:01:40.513572 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.509658    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="91b17b49-a967-49ce-a0e8-3154fd8aa2a7" containerName="test-curl-7541-a0e545"
Sep 16 13:01:40.513572 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.513381    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.516398 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:40.516356    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-b196ab\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="ba812e35-977c-4f2b-9121-de2b04569265" pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:40.517607 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.517586    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-524adf28-openshift-default-dockercfg-kv4q8\""
Sep 16 13:01:40.527094 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.527058    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"]
Sep 16 13:01:40.529612 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.529587    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:40.686387 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.686347    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istiod-ca-cert\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.686591 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.686403    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-workload-certs\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.686591 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.686436    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-data\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.686591 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.686467    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbs97\" (UniqueName: \"kubernetes.io/projected/b5febaf0-5829-4c34-a8f6-4d3e479092c4-kube-api-access-kbs97\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.686591 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.686552    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-credential-socket\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.686591 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.686577    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-workload-socket\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.686798 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.686594    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-envoy\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.686798 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.686629    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-token\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.686798 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.686694    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-podinfo\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.787447 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.787420    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-workload-certs\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.787815 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.787455    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-data\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.787815 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.787493    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbs97\" (UniqueName: \"kubernetes.io/projected/b5febaf0-5829-4c34-a8f6-4d3e479092c4-kube-api-access-kbs97\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.787815 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.787537    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-credential-socket\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.787815 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.787567    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-workload-socket\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.787815 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.787591    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-envoy\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.787815 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.787632    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-token\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.787815 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.787691    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-podinfo\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.787815 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.787762    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istiod-ca-cert\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.787815 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.787791    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-data\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.788257 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.787836    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-workload-certs\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.788257 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.788047    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-workload-socket\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.788359 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.788338    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-credential-socket\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.788429 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.788405    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istiod-ca-cert\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.794551 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.791305    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-envoy\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.794551 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.791427    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-podinfo\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.802053 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.802029    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-token\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.802265 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.802240    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbs97\" (UniqueName: \"kubernetes.io/projected/b5febaf0-5829-4c34-a8f6-4d3e479092c4-kube-api-access-kbs97\") pod \"e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") " pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.802387 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.802358    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7541-a0e545" podUID="91b17b49-a967-49ce-a0e8-3154fd8aa2a7" containerName="test-curl-7541-a0e545" containerID="cri-o://3a723506bc175b5c2b874f7648f6294cbe619af340d876bf4e9e77f7abb8e8c2" gracePeriod=2
Sep 16 13:01:40.807427 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:40.807400    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-a0e545\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="91b17b49-a967-49ce-a0e8-3154fd8aa2a7" pod="opendatahub/test-curl-7541-a0e545"
Sep 16 13:01:40.809539 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:40.809504    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-b196ab\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="ba812e35-977c-4f2b-9121-de2b04569265" pod="opendatahub/test-curl-7541-b196ab"
Sep 16 13:01:40.825873 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.825850    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:40.898407 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.898374    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:40.921763 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.921728    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba812e35-977c-4f2b-9121-de2b04569265" path="/var/lib/kubelet/pods/ba812e35-977c-4f2b-9121-de2b04569265/volumes"
Sep 16 13:01:40.956715 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:40.956694    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-2a60ed"
Sep 16 13:01:41.090691 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.090617    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqz9z\" (UniqueName: \"kubernetes.io/projected/87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a-kube-api-access-pqz9z\") pod \"87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a\" (UID: \"87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a\") "
Sep 16 13:01:41.092741 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.092715    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a-kube-api-access-pqz9z" (OuterVolumeSpecName: "kube-api-access-pqz9z") pod "87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a" (UID: "87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a"). InnerVolumeSpecName "kube-api-access-pqz9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:01:41.126547 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.126525    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"]
Sep 16 13:01:41.128819 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:01:41.128797    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5febaf0_5829_4c34_a8f6_4d3e479092c4.slice/crio-e1e565f7fc66b04479b8c78ccbf33c8a8a4f5349df0b6b86d33ada992f044672 WatchSource:0}: Error finding container e1e565f7fc66b04479b8c78ccbf33c8a8a4f5349df0b6b86d33ada992f044672: Status 404 returned error can't find the container with id e1e565f7fc66b04479b8c78ccbf33c8a8a4f5349df0b6b86d33ada992f044672
Sep 16 13:01:41.131170 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.131136    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:01:41.131241 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.131202    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:01:41.131241 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.131230    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:01:41.191727 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.191703    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqz9z\" (UniqueName: \"kubernetes.io/projected/87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a-kube-api-access-pqz9z\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:41.809206 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.809173    2549 generic.go:356] "Generic (PLEG): container finished" podID="87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a" containerID="390fec4ac0690ec20da2c16cfa4633d46610bb5357476a5aa9a59e2ea679bb34" exitCode=137
Sep 16 13:01:41.809622 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.809220    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-2a60ed"
Sep 16 13:01:41.809622 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.809280    2549 scope.go:117] "RemoveContainer" containerID="390fec4ac0690ec20da2c16cfa4633d46610bb5357476a5aa9a59e2ea679bb34"
Sep 16 13:01:41.811086 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.811064    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f" event={"ID":"b5febaf0-5829-4c34-a8f6-4d3e479092c4","Type":"ContainerStarted","Data":"7a27b43a1b2ddaea37f65350358a4d97bb1cd6dcf177228b36be963581342677"}
Sep 16 13:01:41.811193 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.811111    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f" event={"ID":"b5febaf0-5829-4c34-a8f6-4d3e479092c4","Type":"ContainerStarted","Data":"e1e565f7fc66b04479b8c78ccbf33c8a8a4f5349df0b6b86d33ada992f044672"}
Sep 16 13:01:41.818552 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.818533    2549 scope.go:117] "RemoveContainer" containerID="390fec4ac0690ec20da2c16cfa4633d46610bb5357476a5aa9a59e2ea679bb34"
Sep 16 13:01:41.818803 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:41.818784    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"390fec4ac0690ec20da2c16cfa4633d46610bb5357476a5aa9a59e2ea679bb34\": container with ID starting with 390fec4ac0690ec20da2c16cfa4633d46610bb5357476a5aa9a59e2ea679bb34 not found: ID does not exist" containerID="390fec4ac0690ec20da2c16cfa4633d46610bb5357476a5aa9a59e2ea679bb34"
Sep 16 13:01:41.818855 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.818811    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"390fec4ac0690ec20da2c16cfa4633d46610bb5357476a5aa9a59e2ea679bb34"} err="failed to get container status \"390fec4ac0690ec20da2c16cfa4633d46610bb5357476a5aa9a59e2ea679bb34\": rpc error: code = NotFound desc = could not find container \"390fec4ac0690ec20da2c16cfa4633d46610bb5357476a5aa9a59e2ea679bb34\": container with ID starting with 390fec4ac0690ec20da2c16cfa4633d46610bb5357476a5aa9a59e2ea679bb34 not found: ID does not exist"
Sep 16 13:01:41.826934 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.826913    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:41.834213 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:41.834175    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f" podStartSLOduration=1.8341632049999999 podStartE2EDuration="1.834163205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:01:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:01:41.832675298 +0000 UTC m=+1385.397496388" watchObservedRunningTime="2026-09-16 13:01:41.834163205 +0000 UTC m=+1385.398984315"
Sep 16 13:01:41.834771 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:41.834749    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-2a60ed\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a" pod="opendatahub/test-curl-7541-2a60ed"
Sep 16 13:01:42.822354 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:42.822322    2549 generic.go:356] "Generic (PLEG): container finished" podID="91b17b49-a967-49ce-a0e8-3154fd8aa2a7" containerID="3a723506bc175b5c2b874f7648f6294cbe619af340d876bf4e9e77f7abb8e8c2" exitCode=137
Sep 16 13:01:42.832250 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:42.832227    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:42.856942 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:42.856910    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-2a60ed\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a" pod="opendatahub/test-curl-7541-2a60ed"
Sep 16 13:01:42.921814 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:42.921788    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a" path="/var/lib/kubelet/pods/87cf1226-5a53-4b4d-8bcc-d8c2d0a4e19a/volumes"
Sep 16 13:01:42.948343 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:42.948319    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-a0e545"
Sep 16 13:01:43.109140 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:43.109053    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsm2q\" (UniqueName: \"kubernetes.io/projected/91b17b49-a967-49ce-a0e8-3154fd8aa2a7-kube-api-access-tsm2q\") pod \"91b17b49-a967-49ce-a0e8-3154fd8aa2a7\" (UID: \"91b17b49-a967-49ce-a0e8-3154fd8aa2a7\") "
Sep 16 13:01:43.111080 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:43.111050    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91b17b49-a967-49ce-a0e8-3154fd8aa2a7-kube-api-access-tsm2q" (OuterVolumeSpecName: "kube-api-access-tsm2q") pod "91b17b49-a967-49ce-a0e8-3154fd8aa2a7" (UID: "91b17b49-a967-49ce-a0e8-3154fd8aa2a7"). InnerVolumeSpecName "kube-api-access-tsm2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:01:43.210246 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:43.210215    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsm2q\" (UniqueName: \"kubernetes.io/projected/91b17b49-a967-49ce-a0e8-3154fd8aa2a7-kube-api-access-tsm2q\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:01:43.312021 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:43.311993    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:43.449335 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:43.449303    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:43.548036 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:43.547977    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:43.830417 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:43.830326    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7541-a0e545"
Sep 16 13:01:43.830417 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:43.830395    2549 scope.go:117] "RemoveContainer" containerID="3a723506bc175b5c2b874f7648f6294cbe619af340d876bf4e9e77f7abb8e8c2"
Sep 16 13:01:43.830936 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:43.830698    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:43.831880 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:43.831800    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:01:43.864120 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:43.864078    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-a0e545\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="91b17b49-a967-49ce-a0e8-3154fd8aa2a7" pod="opendatahub/test-curl-7541-a0e545"
Sep 16 13:01:43.889786 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:43.889749    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:44.009040 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.009012    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:44.094724 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.094631    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:44.478961 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.478927    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:44.580163 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.580129    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:44.816510 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.816415    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"]
Sep 16 13:01:44.820486 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.820459    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:44.822741 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:44.822710    2549 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7541-a0e545\" is forbidden: User \"system:node:ip-10-0-128-195.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-195.ec2.internal' and this object" podUID="91b17b49-a967-49ce-a0e8-3154fd8aa2a7" pod="opendatahub/test-curl-7541-a0e545"
Sep 16 13:01:44.823257 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.823238    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-1ef95c-openshift-default-dockercfg-dbfgn\""
Sep 16 13:01:44.837172 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.837150    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"]
Sep 16 13:01:44.854944 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.854909    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:44.935849 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.935815    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-podinfo\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:44.937193 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.937162    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istiod-ca-cert\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:44.937394 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.937371    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-credential-socket\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:44.937582 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.937564    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-envoy\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:44.937715 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.937700    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-workload-certs\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:44.937830 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.937812    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tvsv\" (UniqueName: \"kubernetes.io/projected/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-kube-api-access-6tvsv\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:44.937949 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.937934    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-workload-socket\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:44.938112 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.938099    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-token\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:44.938215 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.938203    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-data\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:44.950015 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:44.945774    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91b17b49-a967-49ce-a0e8-3154fd8aa2a7" path="/var/lib/kubelet/pods/91b17b49-a967-49ce-a0e8-3154fd8aa2a7/volumes"
Sep 16 13:01:45.039226 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.039174    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-podinfo\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.039226 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.039226    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istiod-ca-cert\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.039443 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.039253    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-credential-socket\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.039443 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.039283    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-envoy\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.039443 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.039322    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-workload-certs\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.039443 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.039351    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tvsv\" (UniqueName: \"kubernetes.io/projected/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-kube-api-access-6tvsv\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.039694 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.039650    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-workload-socket\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.039779 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.039761    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-token\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.039840 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.039774    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-credential-socket\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.039899 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.039847    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-data\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.040110 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.040054    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-workload-socket\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.040110 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.040085    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-workload-certs\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.040312 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.040174    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-data\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.040787 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.040766    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istiod-ca-cert\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.042052 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.042024    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-envoy\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.042132 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.042031    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-podinfo\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.062274 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.062245    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-token\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.062608 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.062587    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tvsv\" (UniqueName: \"kubernetes.io/projected/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-kube-api-access-6tvsv\") pod \"e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") " pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.131526 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.131457    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:45.409064 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.409029    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:45.421683 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.421659    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"]
Sep 16 13:01:45.421977 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:01:45.421955    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46ad49e_0aaf_4908_a1bc_07a0ff0771aa.slice/crio-6d411a411859dbf29ac53529c093adfe88367486abb189b4e5dc2ac9a1c814f7 WatchSource:0}: Error finding container 6d411a411859dbf29ac53529c093adfe88367486abb189b4e5dc2ac9a1c814f7: Status 404 returned error can't find the container with id 6d411a411859dbf29ac53529c093adfe88367486abb189b4e5dc2ac9a1c814f7
Sep 16 13:01:45.424205 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.424170    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:01:45.424311 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.424247    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:01:45.424311 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.424292    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:01:45.841579 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.841503    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:45.846428 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.846400    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml" event={"ID":"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa","Type":"ContainerStarted","Data":"6ed453b635badd25dded2b71b7e35238d9c6d6d3bf8f5be6f55e6d52fac9f04d"}
Sep 16 13:01:45.846569 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.846449    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml" event={"ID":"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa","Type":"ContainerStarted","Data":"6d411a411859dbf29ac53529c093adfe88367486abb189b4e5dc2ac9a1c814f7"}
Sep 16 13:01:45.893148 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:45.893096    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml" podStartSLOduration=1.8930780280000001 podStartE2EDuration="1.893078028s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:01:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:01:45.890553715 +0000 UTC m=+1389.455374808" watchObservedRunningTime="2026-09-16 13:01:45.893078028 +0000 UTC m=+1389.457899118"
Sep 16 13:01:46.132702 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:46.132608    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:46.138340 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:46.138317    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:46.743080 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:46.743053    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:46.852873 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:46.852842    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:46.854033 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:46.854005    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:01:47.679490 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:47.679457    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:47.942105 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:47.942001    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:48.030605 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.030573    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:48.736950 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.736917    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"]
Sep 16 13:01:48.739829 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.739808    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:48.742144 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.742123    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-524adf28-serving-cert\""
Sep 16 13:01:48.752374 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.752349    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"]
Sep 16 13:01:48.772471 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.772434    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cntlh\" (UniqueName: \"kubernetes.io/projected/818332fb-24f8-4e74-aac6-0bc1f907ef59-kube-api-access-cntlh\") pod \"maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:48.772636 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.772570    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/818332fb-24f8-4e74-aac6-0bc1f907ef59-maas-api-tls\") pod \"maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:48.772712 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.772692    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/818332fb-24f8-4e74-aac6-0bc1f907ef59-openshift-service-ca\") pod \"maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:48.772770 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.772745    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/818332fb-24f8-4e74-aac6-0bc1f907ef59-metrics-certs\") pod \"maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:48.774548 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.774521    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:48.873341 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.873307    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/818332fb-24f8-4e74-aac6-0bc1f907ef59-openshift-service-ca\") pod \"maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:48.873544 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.873364    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/818332fb-24f8-4e74-aac6-0bc1f907ef59-metrics-certs\") pod \"maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:48.873544 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.873420    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cntlh\" (UniqueName: \"kubernetes.io/projected/818332fb-24f8-4e74-aac6-0bc1f907ef59-kube-api-access-cntlh\") pod \"maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:48.873646 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.873611    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/818332fb-24f8-4e74-aac6-0bc1f907ef59-maas-api-tls\") pod \"maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:48.874036 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.874008    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/818332fb-24f8-4e74-aac6-0bc1f907ef59-openshift-service-ca\") pod \"maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:48.876050 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.876026    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/818332fb-24f8-4e74-aac6-0bc1f907ef59-maas-api-tls\") pod \"maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:48.876146 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.876050    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/818332fb-24f8-4e74-aac6-0bc1f907ef59-metrics-certs\") pod \"maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:48.876329 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.876312    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:48.881941 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.881917    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cntlh\" (UniqueName: \"kubernetes.io/projected/818332fb-24f8-4e74-aac6-0bc1f907ef59-kube-api-access-cntlh\") pod \"maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:48.978778 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:48.978749    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:49.053341 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:49.053265    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:49.331106 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:49.331074    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"]
Sep 16 13:01:49.333177 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:01:49.333141    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818332fb_24f8_4e74_aac6_0bc1f907ef59.slice/crio-f7ed916deb0d4999bb338e3eee1b9abb8e3e1eb3a22fe9a476cefd07260431c9 WatchSource:0}: Error finding container f7ed916deb0d4999bb338e3eee1b9abb8e3e1eb3a22fe9a476cefd07260431c9: Status 404 returned error can't find the container with id f7ed916deb0d4999bb338e3eee1b9abb8e3e1eb3a22fe9a476cefd07260431c9
Sep 16 13:01:49.441291 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:49.441261    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:49.544943 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:49.544914    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:49.869938 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:49.869898    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6" event={"ID":"818332fb-24f8-4e74-aac6-0bc1f907ef59","Type":"ContainerStarted","Data":"f7ed916deb0d4999bb338e3eee1b9abb8e3e1eb3a22fe9a476cefd07260431c9"}
Sep 16 13:01:50.047715 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.047677    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"]
Sep 16 13:01:50.050809 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.050413    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:50.053459 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.053438    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-1ef95c-serving-cert\""
Sep 16 13:01:50.067306 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.067276    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"]
Sep 16 13:01:50.086261 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.086216    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:50.086405 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.086311    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:50.086405 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.086360    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:50.086405 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.086395    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9x5m\" (UniqueName: \"kubernetes.io/projected/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-kube-api-access-t9x5m\") pod \"maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:50.087303 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.087279    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:50.187910 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.187875    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:50.188111 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.187976    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:50.188111 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.188022    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:50.188111 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.188064    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9x5m\" (UniqueName: \"kubernetes.io/projected/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-kube-api-access-t9x5m\") pod \"maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:50.188325 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:50.188191    2549 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-serving-cert: secret "maas-api-e2e-shared-a-w3-1ef95c-serving-cert" not found
Sep 16 13:01:50.188325 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:50.188286    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-maas-api-tls podName:d16bd2ec-b2cd-48a0-baec-aad1054a50c8 nodeName:}" failed. No retries permitted until 2026-09-16 13:01:50.688262078 +0000 UTC m=+1394.253083169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-maas-api-tls") pod "maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k" (UID: "d16bd2ec-b2cd-48a0-baec-aad1054a50c8") : secret "maas-api-e2e-shared-a-w3-1ef95c-serving-cert" not found
Sep 16 13:01:50.188983 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.188960    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:50.190407 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.190362    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:50.191018 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.190996    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:50.202407 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.202377    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9x5m\" (UniqueName: \"kubernetes.io/projected/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-kube-api-access-t9x5m\") pod \"maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:50.643563 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.643468    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:50.692788 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.692757    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:50.692958 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:50.692928    2549 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-serving-cert: secret "maas-api-e2e-shared-a-w3-1ef95c-serving-cert" not found
Sep 16 13:01:50.693065 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:01:50.693008    2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-maas-api-tls podName:d16bd2ec-b2cd-48a0-baec-aad1054a50c8 nodeName:}" failed. No retries permitted until 2026-09-16 13:01:51.692989046 +0000 UTC m=+1395.257810122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-maas-api-tls") pod "maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k" (UID: "d16bd2ec-b2cd-48a0-baec-aad1054a50c8") : secret "maas-api-e2e-shared-a-w3-1ef95c-serving-cert" not found
Sep 16 13:01:50.743080 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.743048    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:50.849061 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.849027    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"]
Sep 16 13:01:50.852340 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.852323    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"
Sep 16 13:01:50.854771 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.854744    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-1ef95c-dockercfg-jwk9n\""
Sep 16 13:01:50.854890 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.854749    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-1ef95c\""
Sep 16 13:01:50.865064 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.865042    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"]
Sep 16 13:01:50.878780 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.878755    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6" event={"ID":"818332fb-24f8-4e74-aac6-0bc1f907ef59","Type":"ContainerStarted","Data":"9d3b141fb0dcdf20f3f2bf0688e2f84723538f3b68ae9c7203689440c190ec30"}
Sep 16 13:01:50.878881 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.878821    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:50.894116 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.894052    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcqsv\" (UniqueName: \"kubernetes.io/projected/d8edbc8e-4ca8-4793-8b70-044026fdb01c-kube-api-access-xcqsv\") pod \"payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6\" (UID: \"d8edbc8e-4ca8-4793-8b70-044026fdb01c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"
Sep 16 13:01:50.894367 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.894349    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8edbc8e-4ca8-4793-8b70-044026fdb01c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6\" (UID: \"d8edbc8e-4ca8-4793-8b70-044026fdb01c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"
Sep 16 13:01:50.906184 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.906144    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6" podStartSLOduration=2.399179618 podStartE2EDuration="2.906132921s" totalImagesPullingTime="506.953303ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:01:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:01:50.904996167 +0000 UTC m=+1394.469817271" watchObservedRunningTime="2026-09-16 13:01:50.906132921 +0000 UTC m=+1394.470954071"
Sep 16 13:01:50.925991 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.925964    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:50.994901 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.994873    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8edbc8e-4ca8-4793-8b70-044026fdb01c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6\" (UID: \"d8edbc8e-4ca8-4793-8b70-044026fdb01c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"
Sep 16 13:01:50.995038 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.994916    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xcqsv\" (UniqueName: \"kubernetes.io/projected/d8edbc8e-4ca8-4793-8b70-044026fdb01c-kube-api-access-xcqsv\") pod \"payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6\" (UID: \"d8edbc8e-4ca8-4793-8b70-044026fdb01c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"
Sep 16 13:01:50.995541 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:50.995521    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8edbc8e-4ca8-4793-8b70-044026fdb01c-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6\" (UID: \"d8edbc8e-4ca8-4793-8b70-044026fdb01c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"
Sep 16 13:01:51.003809 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:51.003779    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcqsv\" (UniqueName: \"kubernetes.io/projected/d8edbc8e-4ca8-4793-8b70-044026fdb01c-kube-api-access-xcqsv\") pod \"payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6\" (UID: \"d8edbc8e-4ca8-4793-8b70-044026fdb01c\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"
Sep 16 13:01:51.163873 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:51.163840    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"
Sep 16 13:01:51.192053 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:51.192025    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:51.438541 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:51.438513    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"]
Sep 16 13:01:51.438994 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:01:51.438966    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8edbc8e_4ca8_4793_8b70_044026fdb01c.slice/crio-91d463502519d95a09fd0cdf1d76800c5bdc0f8d25597338891509d85cf9d65e WatchSource:0}: Error finding container 91d463502519d95a09fd0cdf1d76800c5bdc0f8d25597338891509d85cf9d65e: Status 404 returned error can't find the container with id 91d463502519d95a09fd0cdf1d76800c5bdc0f8d25597338891509d85cf9d65e
Sep 16 13:01:51.702256 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:51.702174    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:51.704561 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:51.704542    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:51.862147 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:51.862113    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:51.886347 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:51.886296    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6" event={"ID":"d8edbc8e-4ca8-4793-8b70-044026fdb01c","Type":"ContainerStarted","Data":"186ffa81587434ced6079a88e4cd592e869a9e7ed7eece918cd4674ef727b2b0"}
Sep 16 13:01:51.886533 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:51.886358    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6" event={"ID":"d8edbc8e-4ca8-4793-8b70-044026fdb01c","Type":"ContainerStarted","Data":"91d463502519d95a09fd0cdf1d76800c5bdc0f8d25597338891509d85cf9d65e"}
Sep 16 13:01:51.907960 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:51.907825    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6" podStartSLOduration=1.9078037989999999 podStartE2EDuration="1.907803799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:01:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:01:51.904656602 +0000 UTC m=+1395.469477693" watchObservedRunningTime="2026-09-16 13:01:51.907803799 +0000 UTC m=+1395.472624892"
Sep 16 13:01:52.052878 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:52.052794    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:52.149468 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:52.149444    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"]
Sep 16 13:01:52.151618 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:01:52.151583    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd16bd2ec_b2cd_48a0_baec_aad1054a50c8.slice/crio-a37866b2b7d042a924ed991f7fc7405aff58c843d6ccef9205cf3fbd8a41eeee WatchSource:0}: Error finding container a37866b2b7d042a924ed991f7fc7405aff58c843d6ccef9205cf3fbd8a41eeee: Status 404 returned error can't find the container with id a37866b2b7d042a924ed991f7fc7405aff58c843d6ccef9205cf3fbd8a41eeee
Sep 16 13:01:52.893844 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:52.893762    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k" event={"ID":"d16bd2ec-b2cd-48a0-baec-aad1054a50c8","Type":"ContainerStarted","Data":"924f4133242e7011288f5e32b6069ff5e9be4b73636d1d1010ed93fcfd8e6718"}
Sep 16 13:01:52.893844 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:52.893826    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k" event={"ID":"d16bd2ec-b2cd-48a0-baec-aad1054a50c8","Type":"ContainerStarted","Data":"a37866b2b7d042a924ed991f7fc7405aff58c843d6ccef9205cf3fbd8a41eeee"}
Sep 16 13:01:52.894228 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:52.893980    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:01:52.894228 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:52.894011    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"
Sep 16 13:01:52.918871 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:52.918825    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k" podStartSLOduration=2.4278441969999998 podStartE2EDuration="2.918809427s" totalImagesPullingTime="490.96523ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:01:52.915452387 +0000 UTC m=+1396.480273478" watchObservedRunningTime="2026-09-16 13:01:52.918809427 +0000 UTC m=+1396.483630517"
Sep 16 13:01:52.999309 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:52.999280    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:53.867150 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:53.867118    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:54.746735 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:54.746699    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:55.519068 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:55.519033    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:56.391070 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:56.391039    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:01:56.891864 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:56.891840    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:01:58.911102 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:01:58.911074    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:02:03.907919 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:03.907883    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"
Sep 16 13:02:08.043079 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:08.043041    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:10.132353 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:10.132316    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:11.375093 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:11.375059    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:12.476183 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:12.476136    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:13.052610 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.052577    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:13.399315 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.399190    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:13.755573 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.755540    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"]
Sep 16 13:02:13.758198 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.758178    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:13.760775 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.760759    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-e344f9-openshift-default-dockercfg-jjp72\""
Sep 16 13:02:13.774304 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.774278    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:13.776641 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.776620    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"]
Sep 16 13:02:13.832079 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.832044    2549 patch_prober.go:28] interesting pod/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 16 13:02:13.832242 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.832099    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f" podUID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 16 13:02:13.876014 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.875907    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:13.921058 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.921027    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-podinfo\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:13.921058 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.921061    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9037d6-9059-4509-a4aa-b00463ce3788-istiod-ca-cert\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:13.921250 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.921097    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-token\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:13.921250 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.921191    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-credential-socket\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:13.921250 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.921233    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-envoy\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:13.921409 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.921316    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-workload-certs\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:13.921409 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.921352    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4xp4\" (UniqueName: \"kubernetes.io/projected/fb9037d6-9059-4509-a4aa-b00463ce3788-kube-api-access-s4xp4\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:13.921556 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.921430    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-data\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:13.921556 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:13.921468    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-workload-socket\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.022556 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.022440    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-envoy\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.022556 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.022535    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-workload-certs\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.022779 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.022564    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4xp4\" (UniqueName: \"kubernetes.io/projected/fb9037d6-9059-4509-a4aa-b00463ce3788-kube-api-access-s4xp4\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.022779 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.022598    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-data\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.022779 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.022628    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-workload-socket\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.022779 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.022693    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-podinfo\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.022779 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.022719    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9037d6-9059-4509-a4aa-b00463ce3788-istiod-ca-cert\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.022779 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.022766    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-token\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.023087 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.022823    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-credential-socket\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.023087 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.022944    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-data\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.023087 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.023064    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-workload-certs\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.023328 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.023304    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-credential-socket\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.023411 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.023352    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-workload-socket\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.023675 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.023645    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9037d6-9059-4509-a4aa-b00463ce3788-istiod-ca-cert\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.024938 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.024910    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-envoy\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.025221 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.025198    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-podinfo\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.034791 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.034770    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-token\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.035643 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.035620    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4xp4\" (UniqueName: \"kubernetes.io/projected/fb9037d6-9059-4509-a4aa-b00463ce3788-kube-api-access-s4xp4\") pod \"e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") " pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.039747 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.039723    2549 generic.go:356] "Generic (PLEG): container finished" podID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerID="6ed453b635badd25dded2b71b7e35238d9c6d6d3bf8f5be6f55e6d52fac9f04d" exitCode=0
Sep 16 13:02:14.039824 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.039798    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml" event={"ID":"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa","Type":"ContainerDied","Data":"6ed453b635badd25dded2b71b7e35238d9c6d6d3bf8f5be6f55e6d52fac9f04d"}
Sep 16 13:02:14.040317 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.040297    2549 scope.go:117] "RemoveContainer" containerID="6ed453b635badd25dded2b71b7e35238d9c6d6d3bf8f5be6f55e6d52fac9f04d"
Sep 16 13:02:14.041674 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.041642    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:02:14.041771 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.041712    2549 generic.go:356] "Generic (PLEG): container finished" podID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerID="7a27b43a1b2ddaea37f65350358a4d97bb1cd6dcf177228b36be963581342677" exitCode=0
Sep 16 13:02:14.041771 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.041724    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:02:14.041885 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.041775    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:02:14.041885 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.041793    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f" event={"ID":"b5febaf0-5829-4c34-a8f6-4d3e479092c4","Type":"ContainerDied","Data":"7a27b43a1b2ddaea37f65350358a4d97bb1cd6dcf177228b36be963581342677"}
Sep 16 13:02:14.042180 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.042165    2549 scope.go:117] "RemoveContainer" containerID="7a27b43a1b2ddaea37f65350358a4d97bb1cd6dcf177228b36be963581342677"
Sep 16 13:02:14.043641 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.043611    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:02:14.043726 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.043686    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:02:14.043778 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.043730    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:02:14.076391 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.076293    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:14.204177 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.204071    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:14.301292 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.301142    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:14.398034 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.398001    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"]
Sep 16 13:02:14.402273 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:02:14.402244    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb9037d6_9059_4509_a4aa_b00463ce3788.slice/crio-0ce35d7d82af9f60d6cc6c749b6b89cd4e9094ab5dbeec3649b61bf5cd3db678 WatchSource:0}: Error finding container 0ce35d7d82af9f60d6cc6c749b6b89cd4e9094ab5dbeec3649b61bf5cd3db678: Status 404 returned error can't find the container with id 0ce35d7d82af9f60d6cc6c749b6b89cd4e9094ab5dbeec3649b61bf5cd3db678
Sep 16 13:02:14.405406 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.405369    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:02:14.405529 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.405442    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:02:14.405529 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:14.405473    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:02:15.016146 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.016109    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:15.055271 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.055223    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb" event={"ID":"fb9037d6-9059-4509-a4aa-b00463ce3788","Type":"ContainerStarted","Data":"4ccbbd76d30db2dc9d2f3369a8bfa0ffb52982ec7433eabd61f1da65b973d338"}
Sep 16 13:02:15.055459 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.055301    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb" event={"ID":"fb9037d6-9059-4509-a4aa-b00463ce3788","Type":"ContainerStarted","Data":"0ce35d7d82af9f60d6cc6c749b6b89cd4e9094ab5dbeec3649b61bf5cd3db678"}
Sep 16 13:02:15.062772 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.062731    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f" event={"ID":"b5febaf0-5829-4c34-a8f6-4d3e479092c4","Type":"ContainerStarted","Data":"b426c226e68268f41e5c8c39ae5d3eac8d461cd23e3fb10bd0a69b1f45b7568f"}
Sep 16 13:02:15.067456 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.067402    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml" event={"ID":"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa","Type":"ContainerStarted","Data":"7e70864f490b6bd0d023fdf1645f6b0b501b63e0134a5e0947831b562accb26b"}
Sep 16 13:02:15.079265 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.079221    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:15.079464 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.079354    2549 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 16 13:02:15.079464 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.079402    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb" podUID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 16 13:02:15.111031 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.110951    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb" podStartSLOduration=2.110927904 podStartE2EDuration="2.110927904s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:02:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:02:15.108527655 +0000 UTC m=+1418.673348748" watchObservedRunningTime="2026-09-16 13:02:15.110927904 +0000 UTC m=+1418.675748991"
Sep 16 13:02:15.132604 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.132566    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:02:15.132753 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.132699    2549 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 13:02:15.132753 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.132739    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml" podUID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 13:02:15.827236 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.827194    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:02:15.827418 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.827301    2549 patch_prober.go:28] interesting pod/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 16 13:02:15.827418 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:15.827366    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f" podUID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 16 13:02:16.099508 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:16.099404    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:16.132246 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:16.132203    2549 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 13:02:16.132409 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:16.132281    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml" podUID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 13:02:16.666090 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:16.666000    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:16.826937 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:16.826902    2549 patch_prober.go:28] interesting pod/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 16 13:02:16.827117 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:16.826954    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f" podUID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 16 13:02:16.853342 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:16.853297    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:02:17.093065 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:17.092966    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:17.095109 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:17.095087    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:17.132589 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:17.132561    2549 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 13:02:17.132931 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:17.132605    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml" podUID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 13:02:17.285361 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:17.285163    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:17.373519 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:17.373412    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:17.826257 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:17.826224    2549 patch_prober.go:28] interesting pod/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 16 13:02:17.826429 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:17.826290    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f" podUID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 16 13:02:17.876595 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:17.876555    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:18.132638 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:18.132557    2549 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 13:02:18.132638 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:18.132612    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml" podUID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 13:02:18.826730 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:18.826691    2549 patch_prober.go:28] interesting pod/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 16 13:02:18.826886 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:18.826747    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f" podUID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 16 13:02:19.058377 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:19.058235    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:19.132101 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:19.132011    2549 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 13:02:19.132101 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:19.132072    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml" podUID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 13:02:19.827160 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:19.827121    2549 patch_prober.go:28] interesting pod/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 16 13:02:19.827644 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:19.827183    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f" podUID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 16 13:02:20.132635 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:20.132531    2549 patch_prober.go:28] interesting pod/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 16 13:02:20.132635 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:20.132614    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml" podUID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 16 13:02:20.329261 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:20.329225    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:20.830690 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:20.830660    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:02:20.831048 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:20.831023    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:02:20.831601 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:20.831586    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:02:21.136315 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:21.136242    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:02:21.137261 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:21.137242    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:02:21.221622 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:21.221591    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:22.319714 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:22.319655    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:22.412617 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:22.412583    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:22.922345 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:22.922312    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:23.026030 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:23.025993    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:23.122414 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:23.122379    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:23.460246 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:23.460216    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:24.483047 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:24.483006    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:25.357108 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:25.357064    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:26.491257 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:26.491223    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:26.895602 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:26.895522    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:27.002126 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:27.002092    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:28.266327 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:28.266299    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:32.520225 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:32.520145    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:32.617699 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:32.617668    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:34.639739 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:34.639706    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:45.199746 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:45.199707    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:46.438148 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:46.438116    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:47.078708 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:47.078677    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:47.391242 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:47.391160    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:47.652052 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:47.651973    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:48.896529 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:48.896471    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:49.844559 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:49.844523    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:50.846329 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:50.846298    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:51.311632 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:51.311596    2549 generic.go:356] "Generic (PLEG): container finished" podID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerID="4ccbbd76d30db2dc9d2f3369a8bfa0ffb52982ec7433eabd61f1da65b973d338" exitCode=0
Sep 16 13:02:51.311809 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:51.311673    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb" event={"ID":"fb9037d6-9059-4509-a4aa-b00463ce3788","Type":"ContainerDied","Data":"4ccbbd76d30db2dc9d2f3369a8bfa0ffb52982ec7433eabd61f1da65b973d338"}
Sep 16 13:02:51.312108 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:51.312073    2549 scope.go:117] "RemoveContainer" containerID="4ccbbd76d30db2dc9d2f3369a8bfa0ffb52982ec7433eabd61f1da65b973d338"
Sep 16 13:02:51.313205 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:51.313174    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:02:51.313263 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:51.313248    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:02:51.313300 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:51.313287    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:02:51.855254 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:51.855219    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:52.319674 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:52.319641    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb" event={"ID":"fb9037d6-9059-4509-a4aa-b00463ce3788","Type":"ContainerStarted","Data":"579439912dac8cd8b7bf1297a610b769944543cf5798e28b2d322db714766157"}
Sep 16 13:02:52.678471 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:52.678433    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:52.844611 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:52.844567    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:53.076844 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:53.076756    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:53.077251 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:53.076973    2549 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 16 13:02:53.077251 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:53.077024    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb" podUID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 16 13:02:54.077675 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:54.077635    2549 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 16 13:02:54.078066 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:54.077694    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb" podUID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 16 13:02:55.077684 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:55.077647    2549 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 16 13:02:55.078086 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:55.077706    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb" podUID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 16 13:02:55.757791 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:55.757755    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:02:56.077410 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:56.077311    2549 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 16 13:02:56.077410 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:56.077373    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb" podUID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 16 13:02:57.077383 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:57.077343    2549 patch_prober.go:28] interesting pod/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Sep 16 13:02:57.077818 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:57.077411    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb" podUID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Sep 16 13:02:58.124922 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:58.124885    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:58.125443 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:58.125372    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:02:58.126568 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:02:58.126544    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:03:01.760137 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:03:01.760105    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:02.023753 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:03:02.023664    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:02.146565 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:03:02.146533    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:07.181268 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:03:07.181239    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:35.610421 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:03:35.610386    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:39.257382 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:03:39.257346    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:43.448811 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:03:43.448784    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:03:45.136834 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:03:45.136796    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:12.384427 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:12.384348    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:12.891754 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:12.891722    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:13.858371 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:13.858333    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:14.699635 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:14.699602    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:15.500652 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:15.500622    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:15.587390 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:15.587360    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:16.519823 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:16.519789    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:17.456502 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:17.456450    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:17.556918 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:17.556884    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:18.284711 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:18.284681    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:19.136284 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:19.136250    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:20.039635 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:20.039602    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:28.320185 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.320147    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"]
Sep 16 13:04:28.320571 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.320383    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm" podUID="b1c8021b-2482-4d7e-bf13-076091f52ff1" containerName="maas-api" containerID="cri-o://ccc83f0575d27e5d255bdc8eed601c912a7318d18ebfa42e5f017df22443d06c" gracePeriod=30
Sep 16 13:04:28.355580 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.355532    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:28.480965 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.480927    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:28.577698 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.577639    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 13:04:28.580555 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.580533    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:28.662089 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.662058    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:28.728009 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.727978    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8q9d\" (UniqueName: \"kubernetes.io/projected/b1c8021b-2482-4d7e-bf13-076091f52ff1-kube-api-access-p8q9d\") pod \"b1c8021b-2482-4d7e-bf13-076091f52ff1\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") "
Sep 16 13:04:28.728196 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.728023    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c8021b-2482-4d7e-bf13-076091f52ff1-maas-api-tls\") pod \"b1c8021b-2482-4d7e-bf13-076091f52ff1\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") "
Sep 16 13:04:28.728196 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.728073    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c8021b-2482-4d7e-bf13-076091f52ff1-openshift-service-ca\") pod \"b1c8021b-2482-4d7e-bf13-076091f52ff1\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") "
Sep 16 13:04:28.728196 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.728109    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1c8021b-2482-4d7e-bf13-076091f52ff1-metrics-certs\") pod \"b1c8021b-2482-4d7e-bf13-076091f52ff1\" (UID: \"b1c8021b-2482-4d7e-bf13-076091f52ff1\") "
Sep 16 13:04:28.728415 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.728390    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1c8021b-2482-4d7e-bf13-076091f52ff1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1c8021b-2482-4d7e-bf13-076091f52ff1" (UID: "b1c8021b-2482-4d7e-bf13-076091f52ff1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:04:28.730185 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.730141    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1c8021b-2482-4d7e-bf13-076091f52ff1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1c8021b-2482-4d7e-bf13-076091f52ff1" (UID: "b1c8021b-2482-4d7e-bf13-076091f52ff1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:04:28.730308 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.730197    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1c8021b-2482-4d7e-bf13-076091f52ff1-kube-api-access-p8q9d" (OuterVolumeSpecName: "kube-api-access-p8q9d") pod "b1c8021b-2482-4d7e-bf13-076091f52ff1" (UID: "b1c8021b-2482-4d7e-bf13-076091f52ff1"). InnerVolumeSpecName "kube-api-access-p8q9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:04:28.730308 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.730258    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1c8021b-2482-4d7e-bf13-076091f52ff1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b1c8021b-2482-4d7e-bf13-076091f52ff1" (UID: "b1c8021b-2482-4d7e-bf13-076091f52ff1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:04:28.829897 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.829824    2549 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b1c8021b-2482-4d7e-bf13-076091f52ff1-metrics-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:04:28.829897 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.829852    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8q9d\" (UniqueName: \"kubernetes.io/projected/b1c8021b-2482-4d7e-bf13-076091f52ff1-kube-api-access-p8q9d\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:04:28.829897 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.829862    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1c8021b-2482-4d7e-bf13-076091f52ff1-maas-api-tls\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:04:28.829897 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.829871    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1c8021b-2482-4d7e-bf13-076091f52ff1-openshift-service-ca\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:04:28.874920 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.874888    2549 generic.go:356] "Generic (PLEG): container finished" podID="b1c8021b-2482-4d7e-bf13-076091f52ff1" containerID="ccc83f0575d27e5d255bdc8eed601c912a7318d18ebfa42e5f017df22443d06c" exitCode=0
Sep 16 13:04:28.875077 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.874935    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"
Sep 16 13:04:28.875077 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.874967    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm" event={"ID":"b1c8021b-2482-4d7e-bf13-076091f52ff1","Type":"ContainerDied","Data":"ccc83f0575d27e5d255bdc8eed601c912a7318d18ebfa42e5f017df22443d06c"}
Sep 16 13:04:28.875077 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.875018    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm" event={"ID":"b1c8021b-2482-4d7e-bf13-076091f52ff1","Type":"ContainerDied","Data":"94e6e98adf77ffa0ddfe69daceb60e3fd05dde91746fcc4185d8887cafa795eb"}
Sep 16 13:04:28.875077 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.875041    2549 scope.go:117] "RemoveContainer" containerID="ccc83f0575d27e5d255bdc8eed601c912a7318d18ebfa42e5f017df22443d06c"
Sep 16 13:04:28.885084 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.885069    2549 scope.go:117] "RemoveContainer" containerID="ccc83f0575d27e5d255bdc8eed601c912a7318d18ebfa42e5f017df22443d06c"
Sep 16 13:04:28.885371 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:04:28.885351    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccc83f0575d27e5d255bdc8eed601c912a7318d18ebfa42e5f017df22443d06c\": container with ID starting with ccc83f0575d27e5d255bdc8eed601c912a7318d18ebfa42e5f017df22443d06c not found: ID does not exist" containerID="ccc83f0575d27e5d255bdc8eed601c912a7318d18ebfa42e5f017df22443d06c"
Sep 16 13:04:28.885409 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.885380    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccc83f0575d27e5d255bdc8eed601c912a7318d18ebfa42e5f017df22443d06c"} err="failed to get container status \"ccc83f0575d27e5d255bdc8eed601c912a7318d18ebfa42e5f017df22443d06c\": rpc error: code = NotFound desc = could not find container \"ccc83f0575d27e5d255bdc8eed601c912a7318d18ebfa42e5f017df22443d06c\": container with ID starting with ccc83f0575d27e5d255bdc8eed601c912a7318d18ebfa42e5f017df22443d06c not found: ID does not exist"
Sep 16 13:04:28.899785 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.899758    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"]
Sep 16 13:04:28.902432 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.902411    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-490797-584966f4f8-gzhnm"]
Sep 16 13:04:28.926695 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:28.926659    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1c8021b-2482-4d7e-bf13-076091f52ff1" path="/var/lib/kubelet/pods/b1c8021b-2482-4d7e-bf13-076091f52ff1/volumes"
Sep 16 13:04:29.061520 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:29.061491    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:29.168114 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:29.168084    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:30.051019 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:30.050977    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:30.966907 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:30.966876    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:31.814468 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:31.814435    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:32.833374 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:32.833338    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:33.755346 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:33.755313    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:34.774924 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:34.774883    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:36.443378 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:36.443343    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:36.566328 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:36.566295    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:36.728152 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:36.728074    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:52.474855 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:52.474803    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:52.575762 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:52.575728    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:54.588538 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:54.588469    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:54.646534 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:54.646468    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:04:55.131347 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:04:55.131313    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:08.298473 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:08.298438    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:09.023271 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:09.023236    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:09.856702 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:09.856659    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:10.645665 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:10.645626    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:11.434326 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:11.434284    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:12.195156 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:12.195127    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:12.342057 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:12.342020    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:13.010119 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:13.010083    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:13.716861 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:13.716813    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:15.400814 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:15.400779    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:19.736865 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:19.736835    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:22.120460 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:22.120429    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:23.511125 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.511093    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"]
Sep 16 13:05:23.511611 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.511354    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6" podUID="818332fb-24f8-4e74-aac6-0bc1f907ef59" containerName="maas-api" containerID="cri-o://9d3b141fb0dcdf20f3f2bf0688e2f84723538f3b68ae9c7203689440c190ec30" gracePeriod=30
Sep 16 13:05:23.540053 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.539996    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:23.631889 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.631858    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:23.720718 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.720685    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:23.769306 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.769249    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:05:23.794178 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.794152    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:23.828651 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.828621    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/818332fb-24f8-4e74-aac6-0bc1f907ef59-openshift-service-ca\") pod \"818332fb-24f8-4e74-aac6-0bc1f907ef59\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") "
Sep 16 13:05:23.828821 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.828680    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cntlh\" (UniqueName: \"kubernetes.io/projected/818332fb-24f8-4e74-aac6-0bc1f907ef59-kube-api-access-cntlh\") pod \"818332fb-24f8-4e74-aac6-0bc1f907ef59\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") "
Sep 16 13:05:23.828821 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.828723    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/818332fb-24f8-4e74-aac6-0bc1f907ef59-metrics-certs\") pod \"818332fb-24f8-4e74-aac6-0bc1f907ef59\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") "
Sep 16 13:05:23.828821 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.828804    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/818332fb-24f8-4e74-aac6-0bc1f907ef59-maas-api-tls\") pod \"818332fb-24f8-4e74-aac6-0bc1f907ef59\" (UID: \"818332fb-24f8-4e74-aac6-0bc1f907ef59\") "
Sep 16 13:05:23.829047 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.829016    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/818332fb-24f8-4e74-aac6-0bc1f907ef59-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "818332fb-24f8-4e74-aac6-0bc1f907ef59" (UID: "818332fb-24f8-4e74-aac6-0bc1f907ef59"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:05:23.829213 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.829189    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/818332fb-24f8-4e74-aac6-0bc1f907ef59-openshift-service-ca\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:05:23.830970 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.830940    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/818332fb-24f8-4e74-aac6-0bc1f907ef59-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "818332fb-24f8-4e74-aac6-0bc1f907ef59" (UID: "818332fb-24f8-4e74-aac6-0bc1f907ef59"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:05:23.830970 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.830959    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/818332fb-24f8-4e74-aac6-0bc1f907ef59-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "818332fb-24f8-4e74-aac6-0bc1f907ef59" (UID: "818332fb-24f8-4e74-aac6-0bc1f907ef59"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:05:23.831144 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.830982    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/818332fb-24f8-4e74-aac6-0bc1f907ef59-kube-api-access-cntlh" (OuterVolumeSpecName: "kube-api-access-cntlh") pod "818332fb-24f8-4e74-aac6-0bc1f907ef59" (UID: "818332fb-24f8-4e74-aac6-0bc1f907ef59"). InnerVolumeSpecName "kube-api-access-cntlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:05:23.852473 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.852446    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:23.931229 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.930656    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/818332fb-24f8-4e74-aac6-0bc1f907ef59-maas-api-tls\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:05:23.931229 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.930690    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cntlh\" (UniqueName: \"kubernetes.io/projected/818332fb-24f8-4e74-aac6-0bc1f907ef59-kube-api-access-cntlh\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:05:23.931229 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:23.930705    2549 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/818332fb-24f8-4e74-aac6-0bc1f907ef59-metrics-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:05:24.204900 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:24.204868    2549 generic.go:356] "Generic (PLEG): container finished" podID="818332fb-24f8-4e74-aac6-0bc1f907ef59" containerID="9d3b141fb0dcdf20f3f2bf0688e2f84723538f3b68ae9c7203689440c190ec30" exitCode=0
Sep 16 13:05:24.205062 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:24.204916    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"
Sep 16 13:05:24.205062 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:24.204959    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6" event={"ID":"818332fb-24f8-4e74-aac6-0bc1f907ef59","Type":"ContainerDied","Data":"9d3b141fb0dcdf20f3f2bf0688e2f84723538f3b68ae9c7203689440c190ec30"}
Sep 16 13:05:24.205062 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:24.205016    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6" event={"ID":"818332fb-24f8-4e74-aac6-0bc1f907ef59","Type":"ContainerDied","Data":"f7ed916deb0d4999bb338e3eee1b9abb8e3e1eb3a22fe9a476cefd07260431c9"}
Sep 16 13:05:24.205062 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:24.205041    2549 scope.go:117] "RemoveContainer" containerID="9d3b141fb0dcdf20f3f2bf0688e2f84723538f3b68ae9c7203689440c190ec30"
Sep 16 13:05:24.211408 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:24.211384    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:24.215473 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:24.215458    2549 scope.go:117] "RemoveContainer" containerID="9d3b141fb0dcdf20f3f2bf0688e2f84723538f3b68ae9c7203689440c190ec30"
Sep 16 13:05:24.215774 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:05:24.215748    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d3b141fb0dcdf20f3f2bf0688e2f84723538f3b68ae9c7203689440c190ec30\": container with ID starting with 9d3b141fb0dcdf20f3f2bf0688e2f84723538f3b68ae9c7203689440c190ec30 not found: ID does not exist" containerID="9d3b141fb0dcdf20f3f2bf0688e2f84723538f3b68ae9c7203689440c190ec30"
Sep 16 13:05:24.215880 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:24.215785    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d3b141fb0dcdf20f3f2bf0688e2f84723538f3b68ae9c7203689440c190ec30"} err="failed to get container status \"9d3b141fb0dcdf20f3f2bf0688e2f84723538f3b68ae9c7203689440c190ec30\": rpc error: code = NotFound desc = could not find container \"9d3b141fb0dcdf20f3f2bf0688e2f84723538f3b68ae9c7203689440c190ec30\": container with ID starting with 9d3b141fb0dcdf20f3f2bf0688e2f84723538f3b68ae9c7203689440c190ec30 not found: ID does not exist"
Sep 16 13:05:24.227285 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:24.227260    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"]
Sep 16 13:05:24.232684 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:24.232660    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-524adf28-5bbf6dbfd9-tscf6"]
Sep 16 13:05:24.886871 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:24.886834    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:24.921106 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:24.921074    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="818332fb-24f8-4e74-aac6-0bc1f907ef59" path="/var/lib/kubelet/pods/818332fb-24f8-4e74-aac6-0bc1f907ef59/volumes"
Sep 16 13:05:25.609618 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:25.609584    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:26.466212 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:26.466184    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:26.953222 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:26.953193    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:27.193547 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:27.193513    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:27.980147 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:27.980101    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:32.034461 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:32.034378    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:05:50.481641 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:05:50.481609    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:08.265227 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:08.265190    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:09.155037 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:09.155000    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:14.878771 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:14.878735    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:15.125710 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:15.125672    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"]
Sep 16 13:06:15.125985 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:15.125962    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f" podUID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerName="istio-proxy" containerID="cri-o://b426c226e68268f41e5c8c39ae5d3eac8d461cd23e3fb10bd0a69b1f45b7568f" gracePeriod=30
Sep 16 13:06:16.717173 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:16.717142    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:17.245200 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:17.245167    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:17.339713 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:17.339680    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:17.439133 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:17.439104    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:18.697292 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:18.697260    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:20.371987 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.371965    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:06:20.437971 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.437935    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-workload-socket\") pod \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") "
Sep 16 13:06:20.438169 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.437984    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-credential-socket\") pod \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") "
Sep 16 13:06:20.438169 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438007    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istiod-ca-cert\") pod \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") "
Sep 16 13:06:20.438169 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438057    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-envoy\") pod \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") "
Sep 16 13:06:20.438169 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438073    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-data\") pod \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") "
Sep 16 13:06:20.438169 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438108    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbs97\" (UniqueName: \"kubernetes.io/projected/b5febaf0-5829-4c34-a8f6-4d3e479092c4-kube-api-access-kbs97\") pod \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") "
Sep 16 13:06:20.438428 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438263    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b5febaf0-5829-4c34-a8f6-4d3e479092c4" (UID: "b5febaf0-5829-4c34-a8f6-4d3e479092c4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:06:20.438428 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438288    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b5febaf0-5829-4c34-a8f6-4d3e479092c4" (UID: "b5febaf0-5829-4c34-a8f6-4d3e479092c4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:06:20.438428 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438302    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-podinfo\") pod \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") "
Sep 16 13:06:20.438428 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438360    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-workload-certs\") pod \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") "
Sep 16 13:06:20.438428 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438398    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-data" (OuterVolumeSpecName: "istio-data") pod "b5febaf0-5829-4c34-a8f6-4d3e479092c4" (UID: "b5febaf0-5829-4c34-a8f6-4d3e479092c4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:06:20.438428 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438410    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-token\") pod \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\" (UID: \"b5febaf0-5829-4c34-a8f6-4d3e479092c4\") "
Sep 16 13:06:20.438695 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438460    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b5febaf0-5829-4c34-a8f6-4d3e479092c4" (UID: "b5febaf0-5829-4c34-a8f6-4d3e479092c4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:06:20.438827 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438805    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-credential-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:06:20.438827 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438816    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b5febaf0-5829-4c34-a8f6-4d3e479092c4" (UID: "b5febaf0-5829-4c34-a8f6-4d3e479092c4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:06:20.438945 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438834    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istiod-ca-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:06:20.438945 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438848    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-data\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:06:20.438945 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.438859    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-workload-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:06:20.440441 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.440413    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b5febaf0-5829-4c34-a8f6-4d3e479092c4" (UID: "b5febaf0-5829-4c34-a8f6-4d3e479092c4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:06:20.440441 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.440438    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-token" (OuterVolumeSpecName: "istio-token") pod "b5febaf0-5829-4c34-a8f6-4d3e479092c4" (UID: "b5febaf0-5829-4c34-a8f6-4d3e479092c4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:06:20.440597 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.440529    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5febaf0-5829-4c34-a8f6-4d3e479092c4-kube-api-access-kbs97" (OuterVolumeSpecName: "kube-api-access-kbs97") pod "b5febaf0-5829-4c34-a8f6-4d3e479092c4" (UID: "b5febaf0-5829-4c34-a8f6-4d3e479092c4"). InnerVolumeSpecName "kube-api-access-kbs97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:06:20.440758 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.440738    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b5febaf0-5829-4c34-a8f6-4d3e479092c4" (UID: "b5febaf0-5829-4c34-a8f6-4d3e479092c4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:06:20.522951 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.522914    2549 generic.go:356] "Generic (PLEG): container finished" podID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerID="b426c226e68268f41e5c8c39ae5d3eac8d461cd23e3fb10bd0a69b1f45b7568f" exitCode=0
Sep 16 13:06:20.523092 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.522973    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"
Sep 16 13:06:20.523092 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.523001    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f" event={"ID":"b5febaf0-5829-4c34-a8f6-4d3e479092c4","Type":"ContainerDied","Data":"b426c226e68268f41e5c8c39ae5d3eac8d461cd23e3fb10bd0a69b1f45b7568f"}
Sep 16 13:06:20.523092 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.523083    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f" event={"ID":"b5febaf0-5829-4c34-a8f6-4d3e479092c4","Type":"ContainerDied","Data":"e1e565f7fc66b04479b8c78ccbf33c8a8a4f5349df0b6b86d33ada992f044672"}
Sep 16 13:06:20.523239 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.523110    2549 scope.go:117] "RemoveContainer" containerID="b426c226e68268f41e5c8c39ae5d3eac8d461cd23e3fb10bd0a69b1f45b7568f"
Sep 16 13:06:20.533083 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.533069    2549 scope.go:117] "RemoveContainer" containerID="7a27b43a1b2ddaea37f65350358a4d97bb1cd6dcf177228b36be963581342677"
Sep 16 13:06:20.539513 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.539491    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-envoy\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:06:20.539605 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.539516    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbs97\" (UniqueName: \"kubernetes.io/projected/b5febaf0-5829-4c34-a8f6-4d3e479092c4-kube-api-access-kbs97\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:06:20.539605 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.539526    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-podinfo\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:06:20.539605 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.539536    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5febaf0-5829-4c34-a8f6-4d3e479092c4-workload-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:06:20.539605 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.539544    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5febaf0-5829-4c34-a8f6-4d3e479092c4-istio-token\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:06:20.541161 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.541148    2549 scope.go:117] "RemoveContainer" containerID="b426c226e68268f41e5c8c39ae5d3eac8d461cd23e3fb10bd0a69b1f45b7568f"
Sep 16 13:06:20.541367 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:06:20.541352    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b426c226e68268f41e5c8c39ae5d3eac8d461cd23e3fb10bd0a69b1f45b7568f\": container with ID starting with b426c226e68268f41e5c8c39ae5d3eac8d461cd23e3fb10bd0a69b1f45b7568f not found: ID does not exist" containerID="b426c226e68268f41e5c8c39ae5d3eac8d461cd23e3fb10bd0a69b1f45b7568f"
Sep 16 13:06:20.541407 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.541374    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b426c226e68268f41e5c8c39ae5d3eac8d461cd23e3fb10bd0a69b1f45b7568f"} err="failed to get container status \"b426c226e68268f41e5c8c39ae5d3eac8d461cd23e3fb10bd0a69b1f45b7568f\": rpc error: code = NotFound desc = could not find container \"b426c226e68268f41e5c8c39ae5d3eac8d461cd23e3fb10bd0a69b1f45b7568f\": container with ID starting with b426c226e68268f41e5c8c39ae5d3eac8d461cd23e3fb10bd0a69b1f45b7568f not found: ID does not exist"
Sep 16 13:06:20.541407 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.541388    2549 scope.go:117] "RemoveContainer" containerID="7a27b43a1b2ddaea37f65350358a4d97bb1cd6dcf177228b36be963581342677"
Sep 16 13:06:20.541634 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:06:20.541619    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a27b43a1b2ddaea37f65350358a4d97bb1cd6dcf177228b36be963581342677\": container with ID starting with 7a27b43a1b2ddaea37f65350358a4d97bb1cd6dcf177228b36be963581342677 not found: ID does not exist" containerID="7a27b43a1b2ddaea37f65350358a4d97bb1cd6dcf177228b36be963581342677"
Sep 16 13:06:20.541681 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.541637    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a27b43a1b2ddaea37f65350358a4d97bb1cd6dcf177228b36be963581342677"} err="failed to get container status \"7a27b43a1b2ddaea37f65350358a4d97bb1cd6dcf177228b36be963581342677\": rpc error: code = NotFound desc = could not find container \"7a27b43a1b2ddaea37f65350358a4d97bb1cd6dcf177228b36be963581342677\": container with ID starting with 7a27b43a1b2ddaea37f65350358a4d97bb1cd6dcf177228b36be963581342677 not found: ID does not exist"
Sep 16 13:06:20.544987 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.544965    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"]
Sep 16 13:06:20.548829 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.548810    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-524adf28-openshift-default-5dc9bd959b-ckr9f"]
Sep 16 13:06:20.921359 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:20.921331    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" path="/var/lib/kubelet/pods/b5febaf0-5829-4c34-a8f6-4d3e479092c4/volumes"
Sep 16 13:06:24.648312 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:24.648276    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:24.731369 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:24.731338    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:25.318346 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:25.318311    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:31.465305 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:31.465275    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:31.597751 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:31.597710    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:31.695873 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:31.695825    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:32.532607 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:32.532577    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:42.201734 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:42.201695    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:42.445165 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:42.445122    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:06:56.068536 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:06:56.068503    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:03.381661 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:03.381580    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:09.226296 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.226260    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:09.293037 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.293002    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:09.553834 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.553749    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:09.824163 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.824083    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"]
Sep 16 13:07:09.824582 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.824566    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c8021b-2482-4d7e-bf13-076091f52ff1" containerName="maas-api"
Sep 16 13:07:09.824643 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.824584    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c8021b-2482-4d7e-bf13-076091f52ff1" containerName="maas-api"
Sep 16 13:07:09.824643 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.824613    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="818332fb-24f8-4e74-aac6-0bc1f907ef59" containerName="maas-api"
Sep 16 13:07:09.824643 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.824619    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="818332fb-24f8-4e74-aac6-0bc1f907ef59" containerName="maas-api"
Sep 16 13:07:09.824643 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.824630    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerName="istio-proxy"
Sep 16 13:07:09.824643 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.824636    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerName="istio-proxy"
Sep 16 13:07:09.824811 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.824712    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1c8021b-2482-4d7e-bf13-076091f52ff1" containerName="maas-api"
Sep 16 13:07:09.824811 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.824718    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerName="istio-proxy"
Sep 16 13:07:09.824811 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.824728    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="818332fb-24f8-4e74-aac6-0bc1f907ef59" containerName="maas-api"
Sep 16 13:07:09.826822 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.826806    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.829378 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.829357    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-f0722f-openshift-default-dockercfg-2ds2k\""
Sep 16 13:07:09.839747 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.839726    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"]
Sep 16 13:07:09.845803 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.845771    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:09.866205 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.866182    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d803c47-0d48-4232-b167-04c7557110fe-istio-token\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.866332 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.866234    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-istio-envoy\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.866381 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.866327    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-istio-data\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.866449 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.866432    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d803c47-0d48-4232-b167-04c7557110fe-istiod-ca-cert\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.866542 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.866503    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-credential-socket\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.866589 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.866553    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tl9m\" (UniqueName: \"kubernetes.io/projected/2d803c47-0d48-4232-b167-04c7557110fe-kube-api-access-2tl9m\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.866589 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.866576    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d803c47-0d48-4232-b167-04c7557110fe-istio-podinfo\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.866661 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.866633    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-workload-certs\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.866696 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.866664    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-workload-socket\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.968003 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.967969    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d803c47-0d48-4232-b167-04c7557110fe-istiod-ca-cert\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.968003 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.968014    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-credential-socket\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.968332 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.968043    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tl9m\" (UniqueName: \"kubernetes.io/projected/2d803c47-0d48-4232-b167-04c7557110fe-kube-api-access-2tl9m\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.968332 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.968106    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d803c47-0d48-4232-b167-04c7557110fe-istio-podinfo\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.968332 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.968166    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-workload-certs\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.968332 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.968199    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-workload-socket\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.968332 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.968236    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d803c47-0d48-4232-b167-04c7557110fe-istio-token\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.968332 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.968282    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-istio-envoy\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.968644 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.968332    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-istio-data\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.968644 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.968582    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-workload-certs\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.968736 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.968666    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-workload-socket\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.968801 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.968782    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d803c47-0d48-4232-b167-04c7557110fe-istiod-ca-cert\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.968930 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.968907    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-istio-data\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.969074 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.969021    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-credential-socket\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.970785 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.970765    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-istio-envoy\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.970879 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.970849    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d803c47-0d48-4232-b167-04c7557110fe-istio-podinfo\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.976141 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.976115    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d803c47-0d48-4232-b167-04c7557110fe-istio-token\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:09.976257 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:09.976233    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tl9m\" (UniqueName: \"kubernetes.io/projected/2d803c47-0d48-4232-b167-04c7557110fe-kube-api-access-2tl9m\") pod \"e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") " pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:10.139554 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:10.139448    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:10.254874 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:10.254828    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:10.420678 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:10.420652    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"]
Sep 16 13:07:10.422912 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:07:10.422886    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d803c47_0d48_4232_b167_04c7557110fe.slice/crio-ed6fe73900a1ecccd4e6dae645401a91bb4b1e3259d9aea671251161ada7ccea WatchSource:0}: Error finding container ed6fe73900a1ecccd4e6dae645401a91bb4b1e3259d9aea671251161ada7ccea: Status 404 returned error can't find the container with id ed6fe73900a1ecccd4e6dae645401a91bb4b1e3259d9aea671251161ada7ccea
Sep 16 13:07:10.425193 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:10.425163    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:07:10.425273 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:10.425225    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:07:10.425273 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:10.425253    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:07:10.810098 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:10.810005    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" event={"ID":"2d803c47-0d48-4232-b167-04c7557110fe","Type":"ContainerStarted","Data":"ae789c89a4e9a03b4f5200db7ea5d17ad0289bd020f336b076ddff73a8e87ca3"}
Sep 16 13:07:10.810098 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:10.810069    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" event={"ID":"2d803c47-0d48-4232-b167-04c7557110fe","Type":"ContainerStarted","Data":"ed6fe73900a1ecccd4e6dae645401a91bb4b1e3259d9aea671251161ada7ccea"}
Sep 16 13:07:10.834668 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:10.834617    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" podStartSLOduration=1.834602399 podStartE2EDuration="1.834602399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:07:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:07:10.831935036 +0000 UTC m=+1714.396756127" watchObservedRunningTime="2026-09-16 13:07:10.834602399 +0000 UTC m=+1714.399423489"
Sep 16 13:07:11.140052 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:11.139970    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:11.145160 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:11.145137    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:11.815695 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:11.815661    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:11.816467 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:11.816446    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:12.063097 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:12.063055    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:12.834515 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:12.834460    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:12.939822 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:12.939792    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:13.668713 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:13.668680    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:14.547148 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:14.547110    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:15.440576 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:15.440541    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:16.198134 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:16.198097    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:17.156885 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:17.156852    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:17.257135 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:17.257108    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:17.389898 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:17.389866    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:17.736867 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:17.736836    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:17.836236 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:17.836208    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:39.481060 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:39.481013    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:40.226729 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:40.226691    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:41.056347 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:41.056310    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:41.858655 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:41.858619    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:42.762465 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:42.762431    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:42.857635 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:42.857597    2549 patch_prober.go:28] interesting pod/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 13:07:42.857830 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:42.857669    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" podUID="2d803c47-0d48-4232-b167-04c7557110fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 13:07:42.860159 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:42.860128    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:43.012579 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.012523    2549 generic.go:356] "Generic (PLEG): container finished" podID="2d803c47-0d48-4232-b167-04c7557110fe" containerID="ae789c89a4e9a03b4f5200db7ea5d17ad0289bd020f336b076ddff73a8e87ca3" exitCode=0
Sep 16 13:07:43.012743 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.012595    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" event={"ID":"2d803c47-0d48-4232-b167-04c7557110fe","Type":"ContainerDied","Data":"ae789c89a4e9a03b4f5200db7ea5d17ad0289bd020f336b076ddff73a8e87ca3"}
Sep 16 13:07:43.013083 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.013064    2549 scope.go:117] "RemoveContainer" containerID="ae789c89a4e9a03b4f5200db7ea5d17ad0289bd020f336b076ddff73a8e87ca3"
Sep 16 13:07:43.014230 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.014200    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:07:43.014318 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.014285    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:07:43.014380 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.014335    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:07:43.254833 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.254795    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:43.448939 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.448896    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:43.525252 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.525213    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"]
Sep 16 13:07:43.525730 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.525707    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerName="istio-proxy"
Sep 16 13:07:43.525730 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.525729    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerName="istio-proxy"
Sep 16 13:07:43.525957 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.525873    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5febaf0-5829-4c34-a8f6-4d3e479092c4" containerName="istio-proxy"
Sep 16 13:07:43.528689 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.528669    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.531415 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.531388    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-94f3e1-openshift-default-dockercfg-whlkc\""
Sep 16 13:07:43.541981 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.541955    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"]
Sep 16 13:07:43.552829 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.552806    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:43.680952 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.680906    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-workload-certs\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.681136 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.681046    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-istio-envoy\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.681136 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.681088    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af334189-cfac-4d13-80f8-4f13c389286c-istio-podinfo\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.681264 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.681140    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-workload-socket\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.681264 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.681173    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af334189-cfac-4d13-80f8-4f13c389286c-istio-token\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.681264 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.681195    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af334189-cfac-4d13-80f8-4f13c389286c-istiod-ca-cert\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.681264 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.681236    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-credential-socket\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.681439 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.681322    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk29z\" (UniqueName: \"kubernetes.io/projected/af334189-cfac-4d13-80f8-4f13c389286c-kube-api-access-xk29z\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.681439 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.681351    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-istio-data\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.729795 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.729724    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:43.782726 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.782684    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-workload-certs\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.783229 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.783124    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-workload-certs\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.783344 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.783314    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-istio-envoy\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.783422 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.783343    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af334189-cfac-4d13-80f8-4f13c389286c-istio-podinfo\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.783422 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.783388    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-workload-socket\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.783561 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.783420    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af334189-cfac-4d13-80f8-4f13c389286c-istio-token\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.783561 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.783442    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af334189-cfac-4d13-80f8-4f13c389286c-istiod-ca-cert\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.783561 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.783504    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-credential-socket\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.783735 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.783567    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk29z\" (UniqueName: \"kubernetes.io/projected/af334189-cfac-4d13-80f8-4f13c389286c-kube-api-access-xk29z\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.783735 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.783597    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-istio-data\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.783946 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.783922    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-istio-data\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.784751 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.784700    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-workload-socket\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.785180 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.784941    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af334189-cfac-4d13-80f8-4f13c389286c-istiod-ca-cert\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.785281 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.785223    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-credential-socket\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.787974 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.787946    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-istio-envoy\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.790132 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.788786    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af334189-cfac-4d13-80f8-4f13c389286c-istio-podinfo\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.793492 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.793457    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af334189-cfac-4d13-80f8-4f13c389286c-istio-token\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.793759 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.793737    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk29z\" (UniqueName: \"kubernetes.io/projected/af334189-cfac-4d13-80f8-4f13c389286c-kube-api-access-xk29z\") pod \"e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") " pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:43.841532 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:43.841510    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:44.023186 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:44.022154    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" event={"ID":"2d803c47-0d48-4232-b167-04c7557110fe","Type":"ContainerStarted","Data":"c10262d5fcf18b764d9642efcd92d14bd723f44e8777f65afdca61a91fc8030e"}
Sep 16 13:07:44.128614 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:44.128582    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"]
Sep 16 13:07:44.129774 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:07:44.129748    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf334189_cfac_4d13_80f8_4f13c389286c.slice/crio-23fe8c80b3a76fa3b8946e450e324f7d9e8fb0be19f54b46381a33aa2ff206ff WatchSource:0}: Error finding container 23fe8c80b3a76fa3b8946e450e324f7d9e8fb0be19f54b46381a33aa2ff206ff: Status 404 returned error can't find the container with id 23fe8c80b3a76fa3b8946e450e324f7d9e8fb0be19f54b46381a33aa2ff206ff
Sep 16 13:07:44.132260 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:44.132223    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:07:44.132358 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:44.132292    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:07:44.132358 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:44.132322    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:07:44.139853 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:44.139830    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:44.140065 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:44.140043    2549 patch_prober.go:28] interesting pod/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 16 13:07:44.140121 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:44.140091    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" podUID="2d803c47-0d48-4232-b167-04c7557110fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 16 13:07:44.449785 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:44.449744    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:45.029850 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:45.029809    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97" event={"ID":"af334189-cfac-4d13-80f8-4f13c389286c","Type":"ContainerStarted","Data":"f5227e2b93e51e2c6537578545e0482985e59d4a812365cf92135c5bed470cb6"}
Sep 16 13:07:45.030248 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:45.029874    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97" event={"ID":"af334189-cfac-4d13-80f8-4f13c389286c","Type":"ContainerStarted","Data":"23fe8c80b3a76fa3b8946e450e324f7d9e8fb0be19f54b46381a33aa2ff206ff"}
Sep 16 13:07:45.055698 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:45.055618    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97" podStartSLOduration=2.055594614 podStartE2EDuration="2.055594614s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:07:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:07:45.05445797 +0000 UTC m=+1748.619279062" watchObservedRunningTime="2026-09-16 13:07:45.055594614 +0000 UTC m=+1748.620415707"
Sep 16 13:07:45.140718 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:45.140680    2549 patch_prober.go:28] interesting pod/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 16 13:07:45.140875 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:45.140748    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" podUID="2d803c47-0d48-4232-b167-04c7557110fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 16 13:07:45.480858 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:45.480821    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:45.842262 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:45.842144    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:45.851584 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:45.851540    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:46.035687 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:46.035657    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:46.036811 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:46.036789    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:07:46.140203 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:46.140119    2549 patch_prober.go:28] interesting pod/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 16 13:07:46.140203 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:46.140169    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" podUID="2d803c47-0d48-4232-b167-04c7557110fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 16 13:07:46.454275 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:46.454233    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:46.999869 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:46.999829    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:47.108490 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:47.108450    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:47.140080 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:47.140051    2549 patch_prober.go:28] interesting pod/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 16 13:07:47.140226 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:47.140099    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" podUID="2d803c47-0d48-4232-b167-04c7557110fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 16 13:07:47.687905 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:47.687872    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:48.140589 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:48.140504    2549 patch_prober.go:28] interesting pod/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 16 13:07:48.140589 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:48.140560    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" podUID="2d803c47-0d48-4232-b167-04c7557110fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 16 13:07:48.581599 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:48.581559    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:49.140050 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:49.140011    2549 patch_prober.go:28] interesting pod/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Sep 16 13:07:49.140237 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:49.140077    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" podUID="2d803c47-0d48-4232-b167-04c7557110fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Sep 16 13:07:49.547309 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:49.547274    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:50.145000 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:50.144969    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:50.145293 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:50.145269    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:50.145888 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:50.145869    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:07:50.543103 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:50.543071    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:51.237557 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:51.237525    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:51.972852 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:51.972798    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:52.862535 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:52.862508    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:52.963372 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:52.963341    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:53.345418 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:53.345389    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:53.411280 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:53.411249    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:07:53.447179 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:53.447145    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"]
Sep 16 13:07:53.449786 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:53.449767    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"
Sep 16 13:07:53.452419 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:53.452394    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-94f3e1-dockercfg-cghbn\""
Sep 16 13:07:53.452570 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:53.452421    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-94f3e1\""
Sep 16 13:07:53.459052 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:53.459029    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"]
Sep 16 13:07:53.471460 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:53.471433    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86ac7e9d-a799-4444-a57c-c4c86549f2db-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4\" (UID: \"86ac7e9d-a799-4444-a57c-c4c86549f2db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"
Sep 16 13:07:53.471584 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:53.471529    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hqnj\" (UniqueName: \"kubernetes.io/projected/86ac7e9d-a799-4444-a57c-c4c86549f2db-kube-api-access-5hqnj\") pod \"payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4\" (UID: \"86ac7e9d-a799-4444-a57c-c4c86549f2db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"
Sep 16 13:07:53.573766 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:53.573717    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hqnj\" (UniqueName: \"kubernetes.io/projected/86ac7e9d-a799-4444-a57c-c4c86549f2db-kube-api-access-5hqnj\") pod \"payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4\" (UID: \"86ac7e9d-a799-4444-a57c-c4c86549f2db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"
Sep 16 13:07:53.573961 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:53.573881    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86ac7e9d-a799-4444-a57c-c4c86549f2db-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4\" (UID: \"86ac7e9d-a799-4444-a57c-c4c86549f2db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"
Sep 16 13:07:53.574832 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:53.574805    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86ac7e9d-a799-4444-a57c-c4c86549f2db-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4\" (UID: \"86ac7e9d-a799-4444-a57c-c4c86549f2db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"
Sep 16 13:07:53.586291 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:53.586266    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hqnj\" (UniqueName: \"kubernetes.io/projected/86ac7e9d-a799-4444-a57c-c4c86549f2db-kube-api-access-5hqnj\") pod \"payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4\" (UID: \"86ac7e9d-a799-4444-a57c-c4c86549f2db\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"
Sep 16 13:07:53.761921 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:53.761879    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"
Sep 16 13:07:54.036292 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:54.036262    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"]
Sep 16 13:07:54.037728 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:07:54.037701    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ac7e9d_a799_4444_a57c_c4c86549f2db.slice/crio-2d2ee68999e0618843505a2e5c433bcb3fc5100b7a3129b5bb6e906bdacc8433 WatchSource:0}: Error finding container 2d2ee68999e0618843505a2e5c433bcb3fc5100b7a3129b5bb6e906bdacc8433: Status 404 returned error can't find the container with id 2d2ee68999e0618843505a2e5c433bcb3fc5100b7a3129b5bb6e906bdacc8433
Sep 16 13:07:54.089537 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:54.089508    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4" event={"ID":"86ac7e9d-a799-4444-a57c-c4c86549f2db","Type":"ContainerStarted","Data":"2d2ee68999e0618843505a2e5c433bcb3fc5100b7a3129b5bb6e906bdacc8433"}
Sep 16 13:07:55.097182 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:55.097148    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4" event={"ID":"86ac7e9d-a799-4444-a57c-c4c86549f2db","Type":"ContainerStarted","Data":"b11dcf34468cad5b9a31600774c36a9872d92165f64d4eecd0b4d96dd870be55"}
Sep 16 13:07:55.097617 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:55.097343    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"
Sep 16 13:07:55.114380 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:07:55.114333    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4" podStartSLOduration=2.114316724 podStartE2EDuration="2.114316724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:07:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:07:55.113922782 +0000 UTC m=+1758.678743874" watchObservedRunningTime="2026-09-16 13:07:55.114316724 +0000 UTC m=+1758.679137815"
Sep 16 13:08:06.106155 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:06.106113    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"
Sep 16 13:08:12.214161 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:12.214127    2549 generic.go:356] "Generic (PLEG): container finished" podID="af334189-cfac-4d13-80f8-4f13c389286c" containerID="f5227e2b93e51e2c6537578545e0482985e59d4a812365cf92135c5bed470cb6" exitCode=0
Sep 16 13:08:12.214522 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:12.214202    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97" event={"ID":"af334189-cfac-4d13-80f8-4f13c389286c","Type":"ContainerDied","Data":"f5227e2b93e51e2c6537578545e0482985e59d4a812365cf92135c5bed470cb6"}
Sep 16 13:08:12.214649 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:12.214634    2549 scope.go:117] "RemoveContainer" containerID="f5227e2b93e51e2c6537578545e0482985e59d4a812365cf92135c5bed470cb6"
Sep 16 13:08:12.215865 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:12.215837    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:08:12.215951 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:12.215909    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:08:12.215951 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:12.215944    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:08:13.222235 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:13.222198    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97" event={"ID":"af334189-cfac-4d13-80f8-4f13c389286c","Type":"ContainerStarted","Data":"1fd1a581c9d5bc610d05098fd3c432384737ce9573f5788b91a3e2f2efda7918"}
Sep 16 13:08:13.841941 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:13.841899    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:08:13.843027 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:13.843003    2549 patch_prober.go:28] interesting pod/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 16 13:08:13.843096 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:13.843054    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97" podUID="af334189-cfac-4d13-80f8-4f13c389286c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 16 13:08:14.842630 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:14.842595    2549 patch_prober.go:28] interesting pod/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 16 13:08:14.843021 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:14.842652    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97" podUID="af334189-cfac-4d13-80f8-4f13c389286c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 16 13:08:15.255350 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:15.255314    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:15.842129 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:15.842092    2549 patch_prober.go:28] interesting pod/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 16 13:08:15.842343 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:15.842152    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97" podUID="af334189-cfac-4d13-80f8-4f13c389286c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 16 13:08:16.036022 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:16.035991    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:08:16.183215 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:16.183189    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:16.842523 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:16.842460    2549 patch_prober.go:28] interesting pod/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 16 13:08:16.842692 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:16.842568    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97" podUID="af334189-cfac-4d13-80f8-4f13c389286c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 16 13:08:16.976411 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:16.976373    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:17.077706 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:17.077668    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:17.794927 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:17.794893    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:17.842200 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:17.842160    2549 patch_prober.go:28] interesting pod/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 16 13:08:17.842346 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:17.842225    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97" podUID="af334189-cfac-4d13-80f8-4f13c389286c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 16 13:08:18.670238 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:18.670203    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:18.846264 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:18.846232    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:08:18.847374 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:18.847353    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:08:19.406426 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:19.406389    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:20.396588 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:20.396553    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:21.350952 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:21.350924    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:22.092612 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:22.092584    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:22.912690 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:22.912645    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:23.650925 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:23.650887    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:24.411782 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:24.411750    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:25.157074 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:25.157048    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:25.830689 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:25.830642    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:26.667618 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:26.667579    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:30.328173 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:30.328098    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:35.984178 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:35.984145    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:36.075607 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:36.075563    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:36.139054 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:36.139014    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:36.220871 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:36.220838    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:36.280371 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:36.280294    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:36.577962 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:36.577879    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:36.818302 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:36.818272    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:37.688462 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:37.688428    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:38.461789 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:38.461752    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:39.155826 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:39.155789    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:39.855423 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:39.855386    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:40.713455 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:40.713422    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:41.455601 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:41.455566    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:42.978937 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:42.978905    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:43.083240 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:43.083210    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:43.188160 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:43.188122    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"]
Sep 16 13:08:43.188408 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:43.188378    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" podUID="2d803c47-0d48-4232-b167-04c7557110fe" containerName="istio-proxy" containerID="cri-o://c10262d5fcf18b764d9642efcd92d14bd723f44e8777f65afdca61a91fc8030e" gracePeriod=30
Sep 16 13:08:43.205062 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:43.205035    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:43.656374 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:43.656344    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:44.530208 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:44.530176    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:45.458790 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:45.458758    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:46.335165 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:46.335129    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:47.235352 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:47.235318    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:47.947178 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:47.947148    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:48.439213 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.439189    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:08:48.469066 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.468980    2549 generic.go:356] "Generic (PLEG): container finished" podID="2d803c47-0d48-4232-b167-04c7557110fe" containerID="c10262d5fcf18b764d9642efcd92d14bd723f44e8777f65afdca61a91fc8030e" exitCode=0
Sep 16 13:08:48.469066 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.469034    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"
Sep 16 13:08:48.469260 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.469101    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" event={"ID":"2d803c47-0d48-4232-b167-04c7557110fe","Type":"ContainerDied","Data":"c10262d5fcf18b764d9642efcd92d14bd723f44e8777f65afdca61a91fc8030e"}
Sep 16 13:08:48.469260 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.469147    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf" event={"ID":"2d803c47-0d48-4232-b167-04c7557110fe","Type":"ContainerDied","Data":"ed6fe73900a1ecccd4e6dae645401a91bb4b1e3259d9aea671251161ada7ccea"}
Sep 16 13:08:48.469260 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.469176    2549 scope.go:117] "RemoveContainer" containerID="c10262d5fcf18b764d9642efcd92d14bd723f44e8777f65afdca61a91fc8030e"
Sep 16 13:08:48.479323 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.479311    2549 scope.go:117] "RemoveContainer" containerID="ae789c89a4e9a03b4f5200db7ea5d17ad0289bd020f336b076ddff73a8e87ca3"
Sep 16 13:08:48.488013 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.487995    2549 scope.go:117] "RemoveContainer" containerID="c10262d5fcf18b764d9642efcd92d14bd723f44e8777f65afdca61a91fc8030e"
Sep 16 13:08:48.488288 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:08:48.488261    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c10262d5fcf18b764d9642efcd92d14bd723f44e8777f65afdca61a91fc8030e\": container with ID starting with c10262d5fcf18b764d9642efcd92d14bd723f44e8777f65afdca61a91fc8030e not found: ID does not exist" containerID="c10262d5fcf18b764d9642efcd92d14bd723f44e8777f65afdca61a91fc8030e"
Sep 16 13:08:48.488360 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.488295    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c10262d5fcf18b764d9642efcd92d14bd723f44e8777f65afdca61a91fc8030e"} err="failed to get container status \"c10262d5fcf18b764d9642efcd92d14bd723f44e8777f65afdca61a91fc8030e\": rpc error: code = NotFound desc = could not find container \"c10262d5fcf18b764d9642efcd92d14bd723f44e8777f65afdca61a91fc8030e\": container with ID starting with c10262d5fcf18b764d9642efcd92d14bd723f44e8777f65afdca61a91fc8030e not found: ID does not exist"
Sep 16 13:08:48.488360 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.488314    2549 scope.go:117] "RemoveContainer" containerID="ae789c89a4e9a03b4f5200db7ea5d17ad0289bd020f336b076ddff73a8e87ca3"
Sep 16 13:08:48.488577 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:08:48.488556    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae789c89a4e9a03b4f5200db7ea5d17ad0289bd020f336b076ddff73a8e87ca3\": container with ID starting with ae789c89a4e9a03b4f5200db7ea5d17ad0289bd020f336b076ddff73a8e87ca3 not found: ID does not exist" containerID="ae789c89a4e9a03b4f5200db7ea5d17ad0289bd020f336b076ddff73a8e87ca3"
Sep 16 13:08:48.488640 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.488585    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae789c89a4e9a03b4f5200db7ea5d17ad0289bd020f336b076ddff73a8e87ca3"} err="failed to get container status \"ae789c89a4e9a03b4f5200db7ea5d17ad0289bd020f336b076ddff73a8e87ca3\": rpc error: code = NotFound desc = could not find container \"ae789c89a4e9a03b4f5200db7ea5d17ad0289bd020f336b076ddff73a8e87ca3\": container with ID starting with ae789c89a4e9a03b4f5200db7ea5d17ad0289bd020f336b076ddff73a8e87ca3 not found: ID does not exist"
Sep 16 13:08:48.534634 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.534602    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tl9m\" (UniqueName: \"kubernetes.io/projected/2d803c47-0d48-4232-b167-04c7557110fe-kube-api-access-2tl9m\") pod \"2d803c47-0d48-4232-b167-04c7557110fe\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") "
Sep 16 13:08:48.534744 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.534644    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d803c47-0d48-4232-b167-04c7557110fe-istiod-ca-cert\") pod \"2d803c47-0d48-4232-b167-04c7557110fe\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") "
Sep 16 13:08:48.534744 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.534681    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-credential-socket\") pod \"2d803c47-0d48-4232-b167-04c7557110fe\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") "
Sep 16 13:08:48.534744 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.534715    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-istio-data\") pod \"2d803c47-0d48-4232-b167-04c7557110fe\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") "
Sep 16 13:08:48.534907 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.534768    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-istio-envoy\") pod \"2d803c47-0d48-4232-b167-04c7557110fe\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") "
Sep 16 13:08:48.534907 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.534805    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d803c47-0d48-4232-b167-04c7557110fe-istio-podinfo\") pod \"2d803c47-0d48-4232-b167-04c7557110fe\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") "
Sep 16 13:08:48.534907 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.534837    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d803c47-0d48-4232-b167-04c7557110fe-istio-token\") pod \"2d803c47-0d48-4232-b167-04c7557110fe\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") "
Sep 16 13:08:48.534907 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.534877    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-workload-certs\") pod \"2d803c47-0d48-4232-b167-04c7557110fe\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") "
Sep 16 13:08:48.535114 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.534908    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-workload-socket\") pod \"2d803c47-0d48-4232-b167-04c7557110fe\" (UID: \"2d803c47-0d48-4232-b167-04c7557110fe\") "
Sep 16 13:08:48.535114 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.535009    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d803c47-0d48-4232-b167-04c7557110fe" (UID: "2d803c47-0d48-4232-b167-04c7557110fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:08:48.535114 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.535040    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d803c47-0d48-4232-b167-04c7557110fe" (UID: "2d803c47-0d48-4232-b167-04c7557110fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:08:48.535114 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.535091    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d803c47-0d48-4232-b167-04c7557110fe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d803c47-0d48-4232-b167-04c7557110fe" (UID: "2d803c47-0d48-4232-b167-04c7557110fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:08:48.535335 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.535245    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d803c47-0d48-4232-b167-04c7557110fe" (UID: "2d803c47-0d48-4232-b167-04c7557110fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:08:48.535335 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.535325    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d803c47-0d48-4232-b167-04c7557110fe" (UID: "2d803c47-0d48-4232-b167-04c7557110fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:08:48.535447 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.535372    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d803c47-0d48-4232-b167-04c7557110fe-istiod-ca-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:08:48.535447 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.535393    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-credential-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:08:48.535447 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.535406    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-istio-data\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:08:48.535447 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.535420    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-workload-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:08:48.536908 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.536878    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d803c47-0d48-4232-b167-04c7557110fe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d803c47-0d48-4232-b167-04c7557110fe" (UID: "2d803c47-0d48-4232-b167-04c7557110fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:08:48.536998 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.536884    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d803c47-0d48-4232-b167-04c7557110fe" (UID: "2d803c47-0d48-4232-b167-04c7557110fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:08:48.537205 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.537187    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d803c47-0d48-4232-b167-04c7557110fe-kube-api-access-2tl9m" (OuterVolumeSpecName: "kube-api-access-2tl9m") pod "2d803c47-0d48-4232-b167-04c7557110fe" (UID: "2d803c47-0d48-4232-b167-04c7557110fe"). InnerVolumeSpecName "kube-api-access-2tl9m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:08:48.537284 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.537267    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d803c47-0d48-4232-b167-04c7557110fe-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d803c47-0d48-4232-b167-04c7557110fe" (UID: "2d803c47-0d48-4232-b167-04c7557110fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:08:48.636167 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.636134    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tl9m\" (UniqueName: \"kubernetes.io/projected/2d803c47-0d48-4232-b167-04c7557110fe-kube-api-access-2tl9m\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:08:48.636167 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.636160    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-istio-envoy\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:08:48.636167 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.636170    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d803c47-0d48-4232-b167-04c7557110fe-istio-podinfo\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:08:48.636384 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.636178    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d803c47-0d48-4232-b167-04c7557110fe-istio-token\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:08:48.636384 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.636186    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d803c47-0d48-4232-b167-04c7557110fe-workload-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:08:48.791764 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.791733    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"]
Sep 16 13:08:48.798235 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.798207    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-f0722f-openshift-default-764cbc85fd-f45cf"]
Sep 16 13:08:48.921382 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.921350    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d803c47-0d48-4232-b167-04c7557110fe" path="/var/lib/kubelet/pods/2d803c47-0d48-4232-b167-04c7557110fe/volumes"
Sep 16 13:08:48.933189 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:48.933163    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:49.744687 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:49.744655    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:50.438457 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:50.438427    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:51.585779 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:51.585747    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:51.700401 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:51.700367    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:59.149087 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.149050    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:59.186656 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.186624    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"]
Sep 16 13:08:59.186956 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.186897    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4" podUID="86ac7e9d-a799-4444-a57c-c4c86549f2db" containerName="payload-pre-processing" containerID="cri-o://b11dcf34468cad5b9a31600774c36a9872d92165f64d4eecd0b4d96dd870be55" gracePeriod=30
Sep 16 13:08:59.209325 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.209295    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:59.278371 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.278341    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:59.347428 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.347391    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:59.440223 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.440195    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"
Sep 16 13:08:59.536127 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.536093    2549 generic.go:356] "Generic (PLEG): container finished" podID="86ac7e9d-a799-4444-a57c-c4c86549f2db" containerID="b11dcf34468cad5b9a31600774c36a9872d92165f64d4eecd0b4d96dd870be55" exitCode=0
Sep 16 13:08:59.536325 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.536142    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"
Sep 16 13:08:59.536325 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.536174    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4" event={"ID":"86ac7e9d-a799-4444-a57c-c4c86549f2db","Type":"ContainerDied","Data":"b11dcf34468cad5b9a31600774c36a9872d92165f64d4eecd0b4d96dd870be55"}
Sep 16 13:08:59.536325 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.536231    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4" event={"ID":"86ac7e9d-a799-4444-a57c-c4c86549f2db","Type":"ContainerDied","Data":"2d2ee68999e0618843505a2e5c433bcb3fc5100b7a3129b5bb6e906bdacc8433"}
Sep 16 13:08:59.536325 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.536258    2549 scope.go:117] "RemoveContainer" containerID="b11dcf34468cad5b9a31600774c36a9872d92165f64d4eecd0b4d96dd870be55"
Sep 16 13:08:59.538652 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.538626    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hqnj\" (UniqueName: \"kubernetes.io/projected/86ac7e9d-a799-4444-a57c-c4c86549f2db-kube-api-access-5hqnj\") pod \"86ac7e9d-a799-4444-a57c-c4c86549f2db\" (UID: \"86ac7e9d-a799-4444-a57c-c4c86549f2db\") "
Sep 16 13:08:59.538784 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.538698    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86ac7e9d-a799-4444-a57c-c4c86549f2db-plugins-config-volume\") pod \"86ac7e9d-a799-4444-a57c-c4c86549f2db\" (UID: \"86ac7e9d-a799-4444-a57c-c4c86549f2db\") "
Sep 16 13:08:59.539086 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.539054    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86ac7e9d-a799-4444-a57c-c4c86549f2db-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "86ac7e9d-a799-4444-a57c-c4c86549f2db" (UID: "86ac7e9d-a799-4444-a57c-c4c86549f2db"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:08:59.541198 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.541163    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86ac7e9d-a799-4444-a57c-c4c86549f2db-kube-api-access-5hqnj" (OuterVolumeSpecName: "kube-api-access-5hqnj") pod "86ac7e9d-a799-4444-a57c-c4c86549f2db" (UID: "86ac7e9d-a799-4444-a57c-c4c86549f2db"). InnerVolumeSpecName "kube-api-access-5hqnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:08:59.555413 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.555384    2549 scope.go:117] "RemoveContainer" containerID="b11dcf34468cad5b9a31600774c36a9872d92165f64d4eecd0b4d96dd870be55"
Sep 16 13:08:59.555809 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:08:59.555783    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b11dcf34468cad5b9a31600774c36a9872d92165f64d4eecd0b4d96dd870be55\": container with ID starting with b11dcf34468cad5b9a31600774c36a9872d92165f64d4eecd0b4d96dd870be55 not found: ID does not exist" containerID="b11dcf34468cad5b9a31600774c36a9872d92165f64d4eecd0b4d96dd870be55"
Sep 16 13:08:59.555893 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.555820    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b11dcf34468cad5b9a31600774c36a9872d92165f64d4eecd0b4d96dd870be55"} err="failed to get container status \"b11dcf34468cad5b9a31600774c36a9872d92165f64d4eecd0b4d96dd870be55\": rpc error: code = NotFound desc = could not find container \"b11dcf34468cad5b9a31600774c36a9872d92165f64d4eecd0b4d96dd870be55\": container with ID starting with b11dcf34468cad5b9a31600774c36a9872d92165f64d4eecd0b4d96dd870be55 not found: ID does not exist"
Sep 16 13:08:59.640207 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.640177    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hqnj\" (UniqueName: \"kubernetes.io/projected/86ac7e9d-a799-4444-a57c-c4c86549f2db-kube-api-access-5hqnj\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:08:59.640207 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.640206    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86ac7e9d-a799-4444-a57c-c4c86549f2db-plugins-config-volume\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:08:59.717954 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.717826    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:59.815021 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.814991    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:08:59.861704 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.861666    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"]
Sep 16 13:08:59.864913 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:08:59.864881    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-94f3e1-5d4df6fbfd-wkbt4"]
Sep 16 13:09:00.537952 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:00.537912    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:00.920544 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:00.920516    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86ac7e9d-a799-4444-a57c-c4c86549f2db" path="/var/lib/kubelet/pods/86ac7e9d-a799-4444-a57c-c4c86549f2db/volumes"
Sep 16 13:09:01.238216 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:01.238126    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:02.054690 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:02.054662    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:02.861511 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:02.861450    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:03.711819 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:03.711786    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:05.962301 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:05.962272    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:06.065327 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:06.065293    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:06.205211 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:06.205181    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"]
Sep 16 13:09:06.205425 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:06.205401    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97" podUID="af334189-cfac-4d13-80f8-4f13c389286c" containerName="istio-proxy" containerID="cri-o://1fd1a581c9d5bc610d05098fd3c432384737ce9573f5788b91a3e2f2efda7918" gracePeriod=30
Sep 16 13:09:06.217113 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:06.217049    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:07.351788 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:07.351744    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:08.256870 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:08.256835    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:09.018464 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:09.018433    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:09.680912 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:09.680879    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:10.515469 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:10.515436    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:11.286220 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.286189    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:11.461635 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.461612    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:09:11.553492 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.553336    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-credential-socket\") pod \"af334189-cfac-4d13-80f8-4f13c389286c\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") "
Sep 16 13:09:11.553492 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.553405    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-istio-data\") pod \"af334189-cfac-4d13-80f8-4f13c389286c\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") "
Sep 16 13:09:11.553492 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.553466    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xk29z\" (UniqueName: \"kubernetes.io/projected/af334189-cfac-4d13-80f8-4f13c389286c-kube-api-access-xk29z\") pod \"af334189-cfac-4d13-80f8-4f13c389286c\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") "
Sep 16 13:09:11.554365 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.553510    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af334189-cfac-4d13-80f8-4f13c389286c-istio-podinfo\") pod \"af334189-cfac-4d13-80f8-4f13c389286c\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") "
Sep 16 13:09:11.554365 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.553571    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-workload-socket\") pod \"af334189-cfac-4d13-80f8-4f13c389286c\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") "
Sep 16 13:09:11.554365 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.553606    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-istio-envoy\") pod \"af334189-cfac-4d13-80f8-4f13c389286c\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") "
Sep 16 13:09:11.554365 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.553627    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af334189-cfac-4d13-80f8-4f13c389286c-istio-token\") pod \"af334189-cfac-4d13-80f8-4f13c389286c\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") "
Sep 16 13:09:11.554365 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.553668    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-workload-certs\") pod \"af334189-cfac-4d13-80f8-4f13c389286c\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") "
Sep 16 13:09:11.554365 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.553694    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-istio-data" (OuterVolumeSpecName: "istio-data") pod "af334189-cfac-4d13-80f8-4f13c389286c" (UID: "af334189-cfac-4d13-80f8-4f13c389286c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:09:11.554365 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.553704    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af334189-cfac-4d13-80f8-4f13c389286c-istiod-ca-cert\") pod \"af334189-cfac-4d13-80f8-4f13c389286c\" (UID: \"af334189-cfac-4d13-80f8-4f13c389286c\") "
Sep 16 13:09:11.554365 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.553885    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "af334189-cfac-4d13-80f8-4f13c389286c" (UID: "af334189-cfac-4d13-80f8-4f13c389286c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:09:11.554365 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.554080    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-istio-data\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:11.554365 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.554100    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-workload-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:11.556944 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.554421    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "af334189-cfac-4d13-80f8-4f13c389286c" (UID: "af334189-cfac-4d13-80f8-4f13c389286c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:09:11.556944 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.554637    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "af334189-cfac-4d13-80f8-4f13c389286c" (UID: "af334189-cfac-4d13-80f8-4f13c389286c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:09:11.556944 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.555128    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af334189-cfac-4d13-80f8-4f13c389286c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "af334189-cfac-4d13-80f8-4f13c389286c" (UID: "af334189-cfac-4d13-80f8-4f13c389286c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:09:11.556944 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.556742    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "af334189-cfac-4d13-80f8-4f13c389286c" (UID: "af334189-cfac-4d13-80f8-4f13c389286c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:09:11.556944 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.556762    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af334189-cfac-4d13-80f8-4f13c389286c-kube-api-access-xk29z" (OuterVolumeSpecName: "kube-api-access-xk29z") pod "af334189-cfac-4d13-80f8-4f13c389286c" (UID: "af334189-cfac-4d13-80f8-4f13c389286c"). InnerVolumeSpecName "kube-api-access-xk29z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:09:11.557717 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.557680    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af334189-cfac-4d13-80f8-4f13c389286c-istio-token" (OuterVolumeSpecName: "istio-token") pod "af334189-cfac-4d13-80f8-4f13c389286c" (UID: "af334189-cfac-4d13-80f8-4f13c389286c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:09:11.557931 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.557899    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/af334189-cfac-4d13-80f8-4f13c389286c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "af334189-cfac-4d13-80f8-4f13c389286c" (UID: "af334189-cfac-4d13-80f8-4f13c389286c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:09:11.608195 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.608157    2549 generic.go:356] "Generic (PLEG): container finished" podID="af334189-cfac-4d13-80f8-4f13c389286c" containerID="1fd1a581c9d5bc610d05098fd3c432384737ce9573f5788b91a3e2f2efda7918" exitCode=0
Sep 16 13:09:11.608383 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.608258    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"
Sep 16 13:09:11.608383 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.608297    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97" event={"ID":"af334189-cfac-4d13-80f8-4f13c389286c","Type":"ContainerDied","Data":"1fd1a581c9d5bc610d05098fd3c432384737ce9573f5788b91a3e2f2efda7918"}
Sep 16 13:09:11.608383 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.608375    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97" event={"ID":"af334189-cfac-4d13-80f8-4f13c389286c","Type":"ContainerDied","Data":"23fe8c80b3a76fa3b8946e450e324f7d9e8fb0be19f54b46381a33aa2ff206ff"}
Sep 16 13:09:11.608580 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.608408    2549 scope.go:117] "RemoveContainer" containerID="1fd1a581c9d5bc610d05098fd3c432384737ce9573f5788b91a3e2f2efda7918"
Sep 16 13:09:11.620389 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.620364    2549 scope.go:117] "RemoveContainer" containerID="f5227e2b93e51e2c6537578545e0482985e59d4a812365cf92135c5bed470cb6"
Sep 16 13:09:11.629509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.629493    2549 scope.go:117] "RemoveContainer" containerID="1fd1a581c9d5bc610d05098fd3c432384737ce9573f5788b91a3e2f2efda7918"
Sep 16 13:09:11.629779 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:09:11.629762    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fd1a581c9d5bc610d05098fd3c432384737ce9573f5788b91a3e2f2efda7918\": container with ID starting with 1fd1a581c9d5bc610d05098fd3c432384737ce9573f5788b91a3e2f2efda7918 not found: ID does not exist" containerID="1fd1a581c9d5bc610d05098fd3c432384737ce9573f5788b91a3e2f2efda7918"
Sep 16 13:09:11.629850 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.629787    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fd1a581c9d5bc610d05098fd3c432384737ce9573f5788b91a3e2f2efda7918"} err="failed to get container status \"1fd1a581c9d5bc610d05098fd3c432384737ce9573f5788b91a3e2f2efda7918\": rpc error: code = NotFound desc = could not find container \"1fd1a581c9d5bc610d05098fd3c432384737ce9573f5788b91a3e2f2efda7918\": container with ID starting with 1fd1a581c9d5bc610d05098fd3c432384737ce9573f5788b91a3e2f2efda7918 not found: ID does not exist"
Sep 16 13:09:11.629850 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.629802    2549 scope.go:117] "RemoveContainer" containerID="f5227e2b93e51e2c6537578545e0482985e59d4a812365cf92135c5bed470cb6"
Sep 16 13:09:11.630043 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:09:11.630027    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5227e2b93e51e2c6537578545e0482985e59d4a812365cf92135c5bed470cb6\": container with ID starting with f5227e2b93e51e2c6537578545e0482985e59d4a812365cf92135c5bed470cb6 not found: ID does not exist" containerID="f5227e2b93e51e2c6537578545e0482985e59d4a812365cf92135c5bed470cb6"
Sep 16 13:09:11.630086 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.630047    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5227e2b93e51e2c6537578545e0482985e59d4a812365cf92135c5bed470cb6"} err="failed to get container status \"f5227e2b93e51e2c6537578545e0482985e59d4a812365cf92135c5bed470cb6\": rpc error: code = NotFound desc = could not find container \"f5227e2b93e51e2c6537578545e0482985e59d4a812365cf92135c5bed470cb6\": container with ID starting with f5227e2b93e51e2c6537578545e0482985e59d4a812365cf92135c5bed470cb6 not found: ID does not exist"
Sep 16 13:09:11.634905 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.634880    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"]
Sep 16 13:09:11.640072 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.640050    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-94f3e1-openshift-default-5945d49bfd-trl97"]
Sep 16 13:09:11.654863 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.654840    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-istio-envoy\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:11.654863 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.654865    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/af334189-cfac-4d13-80f8-4f13c389286c-istio-token\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:11.655004 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.654877    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-workload-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:11.655004 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.654891    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/af334189-cfac-4d13-80f8-4f13c389286c-istiod-ca-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:11.655004 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.654904    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/af334189-cfac-4d13-80f8-4f13c389286c-credential-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:11.655004 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.654916    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk29z\" (UniqueName: \"kubernetes.io/projected/af334189-cfac-4d13-80f8-4f13c389286c-kube-api-access-xk29z\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:11.655004 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:11.654930    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/af334189-cfac-4d13-80f8-4f13c389286c-istio-podinfo\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:12.920935 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:12.920905    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af334189-cfac-4d13-80f8-4f13c389286c" path="/var/lib/kubelet/pods/af334189-cfac-4d13-80f8-4f13c389286c/volumes"
Sep 16 13:09:16.922841 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:16.922808    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:17.632187 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:17.632154    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:18.414654 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:18.414622    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:19.186734 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:19.186699    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:19.890858 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:19.890822    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:20.837313 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:20.837284    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:21.611788 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:21.611750    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:21.663777 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:21.663740    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"]
Sep 16 13:09:21.664043 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:21.663999    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw" podUID="a81b8c91-8d11-47b9-92dd-1642599c6159" containerName="payload-processing" containerID="cri-o://d8e268c1191f29c0df798a951dd4beab4cf39abf01f4724b340df22136961902" gracePeriod=30
Sep 16 13:09:21.704171 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:21.704142    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:21.806585 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:21.806531    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:21.909437 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:21.909407    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:21.948654 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:21.948627    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"
Sep 16 13:09:22.011897 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.011864    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:22.046231 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.046197    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81b8c91-8d11-47b9-92dd-1642599c6159-plugins-config-volume\") pod \"a81b8c91-8d11-47b9-92dd-1642599c6159\" (UID: \"a81b8c91-8d11-47b9-92dd-1642599c6159\") "
Sep 16 13:09:22.046428 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.046375    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xk4lv\" (UniqueName: \"kubernetes.io/projected/a81b8c91-8d11-47b9-92dd-1642599c6159-kube-api-access-xk4lv\") pod \"a81b8c91-8d11-47b9-92dd-1642599c6159\" (UID: \"a81b8c91-8d11-47b9-92dd-1642599c6159\") "
Sep 16 13:09:22.046648 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.046619    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a81b8c91-8d11-47b9-92dd-1642599c6159-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a81b8c91-8d11-47b9-92dd-1642599c6159" (UID: "a81b8c91-8d11-47b9-92dd-1642599c6159"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:09:22.048445 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.048420    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a81b8c91-8d11-47b9-92dd-1642599c6159-kube-api-access-xk4lv" (OuterVolumeSpecName: "kube-api-access-xk4lv") pod "a81b8c91-8d11-47b9-92dd-1642599c6159" (UID: "a81b8c91-8d11-47b9-92dd-1642599c6159"). InnerVolumeSpecName "kube-api-access-xk4lv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:09:22.109456 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.109424    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:22.147781 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.147747    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk4lv\" (UniqueName: \"kubernetes.io/projected/a81b8c91-8d11-47b9-92dd-1642599c6159-kube-api-access-xk4lv\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:22.147781 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.147776    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a81b8c91-8d11-47b9-92dd-1642599c6159-plugins-config-volume\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:22.303885 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.303812    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:22.681765 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.681731    2549 generic.go:356] "Generic (PLEG): container finished" podID="a81b8c91-8d11-47b9-92dd-1642599c6159" containerID="d8e268c1191f29c0df798a951dd4beab4cf39abf01f4724b340df22136961902" exitCode=0
Sep 16 13:09:22.682174 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.681778    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"
Sep 16 13:09:22.682174 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.681805    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw" event={"ID":"a81b8c91-8d11-47b9-92dd-1642599c6159","Type":"ContainerDied","Data":"d8e268c1191f29c0df798a951dd4beab4cf39abf01f4724b340df22136961902"}
Sep 16 13:09:22.682174 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.681881    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw" event={"ID":"a81b8c91-8d11-47b9-92dd-1642599c6159","Type":"ContainerDied","Data":"4ee64a2c7f1bec4b5b1343383b852810d43366ad0c84128fb7060b13c21a72aa"}
Sep 16 13:09:22.682174 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.681903    2549 scope.go:117] "RemoveContainer" containerID="d8e268c1191f29c0df798a951dd4beab4cf39abf01f4724b340df22136961902"
Sep 16 13:09:22.691888 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.691871    2549 scope.go:117] "RemoveContainer" containerID="d8e268c1191f29c0df798a951dd4beab4cf39abf01f4724b340df22136961902"
Sep 16 13:09:22.692163 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:09:22.692146    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8e268c1191f29c0df798a951dd4beab4cf39abf01f4724b340df22136961902\": container with ID starting with d8e268c1191f29c0df798a951dd4beab4cf39abf01f4724b340df22136961902 not found: ID does not exist" containerID="d8e268c1191f29c0df798a951dd4beab4cf39abf01f4724b340df22136961902"
Sep 16 13:09:22.692200 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.692172    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e268c1191f29c0df798a951dd4beab4cf39abf01f4724b340df22136961902"} err="failed to get container status \"d8e268c1191f29c0df798a951dd4beab4cf39abf01f4724b340df22136961902\": rpc error: code = NotFound desc = could not find container \"d8e268c1191f29c0df798a951dd4beab4cf39abf01f4724b340df22136961902\": container with ID starting with d8e268c1191f29c0df798a951dd4beab4cf39abf01f4724b340df22136961902 not found: ID does not exist"
Sep 16 13:09:22.706270 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.706246    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"]
Sep 16 13:09:22.711474 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.711451    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-863d9d-7b95757497-q6fgw"]
Sep 16 13:09:22.921405 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.921359    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a81b8c91-8d11-47b9-92dd-1642599c6159" path="/var/lib/kubelet/pods/a81b8c91-8d11-47b9-92dd-1642599c6159/volumes"
Sep 16 13:09:22.958737 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:22.958665    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:23.922685 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:23.922654    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:24.659289 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:24.659259    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:25.640747 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:25.640695    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:26.544366 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:26.544329    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:28.587934 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:28.587900    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:28.688604 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:28.688576    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:28.832662 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:28.832629    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"]
Sep 16 13:09:28.832939 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:28.832915    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh" podUID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerName="istio-proxy" containerID="cri-o://086eab63d36f1eb2ce4c4148d783e0cac145ff9470bb928a8a303036b9efafc8" gracePeriod=30
Sep 16 13:09:28.890433 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:28.890351    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:29.566173 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:29.566137    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:30.442838 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:30.442806    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:31.271924 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:31.271886    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:31.434752 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:31.434711    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:32.144436 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:32.144396    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:32.762327 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:32.762296    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:32.873895 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:32.873862    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"]
Sep 16 13:09:32.874097 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:32.874074    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2" podUID="6212821b-473d-42b7-8bf5-b920f6cc7427" containerName="maas-api" containerID="cri-o://bda44e087e317f65b1238297b2f22cd658855d80b2b56b5086a09cb4d5ad46f8" gracePeriod=30
Sep 16 13:09:32.906700 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:32.906675    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:32.933972 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:32.933934    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"]
Sep 16 13:09:32.934209 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:32.934183    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd" podUID="797ca2fd-20a5-4a75-b779-655605985b2c" containerName="payload-processing" containerID="cri-o://ec53d5c71557828eb598e94c4dcb0e52e736ffe0de82be353a6ad252281c603b" gracePeriod=30
Sep 16 13:09:32.945760 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:32.945734    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"]
Sep 16 13:09:32.946099 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:32.945995    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv" podUID="897140a0-dccb-4a6c-9e18-45298edf10cf" containerName="payload-pre-processing" containerID="cri-o://ab889458af6bf586c35141e1bdb7ef4e00257b31ec298ad999dc81c1eef84396" gracePeriod=30
Sep 16 13:09:32.982882 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:32.982775    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:33.050665 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.050557    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:33.153174 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.153134    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:33.241124 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.241091    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 13:09:33.250824 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.250791    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:33.258103 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.258070    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"
Sep 16 13:09:33.277526 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.271007    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"
Sep 16 13:09:33.353029 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.352928    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-knsxv\" (UniqueName: \"kubernetes.io/projected/797ca2fd-20a5-4a75-b779-655605985b2c-kube-api-access-knsxv\") pod \"797ca2fd-20a5-4a75-b779-655605985b2c\" (UID: \"797ca2fd-20a5-4a75-b779-655605985b2c\") "
Sep 16 13:09:33.353029 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.353002    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhhj8\" (UniqueName: \"kubernetes.io/projected/6212821b-473d-42b7-8bf5-b920f6cc7427-kube-api-access-zhhj8\") pod \"6212821b-473d-42b7-8bf5-b920f6cc7427\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") "
Sep 16 13:09:33.353326 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.353076    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/797ca2fd-20a5-4a75-b779-655605985b2c-plugins-config-volume\") pod \"797ca2fd-20a5-4a75-b779-655605985b2c\" (UID: \"797ca2fd-20a5-4a75-b779-655605985b2c\") "
Sep 16 13:09:33.353326 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.353102    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6212821b-473d-42b7-8bf5-b920f6cc7427-openshift-service-ca\") pod \"6212821b-473d-42b7-8bf5-b920f6cc7427\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") "
Sep 16 13:09:33.353326 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.353150    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-metrics-certs\") pod \"6212821b-473d-42b7-8bf5-b920f6cc7427\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") "
Sep 16 13:09:33.353326 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.353194    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx287\" (UniqueName: \"kubernetes.io/projected/897140a0-dccb-4a6c-9e18-45298edf10cf-kube-api-access-gx287\") pod \"897140a0-dccb-4a6c-9e18-45298edf10cf\" (UID: \"897140a0-dccb-4a6c-9e18-45298edf10cf\") "
Sep 16 13:09:33.353326 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.353226    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-maas-api-tls\") pod \"6212821b-473d-42b7-8bf5-b920f6cc7427\" (UID: \"6212821b-473d-42b7-8bf5-b920f6cc7427\") "
Sep 16 13:09:33.353326 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.353257    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/897140a0-dccb-4a6c-9e18-45298edf10cf-plugins-config-volume\") pod \"897140a0-dccb-4a6c-9e18-45298edf10cf\" (UID: \"897140a0-dccb-4a6c-9e18-45298edf10cf\") "
Sep 16 13:09:33.353832 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.353771    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6212821b-473d-42b7-8bf5-b920f6cc7427-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6212821b-473d-42b7-8bf5-b920f6cc7427" (UID: "6212821b-473d-42b7-8bf5-b920f6cc7427"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:09:33.353958 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.353930    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/797ca2fd-20a5-4a75-b779-655605985b2c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "797ca2fd-20a5-4a75-b779-655605985b2c" (UID: "797ca2fd-20a5-4a75-b779-655605985b2c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:09:33.353958 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.353942    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/897140a0-dccb-4a6c-9e18-45298edf10cf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "897140a0-dccb-4a6c-9e18-45298edf10cf" (UID: "897140a0-dccb-4a6c-9e18-45298edf10cf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:09:33.355626 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.355592    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6212821b-473d-42b7-8bf5-b920f6cc7427" (UID: "6212821b-473d-42b7-8bf5-b920f6cc7427"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:09:33.355957 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.355930    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/897140a0-dccb-4a6c-9e18-45298edf10cf-kube-api-access-gx287" (OuterVolumeSpecName: "kube-api-access-gx287") pod "897140a0-dccb-4a6c-9e18-45298edf10cf" (UID: "897140a0-dccb-4a6c-9e18-45298edf10cf"). InnerVolumeSpecName "kube-api-access-gx287". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:09:33.356045 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.356025    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6212821b-473d-42b7-8bf5-b920f6cc7427" (UID: "6212821b-473d-42b7-8bf5-b920f6cc7427"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:09:33.356172 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.356158    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6212821b-473d-42b7-8bf5-b920f6cc7427-kube-api-access-zhhj8" (OuterVolumeSpecName: "kube-api-access-zhhj8") pod "6212821b-473d-42b7-8bf5-b920f6cc7427" (UID: "6212821b-473d-42b7-8bf5-b920f6cc7427"). InnerVolumeSpecName "kube-api-access-zhhj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:09:33.356269 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.356257    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/797ca2fd-20a5-4a75-b779-655605985b2c-kube-api-access-knsxv" (OuterVolumeSpecName: "kube-api-access-knsxv") pod "797ca2fd-20a5-4a75-b779-655605985b2c" (UID: "797ca2fd-20a5-4a75-b779-655605985b2c"). InnerVolumeSpecName "kube-api-access-knsxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:09:33.454761 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.454727    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx287\" (UniqueName: \"kubernetes.io/projected/897140a0-dccb-4a6c-9e18-45298edf10cf-kube-api-access-gx287\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:33.454761 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.454756    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-maas-api-tls\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:33.454761 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.454765    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/897140a0-dccb-4a6c-9e18-45298edf10cf-plugins-config-volume\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:33.454994 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.454774    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-knsxv\" (UniqueName: \"kubernetes.io/projected/797ca2fd-20a5-4a75-b779-655605985b2c-kube-api-access-knsxv\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:33.454994 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.454783    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhhj8\" (UniqueName: \"kubernetes.io/projected/6212821b-473d-42b7-8bf5-b920f6cc7427-kube-api-access-zhhj8\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:33.454994 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.454792    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/797ca2fd-20a5-4a75-b779-655605985b2c-plugins-config-volume\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:33.454994 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.454799    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6212821b-473d-42b7-8bf5-b920f6cc7427-openshift-service-ca\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:33.454994 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.454807    2549 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6212821b-473d-42b7-8bf5-b920f6cc7427-metrics-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:33.514102 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.514065    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:33.754088 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.754056    2549 generic.go:356] "Generic (PLEG): container finished" podID="797ca2fd-20a5-4a75-b779-655605985b2c" containerID="ec53d5c71557828eb598e94c4dcb0e52e736ffe0de82be353a6ad252281c603b" exitCode=0
Sep 16 13:09:33.754283 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.754098    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"
Sep 16 13:09:33.754283 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.754137    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd" event={"ID":"797ca2fd-20a5-4a75-b779-655605985b2c","Type":"ContainerDied","Data":"ec53d5c71557828eb598e94c4dcb0e52e736ffe0de82be353a6ad252281c603b"}
Sep 16 13:09:33.754283 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.754204    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd" event={"ID":"797ca2fd-20a5-4a75-b779-655605985b2c","Type":"ContainerDied","Data":"6790af31ce7187dac4e33948eb6851468cd9657b989e7bc5992729ed067c562b"}
Sep 16 13:09:33.754283 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.754236    2549 scope.go:117] "RemoveContainer" containerID="ec53d5c71557828eb598e94c4dcb0e52e736ffe0de82be353a6ad252281c603b"
Sep 16 13:09:33.755726 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.755702    2549 generic.go:356] "Generic (PLEG): container finished" podID="897140a0-dccb-4a6c-9e18-45298edf10cf" containerID="ab889458af6bf586c35141e1bdb7ef4e00257b31ec298ad999dc81c1eef84396" exitCode=0
Sep 16 13:09:33.755855 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.755754    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"
Sep 16 13:09:33.755855 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.755800    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv" event={"ID":"897140a0-dccb-4a6c-9e18-45298edf10cf","Type":"ContainerDied","Data":"ab889458af6bf586c35141e1bdb7ef4e00257b31ec298ad999dc81c1eef84396"}
Sep 16 13:09:33.755855 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.755846    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv" event={"ID":"897140a0-dccb-4a6c-9e18-45298edf10cf","Type":"ContainerDied","Data":"7ac7dad8e167ab591c518eeb8df8162b52cd0402521215143bda28d46f6280e8"}
Sep 16 13:09:33.757246 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.757223    2549 generic.go:356] "Generic (PLEG): container finished" podID="6212821b-473d-42b7-8bf5-b920f6cc7427" containerID="bda44e087e317f65b1238297b2f22cd658855d80b2b56b5086a09cb4d5ad46f8" exitCode=0
Sep 16 13:09:33.757368 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.757258    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"
Sep 16 13:09:33.757368 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.757296    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2" event={"ID":"6212821b-473d-42b7-8bf5-b920f6cc7427","Type":"ContainerDied","Data":"bda44e087e317f65b1238297b2f22cd658855d80b2b56b5086a09cb4d5ad46f8"}
Sep 16 13:09:33.757368 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.757355    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2" event={"ID":"6212821b-473d-42b7-8bf5-b920f6cc7427","Type":"ContainerDied","Data":"509fd471460aa7bd98d05fa5f719ba9578faef1aae6f2daa352861a6a0f7cd50"}
Sep 16 13:09:33.765024 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.764823    2549 scope.go:117] "RemoveContainer" containerID="ec53d5c71557828eb598e94c4dcb0e52e736ffe0de82be353a6ad252281c603b"
Sep 16 13:09:33.765167 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:09:33.765143    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec53d5c71557828eb598e94c4dcb0e52e736ffe0de82be353a6ad252281c603b\": container with ID starting with ec53d5c71557828eb598e94c4dcb0e52e736ffe0de82be353a6ad252281c603b not found: ID does not exist" containerID="ec53d5c71557828eb598e94c4dcb0e52e736ffe0de82be353a6ad252281c603b"
Sep 16 13:09:33.765290 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.765173    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec53d5c71557828eb598e94c4dcb0e52e736ffe0de82be353a6ad252281c603b"} err="failed to get container status \"ec53d5c71557828eb598e94c4dcb0e52e736ffe0de82be353a6ad252281c603b\": rpc error: code = NotFound desc = could not find container \"ec53d5c71557828eb598e94c4dcb0e52e736ffe0de82be353a6ad252281c603b\": container with ID starting with ec53d5c71557828eb598e94c4dcb0e52e736ffe0de82be353a6ad252281c603b not found: ID does not exist"
Sep 16 13:09:33.765290 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.765196    2549 scope.go:117] "RemoveContainer" containerID="ab889458af6bf586c35141e1bdb7ef4e00257b31ec298ad999dc81c1eef84396"
Sep 16 13:09:33.774542 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.774524    2549 scope.go:117] "RemoveContainer" containerID="ab889458af6bf586c35141e1bdb7ef4e00257b31ec298ad999dc81c1eef84396"
Sep 16 13:09:33.774804 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:09:33.774787    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab889458af6bf586c35141e1bdb7ef4e00257b31ec298ad999dc81c1eef84396\": container with ID starting with ab889458af6bf586c35141e1bdb7ef4e00257b31ec298ad999dc81c1eef84396 not found: ID does not exist" containerID="ab889458af6bf586c35141e1bdb7ef4e00257b31ec298ad999dc81c1eef84396"
Sep 16 13:09:33.774804 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.774808    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab889458af6bf586c35141e1bdb7ef4e00257b31ec298ad999dc81c1eef84396"} err="failed to get container status \"ab889458af6bf586c35141e1bdb7ef4e00257b31ec298ad999dc81c1eef84396\": rpc error: code = NotFound desc = could not find container \"ab889458af6bf586c35141e1bdb7ef4e00257b31ec298ad999dc81c1eef84396\": container with ID starting with ab889458af6bf586c35141e1bdb7ef4e00257b31ec298ad999dc81c1eef84396 not found: ID does not exist"
Sep 16 13:09:33.774982 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.774821    2549 scope.go:117] "RemoveContainer" containerID="bda44e087e317f65b1238297b2f22cd658855d80b2b56b5086a09cb4d5ad46f8"
Sep 16 13:09:33.781723 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.781702    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"]
Sep 16 13:09:33.783622 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.783589    2549 scope.go:117] "RemoveContainer" containerID="bda44e087e317f65b1238297b2f22cd658855d80b2b56b5086a09cb4d5ad46f8"
Sep 16 13:09:33.783878 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:09:33.783859    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bda44e087e317f65b1238297b2f22cd658855d80b2b56b5086a09cb4d5ad46f8\": container with ID starting with bda44e087e317f65b1238297b2f22cd658855d80b2b56b5086a09cb4d5ad46f8 not found: ID does not exist" containerID="bda44e087e317f65b1238297b2f22cd658855d80b2b56b5086a09cb4d5ad46f8"
Sep 16 13:09:33.783944 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.783886    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bda44e087e317f65b1238297b2f22cd658855d80b2b56b5086a09cb4d5ad46f8"} err="failed to get container status \"bda44e087e317f65b1238297b2f22cd658855d80b2b56b5086a09cb4d5ad46f8\": rpc error: code = NotFound desc = could not find container \"bda44e087e317f65b1238297b2f22cd658855d80b2b56b5086a09cb4d5ad46f8\": container with ID starting with bda44e087e317f65b1238297b2f22cd658855d80b2b56b5086a09cb4d5ad46f8 not found: ID does not exist"
Sep 16 13:09:33.785688 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.785667    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-7d0256-85bb5876ff-wplbd"]
Sep 16 13:09:33.796472 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.796450    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"]
Sep 16 13:09:33.805150 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.804223    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-7d0256-77f5749d98-5ngfv"]
Sep 16 13:09:33.823738 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.823705    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"]
Sep 16 13:09:33.826776 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:33.826754    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-7d0256-7784fc6c6b-xntc2"]
Sep 16 13:09:34.077395 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.077369    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:34.080726 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.080708    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:09:34.159986 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.159956    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-workload-socket\") pod \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") "
Sep 16 13:09:34.159986 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.159990    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-envoy\") pod \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") "
Sep 16 13:09:34.160515 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.160053    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-credential-socket\") pod \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") "
Sep 16 13:09:34.160515 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.160078    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-token\") pod \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") "
Sep 16 13:09:34.160515 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.160101    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-workload-certs\") pod \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") "
Sep 16 13:09:34.160515 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.160132    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istiod-ca-cert\") pod \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") "
Sep 16 13:09:34.160515 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.160159    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-podinfo\") pod \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") "
Sep 16 13:09:34.160515 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.160199    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-data\") pod \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") "
Sep 16 13:09:34.160515 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.160227    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29v2r\" (UniqueName: \"kubernetes.io/projected/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-kube-api-access-29v2r\") pod \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\" (UID: \"402d8bc2-dc12-4c04-8b2b-a9bfdab320db\") "
Sep 16 13:09:34.160515 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.160291    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "402d8bc2-dc12-4c04-8b2b-a9bfdab320db" (UID: "402d8bc2-dc12-4c04-8b2b-a9bfdab320db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:09:34.160515 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.160426    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "402d8bc2-dc12-4c04-8b2b-a9bfdab320db" (UID: "402d8bc2-dc12-4c04-8b2b-a9bfdab320db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:09:34.160938 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.160577    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-credential-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:34.160938 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.160597    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-workload-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:34.160938 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.160623    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-data" (OuterVolumeSpecName: "istio-data") pod "402d8bc2-dc12-4c04-8b2b-a9bfdab320db" (UID: "402d8bc2-dc12-4c04-8b2b-a9bfdab320db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:09:34.160938 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.160680    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "402d8bc2-dc12-4c04-8b2b-a9bfdab320db" (UID: "402d8bc2-dc12-4c04-8b2b-a9bfdab320db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:09:34.160938 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.160465    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "402d8bc2-dc12-4c04-8b2b-a9bfdab320db" (UID: "402d8bc2-dc12-4c04-8b2b-a9bfdab320db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:09:34.162447 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.162418    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "402d8bc2-dc12-4c04-8b2b-a9bfdab320db" (UID: "402d8bc2-dc12-4c04-8b2b-a9bfdab320db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:09:34.162447 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.162433    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-token" (OuterVolumeSpecName: "istio-token") pod "402d8bc2-dc12-4c04-8b2b-a9bfdab320db" (UID: "402d8bc2-dc12-4c04-8b2b-a9bfdab320db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:09:34.162734 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.162718    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "402d8bc2-dc12-4c04-8b2b-a9bfdab320db" (UID: "402d8bc2-dc12-4c04-8b2b-a9bfdab320db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:09:34.162799 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.162735    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-kube-api-access-29v2r" (OuterVolumeSpecName: "kube-api-access-29v2r") pod "402d8bc2-dc12-4c04-8b2b-a9bfdab320db" (UID: "402d8bc2-dc12-4c04-8b2b-a9bfdab320db"). InnerVolumeSpecName "kube-api-access-29v2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:09:34.261467 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.261433    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-token\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:34.261467 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.261463    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-workload-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:34.261467 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.261488    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istiod-ca-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:34.261467 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.261500    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-podinfo\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:34.261740 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.261513    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-data\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:34.261740 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.261527    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29v2r\" (UniqueName: \"kubernetes.io/projected/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-kube-api-access-29v2r\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:34.261740 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.261539    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/402d8bc2-dc12-4c04-8b2b-a9bfdab320db-istio-envoy\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:09:34.768346 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.768315    2549 generic.go:356] "Generic (PLEG): container finished" podID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerID="086eab63d36f1eb2ce4c4148d783e0cac145ff9470bb928a8a303036b9efafc8" exitCode=0
Sep 16 13:09:34.768550 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.768365    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"
Sep 16 13:09:34.768550 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.768382    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh" event={"ID":"402d8bc2-dc12-4c04-8b2b-a9bfdab320db","Type":"ContainerDied","Data":"086eab63d36f1eb2ce4c4148d783e0cac145ff9470bb928a8a303036b9efafc8"}
Sep 16 13:09:34.768550 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.768456    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh" event={"ID":"402d8bc2-dc12-4c04-8b2b-a9bfdab320db","Type":"ContainerDied","Data":"874fc313d95bb4edca48ea9f299d980c745003d83eed453adad728e6788d9525"}
Sep 16 13:09:34.768550 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.768503    2549 scope.go:117] "RemoveContainer" containerID="086eab63d36f1eb2ce4c4148d783e0cac145ff9470bb928a8a303036b9efafc8"
Sep 16 13:09:34.780679 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.780660    2549 scope.go:117] "RemoveContainer" containerID="6249c1bc19482960c0297140fd5fc91ce16d49aad77f9e99d1477cced0e353ea"
Sep 16 13:09:34.790329 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.790311    2549 scope.go:117] "RemoveContainer" containerID="086eab63d36f1eb2ce4c4148d783e0cac145ff9470bb928a8a303036b9efafc8"
Sep 16 13:09:34.790604 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:09:34.790581    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"086eab63d36f1eb2ce4c4148d783e0cac145ff9470bb928a8a303036b9efafc8\": container with ID starting with 086eab63d36f1eb2ce4c4148d783e0cac145ff9470bb928a8a303036b9efafc8 not found: ID does not exist" containerID="086eab63d36f1eb2ce4c4148d783e0cac145ff9470bb928a8a303036b9efafc8"
Sep 16 13:09:34.790704 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.790608    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"086eab63d36f1eb2ce4c4148d783e0cac145ff9470bb928a8a303036b9efafc8"} err="failed to get container status \"086eab63d36f1eb2ce4c4148d783e0cac145ff9470bb928a8a303036b9efafc8\": rpc error: code = NotFound desc = could not find container \"086eab63d36f1eb2ce4c4148d783e0cac145ff9470bb928a8a303036b9efafc8\": container with ID starting with 086eab63d36f1eb2ce4c4148d783e0cac145ff9470bb928a8a303036b9efafc8 not found: ID does not exist"
Sep 16 13:09:34.790704 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.790623    2549 scope.go:117] "RemoveContainer" containerID="6249c1bc19482960c0297140fd5fc91ce16d49aad77f9e99d1477cced0e353ea"
Sep 16 13:09:34.790863 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:09:34.790848    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6249c1bc19482960c0297140fd5fc91ce16d49aad77f9e99d1477cced0e353ea\": container with ID starting with 6249c1bc19482960c0297140fd5fc91ce16d49aad77f9e99d1477cced0e353ea not found: ID does not exist" containerID="6249c1bc19482960c0297140fd5fc91ce16d49aad77f9e99d1477cced0e353ea"
Sep 16 13:09:34.790905 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.790867    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6249c1bc19482960c0297140fd5fc91ce16d49aad77f9e99d1477cced0e353ea"} err="failed to get container status \"6249c1bc19482960c0297140fd5fc91ce16d49aad77f9e99d1477cced0e353ea\": rpc error: code = NotFound desc = could not find container \"6249c1bc19482960c0297140fd5fc91ce16d49aad77f9e99d1477cced0e353ea\": container with ID starting with 6249c1bc19482960c0297140fd5fc91ce16d49aad77f9e99d1477cced0e353ea not found: ID does not exist"
Sep 16 13:09:34.791408 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.791390    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"]
Sep 16 13:09:34.796896 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.796873    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-863d9d-openshift-default-778fbc7574-hlmjh"]
Sep 16 13:09:34.894548 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.894517    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:34.921719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.921688    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" path="/var/lib/kubelet/pods/402d8bc2-dc12-4c04-8b2b-a9bfdab320db/volumes"
Sep 16 13:09:34.922093 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.922079    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6212821b-473d-42b7-8bf5-b920f6cc7427" path="/var/lib/kubelet/pods/6212821b-473d-42b7-8bf5-b920f6cc7427/volumes"
Sep 16 13:09:34.922392 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.922381    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="797ca2fd-20a5-4a75-b779-655605985b2c" path="/var/lib/kubelet/pods/797ca2fd-20a5-4a75-b779-655605985b2c/volumes"
Sep 16 13:09:34.923032 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:34.923015    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="897140a0-dccb-4a6c-9e18-45298edf10cf" path="/var/lib/kubelet/pods/897140a0-dccb-4a6c-9e18-45298edf10cf/volumes"
Sep 16 13:09:35.728687 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:35.728659    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:36.439385 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:36.439354    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:39.424166 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:39.424122    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:39.491673 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:39.491641    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:39.680891 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:39.680805    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:39.891296 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:39.891236    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:39.967452 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:39.967372    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:40.032439 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:40.032409    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:40.104462 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:40.104429    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:40.454770 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:40.454735    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:40.565240 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:40.565207    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:41.413978 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:41.413946    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:42.253794 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:42.253760    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:45.153764 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:45.153737    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:46.981990 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:46.981958    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:47.083097 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:47.083053    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:47.259151 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:47.259077    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:59.147583 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:59.147505    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:09:59.209275 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:09:59.209244    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:10:00.237171 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:10:00.237136    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:10:06.995684 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:10:06.995653    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:10:07.104043 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:10:07.104014    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:10:11.764643 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:10:11.764616    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:10:47.344311 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:10:47.344273    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:10:48.352753 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:10:48.352721    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:10:55.688413 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:10:55.688383    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:11:01.524183 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:11:01.524148    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:11:02.014995 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:11:02.014963    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:11:02.086815 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:11:02.086777    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:11:26.988793 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:11:26.988759    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:11:37.596264 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:11:37.596164    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:14.526243 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:14.526200    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:17.705148 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:17.705117    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:18.854850 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:18.854819    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:19.275852 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.275819    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:19.653151 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653071    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"]
Sep 16 13:12:19.653594 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653576    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d803c47-0d48-4232-b167-04c7557110fe" containerName="istio-proxy"
Sep 16 13:12:19.653594 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653593    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d803c47-0d48-4232-b167-04c7557110fe" containerName="istio-proxy"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653605    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerName="istio-proxy"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653612    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerName="istio-proxy"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653619    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="797ca2fd-20a5-4a75-b779-655605985b2c" containerName="payload-processing"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653626    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="797ca2fd-20a5-4a75-b779-655605985b2c" containerName="payload-processing"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653636    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6212821b-473d-42b7-8bf5-b920f6cc7427" containerName="maas-api"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653644    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="6212821b-473d-42b7-8bf5-b920f6cc7427" containerName="maas-api"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653653    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="897140a0-dccb-4a6c-9e18-45298edf10cf" containerName="payload-pre-processing"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653658    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="897140a0-dccb-4a6c-9e18-45298edf10cf" containerName="payload-pre-processing"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653666    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a81b8c91-8d11-47b9-92dd-1642599c6159" containerName="payload-processing"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653671    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a81b8c91-8d11-47b9-92dd-1642599c6159" containerName="payload-processing"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653681    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86ac7e9d-a799-4444-a57c-c4c86549f2db" containerName="payload-pre-processing"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653686    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="86ac7e9d-a799-4444-a57c-c4c86549f2db" containerName="payload-pre-processing"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653693    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af334189-cfac-4d13-80f8-4f13c389286c" containerName="istio-proxy"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653698    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="af334189-cfac-4d13-80f8-4f13c389286c" containerName="istio-proxy"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653707    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d803c47-0d48-4232-b167-04c7557110fe" containerName="istio-proxy"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653716    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d803c47-0d48-4232-b167-04c7557110fe" containerName="istio-proxy"
Sep 16 13:12:19.653719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653725    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af334189-cfac-4d13-80f8-4f13c389286c" containerName="istio-proxy"
Sep 16 13:12:19.654239 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653731    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="af334189-cfac-4d13-80f8-4f13c389286c" containerName="istio-proxy"
Sep 16 13:12:19.654239 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653792    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d803c47-0d48-4232-b167-04c7557110fe" containerName="istio-proxy"
Sep 16 13:12:19.654239 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653803    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="af334189-cfac-4d13-80f8-4f13c389286c" containerName="istio-proxy"
Sep 16 13:12:19.654239 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653810    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="a81b8c91-8d11-47b9-92dd-1642599c6159" containerName="payload-processing"
Sep 16 13:12:19.654239 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653825    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerName="istio-proxy"
Sep 16 13:12:19.654239 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653832    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="86ac7e9d-a799-4444-a57c-c4c86549f2db" containerName="payload-pre-processing"
Sep 16 13:12:19.654239 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653838    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="897140a0-dccb-4a6c-9e18-45298edf10cf" containerName="payload-pre-processing"
Sep 16 13:12:19.654239 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653842    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerName="istio-proxy"
Sep 16 13:12:19.654239 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653848    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="797ca2fd-20a5-4a75-b779-655605985b2c" containerName="payload-processing"
Sep 16 13:12:19.654239 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.653853    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="6212821b-473d-42b7-8bf5-b920f6cc7427" containerName="maas-api"
Sep 16 13:12:19.657056 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.657032    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.659541 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.659505    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-a17de2-openshift-default-dockercfg-9qh9d\""
Sep 16 13:12:19.671660 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.671633    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"]
Sep 16 13:12:19.678661 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.678635    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:19.788288 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.788250    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-token\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.788288 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.788291    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-data\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.788672 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.788322    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-envoy\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.788672 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.788398    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-workload-certs\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.788672 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.788442    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-workload-socket\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.788672 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.788524    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-credential-socket\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.788672 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.788573    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istiod-ca-cert\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.788672 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.788589    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-podinfo\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.788672 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.788619    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqs89\" (UniqueName: \"kubernetes.io/projected/343d4c50-a949-43d1-9374-bbfd4d8f83fa-kube-api-access-jqs89\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.889395 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.889363    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-credential-socket\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.889885 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.889414    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istiod-ca-cert\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.889885 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.889431    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-podinfo\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.889885 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.889454    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqs89\" (UniqueName: \"kubernetes.io/projected/343d4c50-a949-43d1-9374-bbfd4d8f83fa-kube-api-access-jqs89\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.889885 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.889509    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-token\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.889885 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.889531    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-data\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.889885 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.889571    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-envoy\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.889885 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.889599    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-workload-certs\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.889885 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.889859    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-workload-socket\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.890328 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.889897    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-credential-socket\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.890328 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.889961    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-data\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.890328 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.890116    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-workload-certs\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.890328 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.890143    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-workload-socket\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.890328 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.890191    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istiod-ca-cert\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.892003 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.891978    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-envoy\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.892132 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.892104    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-podinfo\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.897040 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.897014    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-token\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.897317 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.897300    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqs89\" (UniqueName: \"kubernetes.io/projected/343d4c50-a949-43d1-9374-bbfd4d8f83fa-kube-api-access-jqs89\") pod \"e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") " pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:19.910845 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.910821    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:19.969663 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:19.969633    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:20.244296 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:20.244270    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"]
Sep 16 13:12:20.245511 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:12:20.245471    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod343d4c50_a949_43d1_9374_bbfd4d8f83fa.slice/crio-1440990b752bc2b922212dbc0fbe6b530f7cea65e7b823a3a715786a5d687f67 WatchSource:0}: Error finding container 1440990b752bc2b922212dbc0fbe6b530f7cea65e7b823a3a715786a5d687f67: Status 404 returned error can't find the container with id 1440990b752bc2b922212dbc0fbe6b530f7cea65e7b823a3a715786a5d687f67
Sep 16 13:12:20.247710 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:20.247676    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:12:20.247802 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:20.247738    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:12:20.247802 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:20.247769    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:12:20.665301 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:20.665260    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh" event={"ID":"343d4c50-a949-43d1-9374-bbfd4d8f83fa","Type":"ContainerStarted","Data":"2daa6a4c83352ff0f28ac590e4b933c02d8221cbe1ed5348baf0775b09ae3add"}
Sep 16 13:12:20.665472 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:20.665327    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh" event={"ID":"343d4c50-a949-43d1-9374-bbfd4d8f83fa","Type":"ContainerStarted","Data":"1440990b752bc2b922212dbc0fbe6b530f7cea65e7b823a3a715786a5d687f67"}
Sep 16 13:12:20.686819 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:20.686764    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh" podStartSLOduration=1.686750696 podStartE2EDuration="1.686750696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:12:20.684793617 +0000 UTC m=+2024.249614710" watchObservedRunningTime="2026-09-16 13:12:20.686750696 +0000 UTC m=+2024.251571813"
Sep 16 13:12:20.970043 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:20.969969    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:21.975650 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:21.975619    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:22.390395 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:22.390315    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:22.582773 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:22.582720    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:22.677550 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:22.677520    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:22.678530 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:22.678507    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:22.722738 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:22.722701    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:23.345654 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:23.345623    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:24.057763 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:24.057732    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:24.112613 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:24.112583    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:24.269776 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:24.269744    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:24.734389 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:24.734360    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:24.806692 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:24.806658    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:38.718649 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:38.718607    2549 patch_prober.go:28] interesting pod/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 16 13:12:38.719078 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:38.718675    2549 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh" podUID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 16 13:12:39.776518 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:39.776470    2549 generic.go:356] "Generic (PLEG): container finished" podID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerID="2daa6a4c83352ff0f28ac590e4b933c02d8221cbe1ed5348baf0775b09ae3add" exitCode=0
Sep 16 13:12:39.776948 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:39.776542    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh" event={"ID":"343d4c50-a949-43d1-9374-bbfd4d8f83fa","Type":"ContainerDied","Data":"2daa6a4c83352ff0f28ac590e4b933c02d8221cbe1ed5348baf0775b09ae3add"}
Sep 16 13:12:39.776948 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:39.776900    2549 scope.go:117] "RemoveContainer" containerID="2daa6a4c83352ff0f28ac590e4b933c02d8221cbe1ed5348baf0775b09ae3add"
Sep 16 13:12:39.777982 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:39.777952    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:12:39.778045 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:39.778031    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:12:39.778083 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:39.778070    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:12:40.784493 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:40.784450    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh" event={"ID":"343d4c50-a949-43d1-9374-bbfd4d8f83fa","Type":"ContainerStarted","Data":"edd3b116b33131b45763f20a1d8e73db1ae2d4478a7bb6caf5c95ba4c30d2c62"}
Sep 16 13:12:40.970355 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:40.970316    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:40.970681 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:40.970653    2549 patch_prober.go:28] interesting pod/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 16 13:12:40.970743 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:40.970720    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh" podUID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 16 13:12:41.970766 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:41.970727    2549 patch_prober.go:28] interesting pod/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 16 13:12:41.971185 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:41.970785    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh" podUID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 16 13:12:42.970875 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:42.970832    2549 patch_prober.go:28] interesting pod/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 16 13:12:42.971291 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:42.970900    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh" podUID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 16 13:12:43.970669 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:43.970628    2549 patch_prober.go:28] interesting pod/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 16 13:12:43.970817 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:43.970697    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh" podUID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 16 13:12:44.970756 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:44.970723    2549 patch_prober.go:28] interesting pod/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 16 13:12:44.971229 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:44.971203    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh" podUID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 16 13:12:46.171494 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:46.171448    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:46.172096 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:46.172073    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:46.172634 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:46.172616    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:12:46.431617 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:46.431535    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:47.243951 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:47.243922    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:47.543350 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:47.543257    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:47.930646 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:47.930618    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:48.231070 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:48.230995    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:48.546104 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:48.546027    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:48.814502 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:48.814398    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:49.028436 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:49.028403    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:51.434761 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:51.434723    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:51.538209 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:51.538177    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:51.636372 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:51.636337    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:52.318246 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:52.318217    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:53.130689 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:53.130655    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:53.831996 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:53.831966    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:53.892002 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:53.891971    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:54.410721 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:54.410691    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:12:54.510945 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:12:54.510915    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:13:17.007957 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:13:17.007924    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:13:17.805417 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:13:17.805386    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:13:18.740366 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:13:18.740334    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:13:19.551490 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:13:19.551456    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:13:20.359768 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:13:20.359703    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:13:21.652538 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:13:21.652504    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:13:26.714414 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:13:26.714384    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k2d2c_e0444988-d22a-4a4e-ba47-111da27b871b/payload-processing/0.log"
Sep 16 13:13:30.782738 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:13:30.782701    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:03.075133 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.075100    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k2d2c_e0444988-d22a-4a4e-ba47-111da27b871b/payload-processing/0.log"
Sep 16 13:14:03.585430 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.585382    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:03.880915 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.880831    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"]
Sep 16 13:14:03.881407 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.881391    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerName="istio-proxy"
Sep 16 13:14:03.881451 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.881412    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="402d8bc2-dc12-4c04-8b2b-a9bfdab320db" containerName="istio-proxy"
Sep 16 13:14:03.881537 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.881529    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d803c47-0d48-4232-b167-04c7557110fe" containerName="istio-proxy"
Sep 16 13:14:03.881585 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.881543    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="af334189-cfac-4d13-80f8-4f13c389286c" containerName="istio-proxy"
Sep 16 13:14:03.883821 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.883805    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:03.886437 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.886416    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-d20caf-openshift-default-dockercfg-ckpt5\""
Sep 16 13:14:03.898987 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.898966    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"]
Sep 16 13:14:03.903883 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.903862    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:03.908740 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.908715    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4db7d23-81e0-486e-a67c-eed465f33447-istio-token\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:03.908863 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.908766    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-istio-envoy\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:03.908863 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.908838    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh55v\" (UniqueName: \"kubernetes.io/projected/a4db7d23-81e0-486e-a67c-eed465f33447-kube-api-access-qh55v\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:03.908999 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.908900    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-credential-socket\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:03.909061 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.908981    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-workload-certs\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:03.909061 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.909055    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-istio-data\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:03.909194 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.909099    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4db7d23-81e0-486e-a67c-eed465f33447-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:03.909194 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.909141    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-workload-socket\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:03.909194 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:03.909180    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4db7d23-81e0-486e-a67c-eed465f33447-istio-podinfo\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.009696 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.009657    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-credential-socket\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.009898 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.009702    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-workload-certs\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.009898 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.009722    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-istio-data\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.009898 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.009856    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4db7d23-81e0-486e-a67c-eed465f33447-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.009898 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.009896    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-workload-socket\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.010127 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.009914    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4db7d23-81e0-486e-a67c-eed465f33447-istio-podinfo\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.010127 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.009970    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4db7d23-81e0-486e-a67c-eed465f33447-istio-token\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.010127 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.010000    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-istio-envoy\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.010127 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.010037    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qh55v\" (UniqueName: \"kubernetes.io/projected/a4db7d23-81e0-486e-a67c-eed465f33447-kube-api-access-qh55v\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.010127 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.010096    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-istio-data\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.010341 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.010142    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-credential-socket\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.010341 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.010193    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-workload-certs\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.010515 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.010466    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-workload-socket\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.010860 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.010836    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4db7d23-81e0-486e-a67c-eed465f33447-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.012312 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.012289    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-istio-envoy\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.012584 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.012565    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4db7d23-81e0-486e-a67c-eed465f33447-istio-podinfo\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.017939 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.017914    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4db7d23-81e0-486e-a67c-eed465f33447-istio-token\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.019008 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.018985    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh55v\" (UniqueName: \"kubernetes.io/projected/a4db7d23-81e0-486e-a67c-eed465f33447-kube-api-access-qh55v\") pod \"e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") " pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.197027 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.196995    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:04.199944 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.199648    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:04.473255 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.473227    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"]
Sep 16 13:14:04.475903 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:14:04.475875    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4db7d23_81e0_486e_a67c_eed465f33447.slice/crio-f6b037445b3156fda0f14f5bb7da32be21189d5599212919f2b49a676cf5bcd8 WatchSource:0}: Error finding container f6b037445b3156fda0f14f5bb7da32be21189d5599212919f2b49a676cf5bcd8: Status 404 returned error can't find the container with id f6b037445b3156fda0f14f5bb7da32be21189d5599212919f2b49a676cf5bcd8
Sep 16 13:14:04.478121 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.478081    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:14:04.478218 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.478162    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:14:04.478218 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:04.478209    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:14:05.241880 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:05.241841    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww" event={"ID":"a4db7d23-81e0-486e-a67c-eed465f33447","Type":"ContainerStarted","Data":"7de96a809adc7699924f91658268b22ac33302d840542cf9bae3a822dcec5181"}
Sep 16 13:14:05.242252 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:05.241904    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww" event={"ID":"a4db7d23-81e0-486e-a67c-eed465f33447","Type":"ContainerStarted","Data":"f6b037445b3156fda0f14f5bb7da32be21189d5599212919f2b49a676cf5bcd8"}
Sep 16 13:14:05.268139 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:05.268082    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww" podStartSLOduration=2.268066966 podStartE2EDuration="2.268066966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:14:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:14:05.265175428 +0000 UTC m=+2128.829996533" watchObservedRunningTime="2026-09-16 13:14:05.268066966 +0000 UTC m=+2128.832888057"
Sep 16 13:14:06.198167 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:06.198134    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:06.204149 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:06.204118    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:06.249092 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:06.249052    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:06.250107 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:06.250085    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:06.465001 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:06.464921    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:07.169320 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:07.169281    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:07.260907 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:07.260871    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:07.418190 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:07.418158    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:08.129026 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:08.128989    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:09.226552 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:09.226525    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:09.943000 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:09.942970    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:10.803928 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.803897    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"]
Sep 16 13:14:10.806580 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.806559    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:10.811839 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.811817    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-d20caf-serving-cert\""
Sep 16 13:14:10.828141 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.828115    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"]
Sep 16 13:14:10.865380 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.865356    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:10.873567 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.873543    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a642dadb-b453-4fac-a454-2fcc28cdc6dc-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:10.873659 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.873577    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a642dadb-b453-4fac-a454-2fcc28cdc6dc-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:10.873659 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.873602    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnc85\" (UniqueName: \"kubernetes.io/projected/a642dadb-b453-4fac-a454-2fcc28cdc6dc-kube-api-access-vnc85\") pod \"maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:10.873659 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.873624    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a642dadb-b453-4fac-a454-2fcc28cdc6dc-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:10.974194 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.974157    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a642dadb-b453-4fac-a454-2fcc28cdc6dc-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:10.974391 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.974238    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a642dadb-b453-4fac-a454-2fcc28cdc6dc-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:10.974391 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.974282    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnc85\" (UniqueName: \"kubernetes.io/projected/a642dadb-b453-4fac-a454-2fcc28cdc6dc-kube-api-access-vnc85\") pod \"maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:10.974391 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.974315    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a642dadb-b453-4fac-a454-2fcc28cdc6dc-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:10.974721 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.974689    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:10.974981 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.974960    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a642dadb-b453-4fac-a454-2fcc28cdc6dc-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:10.976832 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.976809    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a642dadb-b453-4fac-a454-2fcc28cdc6dc-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:10.976832 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.976827    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a642dadb-b453-4fac-a454-2fcc28cdc6dc-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:10.989994 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:10.989966    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnc85\" (UniqueName: \"kubernetes.io/projected/a642dadb-b453-4fac-a454-2fcc28cdc6dc-kube-api-access-vnc85\") pod \"maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:11.119978 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.119905    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:11.410013 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.409979    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"]
Sep 16 13:14:11.411882 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:14:11.411854    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda642dadb_b453_4fac_a454_2fcc28cdc6dc.slice/crio-106c25edf51411f89ee39a7c7229b655c36d1b89825f10d7da429578202f080b WatchSource:0}: Error finding container 106c25edf51411f89ee39a7c7229b655c36d1b89825f10d7da429578202f080b: Status 404 returned error can't find the container with id 106c25edf51411f89ee39a7c7229b655c36d1b89825f10d7da429578202f080b
Sep 16 13:14:11.413286 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.413268    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 13:14:11.638674 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.638642    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:11.736931 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.736846    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:11.764840 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.764808    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"]
Sep 16 13:14:11.767901 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.767880    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"
Sep 16 13:14:11.771001 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.770981    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-d20caf\""
Sep 16 13:14:11.771155 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.771137    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-d20caf-dockercfg-hq82h\""
Sep 16 13:14:11.782952 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.782928    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"]
Sep 16 13:14:11.884156 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.884119    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3362fc56-6ada-4f97-a188-e8957c2e9ea0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk\" (UID: \"3362fc56-6ada-4f97-a188-e8957c2e9ea0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"
Sep 16 13:14:11.884616 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.884243    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc4j6\" (UniqueName: \"kubernetes.io/projected/3362fc56-6ada-4f97-a188-e8957c2e9ea0-kube-api-access-gc4j6\") pod \"payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk\" (UID: \"3362fc56-6ada-4f97-a188-e8957c2e9ea0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"
Sep 16 13:14:11.984968 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.984938    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc4j6\" (UniqueName: \"kubernetes.io/projected/3362fc56-6ada-4f97-a188-e8957c2e9ea0-kube-api-access-gc4j6\") pod \"payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk\" (UID: \"3362fc56-6ada-4f97-a188-e8957c2e9ea0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"
Sep 16 13:14:11.985130 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.984994    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3362fc56-6ada-4f97-a188-e8957c2e9ea0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk\" (UID: \"3362fc56-6ada-4f97-a188-e8957c2e9ea0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"
Sep 16 13:14:11.985756 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.985730    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3362fc56-6ada-4f97-a188-e8957c2e9ea0-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk\" (UID: \"3362fc56-6ada-4f97-a188-e8957c2e9ea0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"
Sep 16 13:14:11.994667 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:11.994604    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc4j6\" (UniqueName: \"kubernetes.io/projected/3362fc56-6ada-4f97-a188-e8957c2e9ea0-kube-api-access-gc4j6\") pod \"payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk\" (UID: \"3362fc56-6ada-4f97-a188-e8957c2e9ea0\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"
Sep 16 13:14:12.078565 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:12.078528    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"
Sep 16 13:14:12.282674 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:12.282591    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27" event={"ID":"a642dadb-b453-4fac-a454-2fcc28cdc6dc","Type":"ContainerStarted","Data":"d3a73e967080df50efa5cd042cedd948fa22b204e829ad1d5012cb26fdb8ac16"}
Sep 16 13:14:12.282674 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:12.282665    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27" event={"ID":"a642dadb-b453-4fac-a454-2fcc28cdc6dc","Type":"ContainerStarted","Data":"106c25edf51411f89ee39a7c7229b655c36d1b89825f10d7da429578202f080b"}
Sep 16 13:14:12.282889 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:12.282703    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:12.302658 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:12.302592    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27" podStartSLOduration=1.921182255 podStartE2EDuration="2.302571417s" totalImagesPullingTime="381.389162ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:14:12.302041309 +0000 UTC m=+2135.866862401" watchObservedRunningTime="2026-09-16 13:14:12.302571417 +0000 UTC m=+2135.867392511"
Sep 16 13:14:12.353157 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:12.353128    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"]
Sep 16 13:14:12.354648 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:14:12.354612    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3362fc56_6ada_4f97_a188_e8957c2e9ea0.slice/crio-90d01d4f15c5c63e29b34c0afdb3f0fd62fce55e0bb86e0164585f30e1baedba WatchSource:0}: Error finding container 90d01d4f15c5c63e29b34c0afdb3f0fd62fce55e0bb86e0164585f30e1baedba: Status 404 returned error can't find the container with id 90d01d4f15c5c63e29b34c0afdb3f0fd62fce55e0bb86e0164585f30e1baedba
Sep 16 13:14:12.652649 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:12.652554    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:13.293020 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:13.292979    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk" event={"ID":"3362fc56-6ada-4f97-a188-e8957c2e9ea0","Type":"ContainerStarted","Data":"a223ab853c2b16fec5bacde19ce92f3037fc3647948cffeb6b00c40537643024"}
Sep 16 13:14:13.293569 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:13.293042    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk" event={"ID":"3362fc56-6ada-4f97-a188-e8957c2e9ea0","Type":"ContainerStarted","Data":"90d01d4f15c5c63e29b34c0afdb3f0fd62fce55e0bb86e0164585f30e1baedba"}
Sep 16 13:14:13.293569 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:13.293096    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"
Sep 16 13:14:13.311457 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:13.311385    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk" podStartSLOduration=2.311368296 podStartE2EDuration="2.311368296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:14:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:14:13.30972357 +0000 UTC m=+2136.874544660" watchObservedRunningTime="2026-09-16 13:14:13.311368296 +0000 UTC m=+2136.876189386"
Sep 16 13:14:18.298167 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:18.298131    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:23.651763 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:23.651676    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:25.305143 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:25.305106    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"
Sep 16 13:14:26.377314 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:26.377233    2549 generic.go:356] "Generic (PLEG): container finished" podID="a4db7d23-81e0-486e-a67c-eed465f33447" containerID="7de96a809adc7699924f91658268b22ac33302d840542cf9bae3a822dcec5181" exitCode=0
Sep 16 13:14:26.377314 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:26.377289    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww" event={"ID":"a4db7d23-81e0-486e-a67c-eed465f33447","Type":"ContainerDied","Data":"7de96a809adc7699924f91658268b22ac33302d840542cf9bae3a822dcec5181"}
Sep 16 13:14:26.377757 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:26.377685    2549 scope.go:117] "RemoveContainer" containerID="7de96a809adc7699924f91658268b22ac33302d840542cf9bae3a822dcec5181"
Sep 16 13:14:26.378828 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:26.378797    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:14:26.378896 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:26.378873    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:14:26.378932 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:26.378905    2549 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 16 13:14:27.384929 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:27.384887    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww" event={"ID":"a4db7d23-81e0-486e-a67c-eed465f33447","Type":"ContainerStarted","Data":"0a9f3d9955a3dc82fd77e63d9c992424095100390d0aa452e3d5f7ef8f1e239c"}
Sep 16 13:14:28.197326 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:28.197290    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:28.197541 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:28.197518    2549 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 16 13:14:28.197628 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:28.197580    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww" podUID="a4db7d23-81e0-486e-a67c-eed465f33447" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 16 13:14:29.198207 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:29.198116    2549 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 16 13:14:29.198207 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:29.198178    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww" podUID="a4db7d23-81e0-486e-a67c-eed465f33447" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 16 13:14:30.198130 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:30.198087    2549 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 16 13:14:30.198344 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:30.198169    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww" podUID="a4db7d23-81e0-486e-a67c-eed465f33447" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 16 13:14:31.197810 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:31.197772    2549 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 16 13:14:31.197994 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:31.197830    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww" podUID="a4db7d23-81e0-486e-a67c-eed465f33447" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 16 13:14:32.197734 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:32.197697    2549 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 16 13:14:32.198122 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:32.197762    2549 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww" podUID="a4db7d23-81e0-486e-a67c-eed465f33447" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 16 13:14:33.201557 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:33.201526    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:33.202033 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:33.201777    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:33.202528 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:33.202512    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:14:34.923943 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:34.923916    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:35.690285 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:35.690232    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:36.365437 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:36.365405    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:37.142493 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:37.142449    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:37.293508 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:37.293446    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:37.830747 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:37.830701    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:38.745836 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:38.745799    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:39.527282 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:39.527246    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:40.216929 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:40.216901    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:41.029868 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:41.029816    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:41.708963 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:41.708925    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:42.428133 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:42.428102    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:48.464243 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:48.464212    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:48.998018 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:48.997984    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"]
Sep 16 13:14:48.998241 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:48.998217    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27" podUID="a642dadb-b453-4fac-a454-2fcc28cdc6dc" containerName="maas-api" containerID="cri-o://d3a73e967080df50efa5cd042cedd948fa22b204e829ad1d5012cb26fdb8ac16" gracePeriod=30
Sep 16 13:14:49.024842 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.024813    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:49.063505 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.063458    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"]
Sep 16 13:14:49.063735 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.063711    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk" podUID="3362fc56-6ada-4f97-a188-e8957c2e9ea0" containerName="payload-pre-processing" containerID="cri-o://a223ab853c2b16fec5bacde19ce92f3037fc3647948cffeb6b00c40537643024" gracePeriod=30
Sep 16 13:14:49.124731 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.124694    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:49.216949 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.216878    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:49.281454 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.281430    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:49.348238 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.348205    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:49.380795 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.380762    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"
Sep 16 13:14:49.462605 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.462575    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a642dadb-b453-4fac-a454-2fcc28cdc6dc-maas-api-tls\") pod \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") "
Sep 16 13:14:49.462788 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.462625    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3362fc56-6ada-4f97-a188-e8957c2e9ea0-plugins-config-volume\") pod \"3362fc56-6ada-4f97-a188-e8957c2e9ea0\" (UID: \"3362fc56-6ada-4f97-a188-e8957c2e9ea0\") "
Sep 16 13:14:49.462788 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.462655    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a642dadb-b453-4fac-a454-2fcc28cdc6dc-openshift-service-ca\") pod \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") "
Sep 16 13:14:49.462788 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.462704    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc4j6\" (UniqueName: \"kubernetes.io/projected/3362fc56-6ada-4f97-a188-e8957c2e9ea0-kube-api-access-gc4j6\") pod \"3362fc56-6ada-4f97-a188-e8957c2e9ea0\" (UID: \"3362fc56-6ada-4f97-a188-e8957c2e9ea0\") "
Sep 16 13:14:49.462788 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.462756    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a642dadb-b453-4fac-a454-2fcc28cdc6dc-metrics-certs\") pod \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") "
Sep 16 13:14:49.463046 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.462805    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnc85\" (UniqueName: \"kubernetes.io/projected/a642dadb-b453-4fac-a454-2fcc28cdc6dc-kube-api-access-vnc85\") pod \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\" (UID: \"a642dadb-b453-4fac-a454-2fcc28cdc6dc\") "
Sep 16 13:14:49.463126 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.463096    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3362fc56-6ada-4f97-a188-e8957c2e9ea0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3362fc56-6ada-4f97-a188-e8957c2e9ea0" (UID: "3362fc56-6ada-4f97-a188-e8957c2e9ea0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:14:49.463185 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.463107    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a642dadb-b453-4fac-a454-2fcc28cdc6dc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a642dadb-b453-4fac-a454-2fcc28cdc6dc" (UID: "a642dadb-b453-4fac-a454-2fcc28cdc6dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:14:49.464973 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.464940    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a642dadb-b453-4fac-a454-2fcc28cdc6dc-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a642dadb-b453-4fac-a454-2fcc28cdc6dc" (UID: "a642dadb-b453-4fac-a454-2fcc28cdc6dc"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:14:49.464973 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.464948    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3362fc56-6ada-4f97-a188-e8957c2e9ea0-kube-api-access-gc4j6" (OuterVolumeSpecName: "kube-api-access-gc4j6") pod "3362fc56-6ada-4f97-a188-e8957c2e9ea0" (UID: "3362fc56-6ada-4f97-a188-e8957c2e9ea0"). InnerVolumeSpecName "kube-api-access-gc4j6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:14:49.465388 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.465371    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a642dadb-b453-4fac-a454-2fcc28cdc6dc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a642dadb-b453-4fac-a454-2fcc28cdc6dc" (UID: "a642dadb-b453-4fac-a454-2fcc28cdc6dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:14:49.465431 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.465381    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a642dadb-b453-4fac-a454-2fcc28cdc6dc-kube-api-access-vnc85" (OuterVolumeSpecName: "kube-api-access-vnc85") pod "a642dadb-b453-4fac-a454-2fcc28cdc6dc" (UID: "a642dadb-b453-4fac-a454-2fcc28cdc6dc"). InnerVolumeSpecName "kube-api-access-vnc85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:14:49.509008 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.508973    2549 generic.go:356] "Generic (PLEG): container finished" podID="3362fc56-6ada-4f97-a188-e8957c2e9ea0" containerID="a223ab853c2b16fec5bacde19ce92f3037fc3647948cffeb6b00c40537643024" exitCode=0
Sep 16 13:14:49.509165 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.509019    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"
Sep 16 13:14:49.509165 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.509062    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk" event={"ID":"3362fc56-6ada-4f97-a188-e8957c2e9ea0","Type":"ContainerDied","Data":"a223ab853c2b16fec5bacde19ce92f3037fc3647948cffeb6b00c40537643024"}
Sep 16 13:14:49.509165 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.509110    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk" event={"ID":"3362fc56-6ada-4f97-a188-e8957c2e9ea0","Type":"ContainerDied","Data":"90d01d4f15c5c63e29b34c0afdb3f0fd62fce55e0bb86e0164585f30e1baedba"}
Sep 16 13:14:49.509165 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.509132    2549 scope.go:117] "RemoveContainer" containerID="a223ab853c2b16fec5bacde19ce92f3037fc3647948cffeb6b00c40537643024"
Sep 16 13:14:49.510613 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.510590    2549 generic.go:356] "Generic (PLEG): container finished" podID="a642dadb-b453-4fac-a454-2fcc28cdc6dc" containerID="d3a73e967080df50efa5cd042cedd948fa22b204e829ad1d5012cb26fdb8ac16" exitCode=0
Sep 16 13:14:49.510738 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.510635    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"
Sep 16 13:14:49.510738 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.510668    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27" event={"ID":"a642dadb-b453-4fac-a454-2fcc28cdc6dc","Type":"ContainerDied","Data":"d3a73e967080df50efa5cd042cedd948fa22b204e829ad1d5012cb26fdb8ac16"}
Sep 16 13:14:49.510738 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.510704    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27" event={"ID":"a642dadb-b453-4fac-a454-2fcc28cdc6dc","Type":"ContainerDied","Data":"106c25edf51411f89ee39a7c7229b655c36d1b89825f10d7da429578202f080b"}
Sep 16 13:14:49.518925 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.518906    2549 scope.go:117] "RemoveContainer" containerID="a223ab853c2b16fec5bacde19ce92f3037fc3647948cffeb6b00c40537643024"
Sep 16 13:14:49.519232 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:14:49.519210    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a223ab853c2b16fec5bacde19ce92f3037fc3647948cffeb6b00c40537643024\": container with ID starting with a223ab853c2b16fec5bacde19ce92f3037fc3647948cffeb6b00c40537643024 not found: ID does not exist" containerID="a223ab853c2b16fec5bacde19ce92f3037fc3647948cffeb6b00c40537643024"
Sep 16 13:14:49.519330 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.519240    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a223ab853c2b16fec5bacde19ce92f3037fc3647948cffeb6b00c40537643024"} err="failed to get container status \"a223ab853c2b16fec5bacde19ce92f3037fc3647948cffeb6b00c40537643024\": rpc error: code = NotFound desc = could not find container \"a223ab853c2b16fec5bacde19ce92f3037fc3647948cffeb6b00c40537643024\": container with ID starting with a223ab853c2b16fec5bacde19ce92f3037fc3647948cffeb6b00c40537643024 not found: ID does not exist"
Sep 16 13:14:49.519330 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.519258    2549 scope.go:117] "RemoveContainer" containerID="d3a73e967080df50efa5cd042cedd948fa22b204e829ad1d5012cb26fdb8ac16"
Sep 16 13:14:49.528245 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.528220    2549 scope.go:117] "RemoveContainer" containerID="d3a73e967080df50efa5cd042cedd948fa22b204e829ad1d5012cb26fdb8ac16"
Sep 16 13:14:49.528721 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:14:49.528694    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3a73e967080df50efa5cd042cedd948fa22b204e829ad1d5012cb26fdb8ac16\": container with ID starting with d3a73e967080df50efa5cd042cedd948fa22b204e829ad1d5012cb26fdb8ac16 not found: ID does not exist" containerID="d3a73e967080df50efa5cd042cedd948fa22b204e829ad1d5012cb26fdb8ac16"
Sep 16 13:14:49.528812 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.528722    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3a73e967080df50efa5cd042cedd948fa22b204e829ad1d5012cb26fdb8ac16"} err="failed to get container status \"d3a73e967080df50efa5cd042cedd948fa22b204e829ad1d5012cb26fdb8ac16\": rpc error: code = NotFound desc = could not find container \"d3a73e967080df50efa5cd042cedd948fa22b204e829ad1d5012cb26fdb8ac16\": container with ID starting with d3a73e967080df50efa5cd042cedd948fa22b204e829ad1d5012cb26fdb8ac16 not found: ID does not exist"
Sep 16 13:14:49.530897 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.530877    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"]
Sep 16 13:14:49.534243 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.534223    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-d20caf-59448b48d6-w4gnk"]
Sep 16 13:14:49.543694 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.543669    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"]
Sep 16 13:14:49.547327 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.547307    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d20caf-86646dbb64-tnk27"]
Sep 16 13:14:49.564321 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.564298    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnc85\" (UniqueName: \"kubernetes.io/projected/a642dadb-b453-4fac-a454-2fcc28cdc6dc-kube-api-access-vnc85\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:14:49.564321 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.564317    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a642dadb-b453-4fac-a454-2fcc28cdc6dc-maas-api-tls\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:14:49.564454 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.564328    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3362fc56-6ada-4f97-a188-e8957c2e9ea0-plugins-config-volume\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:14:49.564454 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.564338    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a642dadb-b453-4fac-a454-2fcc28cdc6dc-openshift-service-ca\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:14:49.564454 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.564346    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc4j6\" (UniqueName: \"kubernetes.io/projected/3362fc56-6ada-4f97-a188-e8957c2e9ea0-kube-api-access-gc4j6\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:14:49.564454 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.564354    2549 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a642dadb-b453-4fac-a454-2fcc28cdc6dc-metrics-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:14:49.633984 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.633959    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:49.740176 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:49.740147    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:50.581213 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:50.581180    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:50.921999 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:50.921969    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3362fc56-6ada-4f97-a188-e8957c2e9ea0" path="/var/lib/kubelet/pods/3362fc56-6ada-4f97-a188-e8957c2e9ea0/volumes"
Sep 16 13:14:50.922359 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:50.922346    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a642dadb-b453-4fac-a454-2fcc28cdc6dc" path="/var/lib/kubelet/pods/a642dadb-b453-4fac-a454-2fcc28cdc6dc/volumes"
Sep 16 13:14:51.292267 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:51.292176    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:52.055172 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:52.055137    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:52.728563 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:52.728530    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:55.855703 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:55.855644    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:55.914593 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:55.914561    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:14:56.089107 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:56.089071    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"]
Sep 16 13:14:56.089347 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:56.089323    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww" podUID="a4db7d23-81e0-486e-a67c-eed465f33447" containerName="istio-proxy" containerID="cri-o://0a9f3d9955a3dc82fd77e63d9c992424095100390d0aa452e3d5f7ef8f1e239c" gracePeriod=30
Sep 16 13:14:56.164765 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:14:56.164737    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:00.033585 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.033553    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:00.148402 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.148366    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ef95c-29826075-4shnw"]
Sep 16 13:15:00.148887 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.148866    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a642dadb-b453-4fac-a454-2fcc28cdc6dc" containerName="maas-api"
Sep 16 13:15:00.148887 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.148887    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a642dadb-b453-4fac-a454-2fcc28cdc6dc" containerName="maas-api"
Sep 16 13:15:00.149053 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.148898    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3362fc56-6ada-4f97-a188-e8957c2e9ea0" containerName="payload-pre-processing"
Sep 16 13:15:00.149053 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.148905    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="3362fc56-6ada-4f97-a188-e8957c2e9ea0" containerName="payload-pre-processing"
Sep 16 13:15:00.149053 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.148983    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="3362fc56-6ada-4f97-a188-e8957c2e9ea0" containerName="payload-pre-processing"
Sep 16 13:15:00.149053 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.148996    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="a642dadb-b453-4fac-a454-2fcc28cdc6dc" containerName="maas-api"
Sep 16 13:15:00.153198 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.153174    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ef95c-29826075-4shnw"
Sep 16 13:15:00.155860 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.155836    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-64zph\""
Sep 16 13:15:00.159809 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.159785    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ef95c-29826075-4shnw"]
Sep 16 13:15:00.165605 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.165588    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ef95c-29826075-4shnw"
Sep 16 13:15:00.437876 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.437846    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ef95c-29826075-4shnw"]
Sep 16 13:15:00.439555 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:15:00.439525    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe5e5b7_3fd6_4ef3_bb81_eef937e51d81.slice/crio-b1550c4886195f48172a24df824ec4ed8290051b2fb3ac82ae75bef03b86a329 WatchSource:0}: Error finding container b1550c4886195f48172a24df824ec4ed8290051b2fb3ac82ae75bef03b86a329: Status 404 returned error can't find the container with id b1550c4886195f48172a24df824ec4ed8290051b2fb3ac82ae75bef03b86a329
Sep 16 13:15:00.574623 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.574586    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ef95c-29826075-4shnw" event={"ID":"afe5e5b7-3fd6-4ef3-bb81-eef937e51d81","Type":"ContainerStarted","Data":"b1550c4886195f48172a24df824ec4ed8290051b2fb3ac82ae75bef03b86a329"}
Sep 16 13:15:00.842567 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:00.842465    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:01.360293 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.360232    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:15:01.475293 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.475257    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-credential-socket\") pod \"a4db7d23-81e0-486e-a67c-eed465f33447\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") "
Sep 16 13:15:01.475468 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.475303    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qh55v\" (UniqueName: \"kubernetes.io/projected/a4db7d23-81e0-486e-a67c-eed465f33447-kube-api-access-qh55v\") pod \"a4db7d23-81e0-486e-a67c-eed465f33447\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") "
Sep 16 13:15:01.475468 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.475343    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-workload-socket\") pod \"a4db7d23-81e0-486e-a67c-eed465f33447\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") "
Sep 16 13:15:01.475468 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.475375    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4db7d23-81e0-486e-a67c-eed465f33447-istio-podinfo\") pod \"a4db7d23-81e0-486e-a67c-eed465f33447\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") "
Sep 16 13:15:01.475468 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.475434    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-istio-envoy\") pod \"a4db7d23-81e0-486e-a67c-eed465f33447\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") "
Sep 16 13:15:01.475751 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.475502    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-workload-certs\") pod \"a4db7d23-81e0-486e-a67c-eed465f33447\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") "
Sep 16 13:15:01.475751 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.475529    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-istio-data\") pod \"a4db7d23-81e0-486e-a67c-eed465f33447\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") "
Sep 16 13:15:01.475751 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.475597    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4db7d23-81e0-486e-a67c-eed465f33447-istio-token\") pod \"a4db7d23-81e0-486e-a67c-eed465f33447\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") "
Sep 16 13:15:01.475751 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.475646    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4db7d23-81e0-486e-a67c-eed465f33447-istiod-ca-cert\") pod \"a4db7d23-81e0-486e-a67c-eed465f33447\" (UID: \"a4db7d23-81e0-486e-a67c-eed465f33447\") "
Sep 16 13:15:01.475751 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.475644    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a4db7d23-81e0-486e-a67c-eed465f33447" (UID: "a4db7d23-81e0-486e-a67c-eed465f33447"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:15:01.475751 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.475735    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a4db7d23-81e0-486e-a67c-eed465f33447" (UID: "a4db7d23-81e0-486e-a67c-eed465f33447"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:15:01.476057 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.476016    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-credential-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:15:01.476057 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.476037    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-workload-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:15:01.476173 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.476056    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4db7d23-81e0-486e-a67c-eed465f33447-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a4db7d23-81e0-486e-a67c-eed465f33447" (UID: "a4db7d23-81e0-486e-a67c-eed465f33447"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:15:01.476232 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.476197    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a4db7d23-81e0-486e-a67c-eed465f33447" (UID: "a4db7d23-81e0-486e-a67c-eed465f33447"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:15:01.476287 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.476273    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-istio-data" (OuterVolumeSpecName: "istio-data") pod "a4db7d23-81e0-486e-a67c-eed465f33447" (UID: "a4db7d23-81e0-486e-a67c-eed465f33447"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:15:01.478384 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.478347    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a4db7d23-81e0-486e-a67c-eed465f33447-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a4db7d23-81e0-486e-a67c-eed465f33447" (UID: "a4db7d23-81e0-486e-a67c-eed465f33447"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:15:01.478384 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.478364    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4db7d23-81e0-486e-a67c-eed465f33447-kube-api-access-qh55v" (OuterVolumeSpecName: "kube-api-access-qh55v") pod "a4db7d23-81e0-486e-a67c-eed465f33447" (UID: "a4db7d23-81e0-486e-a67c-eed465f33447"). InnerVolumeSpecName "kube-api-access-qh55v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:15:01.478384 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.478375    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a4db7d23-81e0-486e-a67c-eed465f33447" (UID: "a4db7d23-81e0-486e-a67c-eed465f33447"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:15:01.478688 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.478432    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4db7d23-81e0-486e-a67c-eed465f33447-istio-token" (OuterVolumeSpecName: "istio-token") pod "a4db7d23-81e0-486e-a67c-eed465f33447" (UID: "a4db7d23-81e0-486e-a67c-eed465f33447"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:15:01.576703 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.576662    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-istio-envoy\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:15:01.576703 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.576701    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-workload-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:15:01.576941 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.576715    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4db7d23-81e0-486e-a67c-eed465f33447-istio-data\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:15:01.576941 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.576729    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4db7d23-81e0-486e-a67c-eed465f33447-istio-token\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:15:01.576941 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.576742    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4db7d23-81e0-486e-a67c-eed465f33447-istiod-ca-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:15:01.576941 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.576757    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qh55v\" (UniqueName: \"kubernetes.io/projected/a4db7d23-81e0-486e-a67c-eed465f33447-kube-api-access-qh55v\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:15:01.576941 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.576773    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4db7d23-81e0-486e-a67c-eed465f33447-istio-podinfo\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:15:01.584447 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.584415    2549 generic.go:356] "Generic (PLEG): container finished" podID="a4db7d23-81e0-486e-a67c-eed465f33447" containerID="0a9f3d9955a3dc82fd77e63d9c992424095100390d0aa452e3d5f7ef8f1e239c" exitCode=0
Sep 16 13:15:01.584614 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.584513    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww" event={"ID":"a4db7d23-81e0-486e-a67c-eed465f33447","Type":"ContainerDied","Data":"0a9f3d9955a3dc82fd77e63d9c992424095100390d0aa452e3d5f7ef8f1e239c"}
Sep 16 13:15:01.584614 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.584570    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww" event={"ID":"a4db7d23-81e0-486e-a67c-eed465f33447","Type":"ContainerDied","Data":"f6b037445b3156fda0f14f5bb7da32be21189d5599212919f2b49a676cf5bcd8"}
Sep 16 13:15:01.584614 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.584576    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"
Sep 16 13:15:01.584614 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.584610    2549 scope.go:117] "RemoveContainer" containerID="0a9f3d9955a3dc82fd77e63d9c992424095100390d0aa452e3d5f7ef8f1e239c"
Sep 16 13:15:01.597210 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.597175    2549 scope.go:117] "RemoveContainer" containerID="7de96a809adc7699924f91658268b22ac33302d840542cf9bae3a822dcec5181"
Sep 16 13:15:01.607390 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.607366    2549 scope.go:117] "RemoveContainer" containerID="0a9f3d9955a3dc82fd77e63d9c992424095100390d0aa452e3d5f7ef8f1e239c"
Sep 16 13:15:01.607749 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:15:01.607723    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a9f3d9955a3dc82fd77e63d9c992424095100390d0aa452e3d5f7ef8f1e239c\": container with ID starting with 0a9f3d9955a3dc82fd77e63d9c992424095100390d0aa452e3d5f7ef8f1e239c not found: ID does not exist" containerID="0a9f3d9955a3dc82fd77e63d9c992424095100390d0aa452e3d5f7ef8f1e239c"
Sep 16 13:15:01.607861 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.607760    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a9f3d9955a3dc82fd77e63d9c992424095100390d0aa452e3d5f7ef8f1e239c"} err="failed to get container status \"0a9f3d9955a3dc82fd77e63d9c992424095100390d0aa452e3d5f7ef8f1e239c\": rpc error: code = NotFound desc = could not find container \"0a9f3d9955a3dc82fd77e63d9c992424095100390d0aa452e3d5f7ef8f1e239c\": container with ID starting with 0a9f3d9955a3dc82fd77e63d9c992424095100390d0aa452e3d5f7ef8f1e239c not found: ID does not exist"
Sep 16 13:15:01.607861 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.607781    2549 scope.go:117] "RemoveContainer" containerID="7de96a809adc7699924f91658268b22ac33302d840542cf9bae3a822dcec5181"
Sep 16 13:15:01.608113 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:15:01.608083    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7de96a809adc7699924f91658268b22ac33302d840542cf9bae3a822dcec5181\": container with ID starting with 7de96a809adc7699924f91658268b22ac33302d840542cf9bae3a822dcec5181 not found: ID does not exist" containerID="7de96a809adc7699924f91658268b22ac33302d840542cf9bae3a822dcec5181"
Sep 16 13:15:01.608221 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.608146    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7de96a809adc7699924f91658268b22ac33302d840542cf9bae3a822dcec5181"} err="failed to get container status \"7de96a809adc7699924f91658268b22ac33302d840542cf9bae3a822dcec5181\": rpc error: code = NotFound desc = could not find container \"7de96a809adc7699924f91658268b22ac33302d840542cf9bae3a822dcec5181\": container with ID starting with 7de96a809adc7699924f91658268b22ac33302d840542cf9bae3a822dcec5181 not found: ID does not exist"
Sep 16 13:15:01.612284 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.612228    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"]
Sep 16 13:15:01.619090 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.619064    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d20caf-openshift-default-56c54c98d-8vdww"]
Sep 16 13:15:01.687066 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:01.687034    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:02.428778 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:02.428729    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:02.921078 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:02.921048    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4db7d23-81e0-486e-a67c-eed465f33447" path="/var/lib/kubelet/pods/a4db7d23-81e0-486e-a67c-eed465f33447/volumes"
Sep 16 13:15:03.185115 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:03.185051    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:03.601379 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:03.601345    2549 generic.go:356] "Generic (PLEG): container finished" podID="afe5e5b7-3fd6-4ef3-bb81-eef937e51d81" containerID="6027f9688a52e85f669a1eb2ed82e56d42dc33c20f841dd1a7ca1f3b8104691f" exitCode=0
Sep 16 13:15:03.601838 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:03.601394    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ef95c-29826075-4shnw" event={"ID":"afe5e5b7-3fd6-4ef3-bb81-eef937e51d81","Type":"ContainerDied","Data":"6027f9688a52e85f669a1eb2ed82e56d42dc33c20f841dd1a7ca1f3b8104691f"}
Sep 16 13:15:03.830160 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:03.830069    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:04.742301 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:04.742276    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ef95c-29826075-4shnw"
Sep 16 13:15:05.613897 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:05.613868    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ef95c-29826075-4shnw"
Sep 16 13:15:05.614066 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:05.613868    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ef95c-29826075-4shnw" event={"ID":"afe5e5b7-3fd6-4ef3-bb81-eef937e51d81","Type":"ContainerDied","Data":"b1550c4886195f48172a24df824ec4ed8290051b2fb3ac82ae75bef03b86a329"}
Sep 16 13:15:05.614066 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:05.613988    2549 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b1550c4886195f48172a24df824ec4ed8290051b2fb3ac82ae75bef03b86a329"
Sep 16 13:15:15.210425 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:15.210388    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:15.285424 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:15.285387    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:15.342269 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:15.342232    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:15.408642 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:15.408615    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:15.476648 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:15.476566    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:15.782564 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:15.782452    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:15.883152 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:15.883115    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:16.634080 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:16.634048    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:17.443460 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:17.443421    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:18.291493 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:18.291459    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:20.861655 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:20.861622    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:58.348888 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:58.348855    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:15:58.747186 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:15:58.747158    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:04.745407 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:04.745373    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:04.846346 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:04.846311    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:05.004689 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:05.004609    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"]
Sep 16 13:16:05.004848 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:05.004805    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh" podUID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerName="istio-proxy" containerID="cri-o://edd3b116b33131b45763f20a1d8e73db1ae2d4478a7bb6caf5c95ba4c30d2c62" gracePeriod=30
Sep 16 13:16:05.028947 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:05.028921    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:05.660608 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:05.660574    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:06.542061 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:06.542030    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:07.253488 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:07.253456    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:08.491763 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:08.491728    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:09.439547 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:09.439513    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:10.257986 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.257959    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:16:10.379229 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.379143    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-credential-socket\") pod \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") "
Sep 16 13:16:10.379229 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.379186    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-workload-socket\") pod \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") "
Sep 16 13:16:10.379461 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.379259    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-data\") pod \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") "
Sep 16 13:16:10.379461 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.379291    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istiod-ca-cert\") pod \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") "
Sep 16 13:16:10.379461 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.379314    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-token\") pod \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") "
Sep 16 13:16:10.379461 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.379344    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-envoy\") pod \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") "
Sep 16 13:16:10.379461 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.379389    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-podinfo\") pod \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") "
Sep 16 13:16:10.379461 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.379410    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "343d4c50-a949-43d1-9374-bbfd4d8f83fa" (UID: "343d4c50-a949-43d1-9374-bbfd4d8f83fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:16:10.379816 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.379451    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-workload-certs\") pod \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") "
Sep 16 13:16:10.379875 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.379852    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqs89\" (UniqueName: \"kubernetes.io/projected/343d4c50-a949-43d1-9374-bbfd4d8f83fa-kube-api-access-jqs89\") pod \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\" (UID: \"343d4c50-a949-43d1-9374-bbfd4d8f83fa\") "
Sep 16 13:16:10.379930 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.379548    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "343d4c50-a949-43d1-9374-bbfd4d8f83fa" (UID: "343d4c50-a949-43d1-9374-bbfd4d8f83fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:16:10.379930 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.379620    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-data" (OuterVolumeSpecName: "istio-data") pod "343d4c50-a949-43d1-9374-bbfd4d8f83fa" (UID: "343d4c50-a949-43d1-9374-bbfd4d8f83fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:16:10.379930 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.379692    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "343d4c50-a949-43d1-9374-bbfd4d8f83fa" (UID: "343d4c50-a949-43d1-9374-bbfd4d8f83fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:16:10.379930 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.379734    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "343d4c50-a949-43d1-9374-bbfd4d8f83fa" (UID: "343d4c50-a949-43d1-9374-bbfd4d8f83fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:16:10.380163 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.380146    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-credential-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:10.380226 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.380168    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-workload-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:10.380226 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.380183    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-data\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:10.380226 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.380196    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istiod-ca-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:10.380226 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.380209    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-workload-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:10.381466 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.381442    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "343d4c50-a949-43d1-9374-bbfd4d8f83fa" (UID: "343d4c50-a949-43d1-9374-bbfd4d8f83fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:16:10.381588 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.381530    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "343d4c50-a949-43d1-9374-bbfd4d8f83fa" (UID: "343d4c50-a949-43d1-9374-bbfd4d8f83fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:16:10.381822 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.381792    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "343d4c50-a949-43d1-9374-bbfd4d8f83fa" (UID: "343d4c50-a949-43d1-9374-bbfd4d8f83fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:16:10.382024 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.382005    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/343d4c50-a949-43d1-9374-bbfd4d8f83fa-kube-api-access-jqs89" (OuterVolumeSpecName: "kube-api-access-jqs89") pod "343d4c50-a949-43d1-9374-bbfd4d8f83fa" (UID: "343d4c50-a949-43d1-9374-bbfd4d8f83fa"). InnerVolumeSpecName "kube-api-access-jqs89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:16:10.481643 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.481613    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-podinfo\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:10.481643 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.481640    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqs89\" (UniqueName: \"kubernetes.io/projected/343d4c50-a949-43d1-9374-bbfd4d8f83fa-kube-api-access-jqs89\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:10.481643 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.481650    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-token\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:10.481875 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.481659    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/343d4c50-a949-43d1-9374-bbfd4d8f83fa-istio-envoy\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:10.968563 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.968530    2549 generic.go:356] "Generic (PLEG): container finished" podID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerID="edd3b116b33131b45763f20a1d8e73db1ae2d4478a7bb6caf5c95ba4c30d2c62" exitCode=0
Sep 16 13:16:10.968716 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.968577    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"
Sep 16 13:16:10.968716 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.968610    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh" event={"ID":"343d4c50-a949-43d1-9374-bbfd4d8f83fa","Type":"ContainerDied","Data":"edd3b116b33131b45763f20a1d8e73db1ae2d4478a7bb6caf5c95ba4c30d2c62"}
Sep 16 13:16:10.968716 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.968669    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh" event={"ID":"343d4c50-a949-43d1-9374-bbfd4d8f83fa","Type":"ContainerDied","Data":"1440990b752bc2b922212dbc0fbe6b530f7cea65e7b823a3a715786a5d687f67"}
Sep 16 13:16:10.968716 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.968695    2549 scope.go:117] "RemoveContainer" containerID="edd3b116b33131b45763f20a1d8e73db1ae2d4478a7bb6caf5c95ba4c30d2c62"
Sep 16 13:16:10.977628 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.977607    2549 scope.go:117] "RemoveContainer" containerID="2daa6a4c83352ff0f28ac590e4b933c02d8221cbe1ed5348baf0775b09ae3add"
Sep 16 13:16:10.985718 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.985703    2549 scope.go:117] "RemoveContainer" containerID="edd3b116b33131b45763f20a1d8e73db1ae2d4478a7bb6caf5c95ba4c30d2c62"
Sep 16 13:16:10.986016 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:16:10.985992    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edd3b116b33131b45763f20a1d8e73db1ae2d4478a7bb6caf5c95ba4c30d2c62\": container with ID starting with edd3b116b33131b45763f20a1d8e73db1ae2d4478a7bb6caf5c95ba4c30d2c62 not found: ID does not exist" containerID="edd3b116b33131b45763f20a1d8e73db1ae2d4478a7bb6caf5c95ba4c30d2c62"
Sep 16 13:16:10.986084 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.986024    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edd3b116b33131b45763f20a1d8e73db1ae2d4478a7bb6caf5c95ba4c30d2c62"} err="failed to get container status \"edd3b116b33131b45763f20a1d8e73db1ae2d4478a7bb6caf5c95ba4c30d2c62\": rpc error: code = NotFound desc = could not find container \"edd3b116b33131b45763f20a1d8e73db1ae2d4478a7bb6caf5c95ba4c30d2c62\": container with ID starting with edd3b116b33131b45763f20a1d8e73db1ae2d4478a7bb6caf5c95ba4c30d2c62 not found: ID does not exist"
Sep 16 13:16:10.986084 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.986040    2549 scope.go:117] "RemoveContainer" containerID="2daa6a4c83352ff0f28ac590e4b933c02d8221cbe1ed5348baf0775b09ae3add"
Sep 16 13:16:10.986319 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:16:10.986301    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2daa6a4c83352ff0f28ac590e4b933c02d8221cbe1ed5348baf0775b09ae3add\": container with ID starting with 2daa6a4c83352ff0f28ac590e4b933c02d8221cbe1ed5348baf0775b09ae3add not found: ID does not exist" containerID="2daa6a4c83352ff0f28ac590e4b933c02d8221cbe1ed5348baf0775b09ae3add"
Sep 16 13:16:10.986360 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.986327    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2daa6a4c83352ff0f28ac590e4b933c02d8221cbe1ed5348baf0775b09ae3add"} err="failed to get container status \"2daa6a4c83352ff0f28ac590e4b933c02d8221cbe1ed5348baf0775b09ae3add\": rpc error: code = NotFound desc = could not find container \"2daa6a4c83352ff0f28ac590e4b933c02d8221cbe1ed5348baf0775b09ae3add\": container with ID starting with 2daa6a4c83352ff0f28ac590e4b933c02d8221cbe1ed5348baf0775b09ae3add not found: ID does not exist"
Sep 16 13:16:10.991075 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.991052    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"]
Sep 16 13:16:10.994454 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:10.994434    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-a17de2-openshift-default-7db5c7ddd6-7rtgh"]
Sep 16 13:16:12.920671 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:12.920640    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" path="/var/lib/kubelet/pods/343d4c50-a949-43d1-9374-bbfd4d8f83fa/volumes"
Sep 16 13:16:16.018892 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:16.018851    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:16.114710 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:16.114681    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:16.213251 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:16.213216    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:16.272660 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:16.272565    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:16.641410 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:16.641316    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:16.742341 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:16.742309    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:17.654591 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:17.654554    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:18.582335 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:18.582290    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:23.349252 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:23.349214    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:23.418258 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:23.418225    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:23.648539 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:23.648426    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:24.301325 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:24.301292    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:25.821860 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:25.821830    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:25.921848 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:25.921815    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:26.642386 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:26.642345    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:33.018867 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:33.018831    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:34.770786 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:34.770749    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"]
Sep 16 13:16:34.771184 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:34.770990    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k" podUID="d16bd2ec-b2cd-48a0-baec-aad1054a50c8" containerName="maas-api" containerID="cri-o://924f4133242e7011288f5e32b6069ff5e9be4b73636d1d1010ed93fcfd8e6718" gracePeriod=30
Sep 16 13:16:34.792837 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:34.792807    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ef95c-29826075-4shnw"]
Sep 16 13:16:34.798856 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:34.798831    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-1ef95c-29826075-4shnw"]
Sep 16 13:16:34.838506 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:34.838464    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"]
Sep 16 13:16:34.838739 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:34.838716    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6" podUID="d8edbc8e-4ca8-4793-8b70-044026fdb01c" containerName="payload-pre-processing" containerID="cri-o://186ffa81587434ced6079a88e4cd592e869a9e7ed7eece918cd4674ef727b2b0" gracePeriod=30
Sep 16 13:16:34.920472 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:34.920436    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afe5e5b7-3fd6-4ef3-bb81-eef937e51d81" path="/var/lib/kubelet/pods/afe5e5b7-3fd6-4ef3-bb81-eef937e51d81/volumes"
Sep 16 13:16:35.097790 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.097751    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:16:35.106610 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.106059    2549 generic.go:356] "Generic (PLEG): container finished" podID="d16bd2ec-b2cd-48a0-baec-aad1054a50c8" containerID="924f4133242e7011288f5e32b6069ff5e9be4b73636d1d1010ed93fcfd8e6718" exitCode=0
Sep 16 13:16:35.106610 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.106178    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k" event={"ID":"d16bd2ec-b2cd-48a0-baec-aad1054a50c8","Type":"ContainerDied","Data":"924f4133242e7011288f5e32b6069ff5e9be4b73636d1d1010ed93fcfd8e6718"}
Sep 16 13:16:35.106610 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.106267    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k" event={"ID":"d16bd2ec-b2cd-48a0-baec-aad1054a50c8","Type":"ContainerDied","Data":"a37866b2b7d042a924ed991f7fc7405aff58c843d6ccef9205cf3fbd8a41eeee"}
Sep 16 13:16:35.106610 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.106308    2549 scope.go:117] "RemoveContainer" containerID="924f4133242e7011288f5e32b6069ff5e9be4b73636d1d1010ed93fcfd8e6718"
Sep 16 13:16:35.106610 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.106522    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"
Sep 16 13:16:35.115804 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.115579    2549 generic.go:356] "Generic (PLEG): container finished" podID="d8edbc8e-4ca8-4793-8b70-044026fdb01c" containerID="186ffa81587434ced6079a88e4cd592e869a9e7ed7eece918cd4674ef727b2b0" exitCode=0
Sep 16 13:16:35.115804 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.115739    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6" event={"ID":"d8edbc8e-4ca8-4793-8b70-044026fdb01c","Type":"ContainerDied","Data":"186ffa81587434ced6079a88e4cd592e869a9e7ed7eece918cd4674ef727b2b0"}
Sep 16 13:16:35.129289 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.129262    2549 scope.go:117] "RemoveContainer" containerID="924f4133242e7011288f5e32b6069ff5e9be4b73636d1d1010ed93fcfd8e6718"
Sep 16 13:16:35.129588 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.129546    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"
Sep 16 13:16:35.129664 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:16:35.129620    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"924f4133242e7011288f5e32b6069ff5e9be4b73636d1d1010ed93fcfd8e6718\": container with ID starting with 924f4133242e7011288f5e32b6069ff5e9be4b73636d1d1010ed93fcfd8e6718 not found: ID does not exist" containerID="924f4133242e7011288f5e32b6069ff5e9be4b73636d1d1010ed93fcfd8e6718"
Sep 16 13:16:35.129710 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.129659    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"924f4133242e7011288f5e32b6069ff5e9be4b73636d1d1010ed93fcfd8e6718"} err="failed to get container status \"924f4133242e7011288f5e32b6069ff5e9be4b73636d1d1010ed93fcfd8e6718\": rpc error: code = NotFound desc = could not find container \"924f4133242e7011288f5e32b6069ff5e9be4b73636d1d1010ed93fcfd8e6718\": container with ID starting with 924f4133242e7011288f5e32b6069ff5e9be4b73636d1d1010ed93fcfd8e6718 not found: ID does not exist"
Sep 16 13:16:35.193964 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.193938    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcqsv\" (UniqueName: \"kubernetes.io/projected/d8edbc8e-4ca8-4793-8b70-044026fdb01c-kube-api-access-xcqsv\") pod \"d8edbc8e-4ca8-4793-8b70-044026fdb01c\" (UID: \"d8edbc8e-4ca8-4793-8b70-044026fdb01c\") "
Sep 16 13:16:35.194149 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.193982    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8edbc8e-4ca8-4793-8b70-044026fdb01c-plugins-config-volume\") pod \"d8edbc8e-4ca8-4793-8b70-044026fdb01c\" (UID: \"d8edbc8e-4ca8-4793-8b70-044026fdb01c\") "
Sep 16 13:16:35.194149 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.194012    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9x5m\" (UniqueName: \"kubernetes.io/projected/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-kube-api-access-t9x5m\") pod \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") "
Sep 16 13:16:35.194149 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.194052    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-maas-api-tls\") pod \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") "
Sep 16 13:16:35.194149 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.194086    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-metrics-certs\") pod \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") "
Sep 16 13:16:35.194396 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.194359    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-openshift-service-ca\") pod \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\" (UID: \"d16bd2ec-b2cd-48a0-baec-aad1054a50c8\") "
Sep 16 13:16:35.194973 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.194923    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d16bd2ec-b2cd-48a0-baec-aad1054a50c8" (UID: "d16bd2ec-b2cd-48a0-baec-aad1054a50c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:16:35.195123 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.194424    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8edbc8e-4ca8-4793-8b70-044026fdb01c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8edbc8e-4ca8-4793-8b70-044026fdb01c" (UID: "d8edbc8e-4ca8-4793-8b70-044026fdb01c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:16:35.196188 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.196160    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-kube-api-access-t9x5m" (OuterVolumeSpecName: "kube-api-access-t9x5m") pod "d16bd2ec-b2cd-48a0-baec-aad1054a50c8" (UID: "d16bd2ec-b2cd-48a0-baec-aad1054a50c8"). InnerVolumeSpecName "kube-api-access-t9x5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:16:35.196296 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.196229    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d16bd2ec-b2cd-48a0-baec-aad1054a50c8" (UID: "d16bd2ec-b2cd-48a0-baec-aad1054a50c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:16:35.196340 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.196311    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d16bd2ec-b2cd-48a0-baec-aad1054a50c8" (UID: "d16bd2ec-b2cd-48a0-baec-aad1054a50c8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:16:35.196465 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.196450    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8edbc8e-4ca8-4793-8b70-044026fdb01c-kube-api-access-xcqsv" (OuterVolumeSpecName: "kube-api-access-xcqsv") pod "d8edbc8e-4ca8-4793-8b70-044026fdb01c" (UID: "d8edbc8e-4ca8-4793-8b70-044026fdb01c"). InnerVolumeSpecName "kube-api-access-xcqsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:16:35.295883 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.295797    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-maas-api-tls\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:35.295883 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.295828    2549 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-metrics-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:35.295883 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.295838    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-openshift-service-ca\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:35.295883 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.295848    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xcqsv\" (UniqueName: \"kubernetes.io/projected/d8edbc8e-4ca8-4793-8b70-044026fdb01c-kube-api-access-xcqsv\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:35.295883 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.295857    2549 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8edbc8e-4ca8-4793-8b70-044026fdb01c-plugins-config-volume\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:35.295883 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.295865    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9x5m\" (UniqueName: \"kubernetes.io/projected/d16bd2ec-b2cd-48a0-baec-aad1054a50c8-kube-api-access-t9x5m\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:35.428694 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.428661    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"]
Sep 16 13:16:35.432878 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.432850    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-1ef95c-66b7fc4f5-mrj8k"]
Sep 16 13:16:35.781656 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:35.781607    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:36.123438 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:36.123354    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6" event={"ID":"d8edbc8e-4ca8-4793-8b70-044026fdb01c","Type":"ContainerDied","Data":"91d463502519d95a09fd0cdf1d76800c5bdc0f8d25597338891509d85cf9d65e"}
Sep 16 13:16:36.123438 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:36.123382    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"
Sep 16 13:16:36.123438 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:36.123417    2549 scope.go:117] "RemoveContainer" containerID="186ffa81587434ced6079a88e4cd592e869a9e7ed7eece918cd4674ef727b2b0"
Sep 16 13:16:36.146029 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:36.145993    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"]
Sep 16 13:16:36.152844 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:36.152807    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-1ef95c-56d7bd6dc4-gfxc6"]
Sep 16 13:16:36.912637 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:36.912608    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:36.920691 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:36.920665    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d16bd2ec-b2cd-48a0-baec-aad1054a50c8" path="/var/lib/kubelet/pods/d16bd2ec-b2cd-48a0-baec-aad1054a50c8/volumes"
Sep 16 13:16:36.921017 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:36.921006    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8edbc8e-4ca8-4793-8b70-044026fdb01c" path="/var/lib/kubelet/pods/d8edbc8e-4ca8-4793-8b70-044026fdb01c/volumes"
Sep 16 13:16:41.597571 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:41.597539    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:41.698800 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:41.698771    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:41.841527 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:41.841491    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"]
Sep 16 13:16:41.841768 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:41.841745    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml" podUID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerName="istio-proxy" containerID="cri-o://7e70864f490b6bd0d023fdf1645f6b0b501b63e0134a5e0947831b562accb26b" gracePeriod=30
Sep 16 13:16:41.856183 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:41.856115    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:42.345777 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:42.345746    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:43.172412 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:43.172380    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:43.939795 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:43.939759    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:47.095671 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.095641    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:16:47.188853 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.188818    2549 generic.go:356] "Generic (PLEG): container finished" podID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerID="7e70864f490b6bd0d023fdf1645f6b0b501b63e0134a5e0947831b562accb26b" exitCode=0
Sep 16 13:16:47.189037 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.188867    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"
Sep 16 13:16:47.189037 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.188900    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml" event={"ID":"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa","Type":"ContainerDied","Data":"7e70864f490b6bd0d023fdf1645f6b0b501b63e0134a5e0947831b562accb26b"}
Sep 16 13:16:47.189037 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.188954    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml" event={"ID":"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa","Type":"ContainerDied","Data":"6d411a411859dbf29ac53529c093adfe88367486abb189b4e5dc2ac9a1c814f7"}
Sep 16 13:16:47.189037 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.188975    2549 scope.go:117] "RemoveContainer" containerID="7e70864f490b6bd0d023fdf1645f6b0b501b63e0134a5e0947831b562accb26b"
Sep 16 13:16:47.197892 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.197876    2549 scope.go:117] "RemoveContainer" containerID="6ed453b635badd25dded2b71b7e35238d9c6d6d3bf8f5be6f55e6d52fac9f04d"
Sep 16 13:16:47.206378 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.206354    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-credential-socket\") pod \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") "
Sep 16 13:16:47.206506 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.206409    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-data\") pod \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") "
Sep 16 13:16:47.206506 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.206461    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-workload-socket\") pod \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") "
Sep 16 13:16:47.206627 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.206544    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-podinfo\") pod \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") "
Sep 16 13:16:47.206627 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.206575    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-workload-certs\") pod \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") "
Sep 16 13:16:47.206740 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.206650    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-data" (OuterVolumeSpecName: "istio-data") pod "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" (UID: "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:16:47.206740 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.206660    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" (UID: "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:16:47.206840 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.206764    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" (UID: "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:16:47.206894 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.206861    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" (UID: "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:16:47.206894 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.206885    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-envoy\") pod \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") "
Sep 16 13:16:47.206997 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.206915    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tvsv\" (UniqueName: \"kubernetes.io/projected/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-kube-api-access-6tvsv\") pod \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") "
Sep 16 13:16:47.206997 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.206966    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istiod-ca-cert\") pod \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") "
Sep 16 13:16:47.206997 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.206990    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-token\") pod \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\" (UID: \"c46ad49e-0aaf-4908-a1bc-07a0ff0771aa\") "
Sep 16 13:16:47.207362 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.207278    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-workload-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:47.207362 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.207310    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-workload-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:47.207362 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.207315    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" (UID: "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:16:47.207362 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.207327    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-credential-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:47.207362 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.207342    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-data\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:47.208058 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.208031    2549 scope.go:117] "RemoveContainer" containerID="7e70864f490b6bd0d023fdf1645f6b0b501b63e0134a5e0947831b562accb26b"
Sep 16 13:16:47.208405 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:16:47.208376    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e70864f490b6bd0d023fdf1645f6b0b501b63e0134a5e0947831b562accb26b\": container with ID starting with 7e70864f490b6bd0d023fdf1645f6b0b501b63e0134a5e0947831b562accb26b not found: ID does not exist" containerID="7e70864f490b6bd0d023fdf1645f6b0b501b63e0134a5e0947831b562accb26b"
Sep 16 13:16:47.208532 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.208416    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e70864f490b6bd0d023fdf1645f6b0b501b63e0134a5e0947831b562accb26b"} err="failed to get container status \"7e70864f490b6bd0d023fdf1645f6b0b501b63e0134a5e0947831b562accb26b\": rpc error: code = NotFound desc = could not find container \"7e70864f490b6bd0d023fdf1645f6b0b501b63e0134a5e0947831b562accb26b\": container with ID starting with 7e70864f490b6bd0d023fdf1645f6b0b501b63e0134a5e0947831b562accb26b not found: ID does not exist"
Sep 16 13:16:47.208532 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.208440    2549 scope.go:117] "RemoveContainer" containerID="6ed453b635badd25dded2b71b7e35238d9c6d6d3bf8f5be6f55e6d52fac9f04d"
Sep 16 13:16:47.208862 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:16:47.208840    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ed453b635badd25dded2b71b7e35238d9c6d6d3bf8f5be6f55e6d52fac9f04d\": container with ID starting with 6ed453b635badd25dded2b71b7e35238d9c6d6d3bf8f5be6f55e6d52fac9f04d not found: ID does not exist" containerID="6ed453b635badd25dded2b71b7e35238d9c6d6d3bf8f5be6f55e6d52fac9f04d"
Sep 16 13:16:47.208937 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.208870    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ed453b635badd25dded2b71b7e35238d9c6d6d3bf8f5be6f55e6d52fac9f04d"} err="failed to get container status \"6ed453b635badd25dded2b71b7e35238d9c6d6d3bf8f5be6f55e6d52fac9f04d\": rpc error: code = NotFound desc = could not find container \"6ed453b635badd25dded2b71b7e35238d9c6d6d3bf8f5be6f55e6d52fac9f04d\": container with ID starting with 6ed453b635badd25dded2b71b7e35238d9c6d6d3bf8f5be6f55e6d52fac9f04d not found: ID does not exist"
Sep 16 13:16:47.208937 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.208891    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" (UID: "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:16:47.209333 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.209314    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-kube-api-access-6tvsv" (OuterVolumeSpecName: "kube-api-access-6tvsv") pod "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" (UID: "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa"). InnerVolumeSpecName "kube-api-access-6tvsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:16:47.209391 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.209317    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" (UID: "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:16:47.209391 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.209369    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-token" (OuterVolumeSpecName: "istio-token") pod "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" (UID: "c46ad49e-0aaf-4908-a1bc-07a0ff0771aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:16:47.308549 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.308520    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-podinfo\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:47.308549 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.308544    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-envoy\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:47.308719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.308559    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tvsv\" (UniqueName: \"kubernetes.io/projected/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-kube-api-access-6tvsv\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:47.308719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.308571    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istiod-ca-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:47.308719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.308582    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa-istio-token\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:16:47.512222 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.512167    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"]
Sep 16 13:16:47.515927 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:47.515901    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-1ef95c-openshift-default-79d6f67998-8g5ml"]
Sep 16 13:16:48.920282 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:48.920245    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" path="/var/lib/kubelet/pods/c46ad49e-0aaf-4908-a1bc-07a0ff0771aa/volumes"
Sep 16 13:16:52.947088 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:52.947055    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:53.059532 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:53.059500    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:53.122151 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:53.122118    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:53.242863 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:53.242778    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:53.329450 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:53.329404    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:53.704108 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:53.704071    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:53.846994 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:53.846955    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:59.844119 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:59.844082    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:16:59.907149 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:16:59.907121    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:17:00.087306 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:00.087270    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"]
Sep 16 13:17:00.087572 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:00.087533    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb" podUID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerName="istio-proxy" containerID="cri-o://579439912dac8cd8b7bf1297a610b769944543cf5798e28b2d322db714766157" gracePeriod=30
Sep 16 13:17:00.116569 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:00.116498    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:17:03.020146 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.020107    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-6fj4g"]
Sep 16 13:17:03.020634 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.020326    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-669f4b5bdf-6fj4g" podUID="8e8cdd07-7962-4543-80c4-7ac33aeccc06" containerName="manager" containerID="cri-o://3e9db67e805820c2e80d31f44575fbde28377cd3243b52381263bc9fc191ef6f" gracePeriod=30
Sep 16 13:17:03.268307 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.268283    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 13:17:03.275732 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.275679    2549 generic.go:356] "Generic (PLEG): container finished" podID="8e8cdd07-7962-4543-80c4-7ac33aeccc06" containerID="3e9db67e805820c2e80d31f44575fbde28377cd3243b52381263bc9fc191ef6f" exitCode=0
Sep 16 13:17:03.275732 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.275718    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669f4b5bdf-6fj4g"
Sep 16 13:17:03.275852 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.275759    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669f4b5bdf-6fj4g" event={"ID":"8e8cdd07-7962-4543-80c4-7ac33aeccc06","Type":"ContainerDied","Data":"3e9db67e805820c2e80d31f44575fbde28377cd3243b52381263bc9fc191ef6f"}
Sep 16 13:17:03.275852 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.275813    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669f4b5bdf-6fj4g" event={"ID":"8e8cdd07-7962-4543-80c4-7ac33aeccc06","Type":"ContainerDied","Data":"c6e3af5f96d22fc3e297b1aa43ee474a1babfb4fcf79973190f0291f5a3ae886"}
Sep 16 13:17:03.275852 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.275844    2549 scope.go:117] "RemoveContainer" containerID="3e9db67e805820c2e80d31f44575fbde28377cd3243b52381263bc9fc191ef6f"
Sep 16 13:17:03.285060 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.285037    2549 scope.go:117] "RemoveContainer" containerID="3e9db67e805820c2e80d31f44575fbde28377cd3243b52381263bc9fc191ef6f"
Sep 16 13:17:03.285321 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:17:03.285301    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e9db67e805820c2e80d31f44575fbde28377cd3243b52381263bc9fc191ef6f\": container with ID starting with 3e9db67e805820c2e80d31f44575fbde28377cd3243b52381263bc9fc191ef6f not found: ID does not exist" containerID="3e9db67e805820c2e80d31f44575fbde28377cd3243b52381263bc9fc191ef6f"
Sep 16 13:17:03.285394 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.285329    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e9db67e805820c2e80d31f44575fbde28377cd3243b52381263bc9fc191ef6f"} err="failed to get container status \"3e9db67e805820c2e80d31f44575fbde28377cd3243b52381263bc9fc191ef6f\": rpc error: code = NotFound desc = could not find container \"3e9db67e805820c2e80d31f44575fbde28377cd3243b52381263bc9fc191ef6f\": container with ID starting with 3e9db67e805820c2e80d31f44575fbde28377cd3243b52381263bc9fc191ef6f not found: ID does not exist"
Sep 16 13:17:03.449025 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.448994    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e8cdd07-7962-4543-80c4-7ac33aeccc06-webhook-cert\") pod \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\" (UID: \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\") "
Sep 16 13:17:03.449167 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.449055    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmf8s\" (UniqueName: \"kubernetes.io/projected/8e8cdd07-7962-4543-80c4-7ac33aeccc06-kube-api-access-jmf8s\") pod \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\" (UID: \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\") "
Sep 16 13:17:03.449167 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.449089    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e8cdd07-7962-4543-80c4-7ac33aeccc06-metrics-certs\") pod \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\" (UID: \"8e8cdd07-7962-4543-80c4-7ac33aeccc06\") "
Sep 16 13:17:03.451126 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.451092    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e8cdd07-7962-4543-80c4-7ac33aeccc06-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8e8cdd07-7962-4543-80c4-7ac33aeccc06" (UID: "8e8cdd07-7962-4543-80c4-7ac33aeccc06"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:17:03.451257 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.451127    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e8cdd07-7962-4543-80c4-7ac33aeccc06-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "8e8cdd07-7962-4543-80c4-7ac33aeccc06" (UID: "8e8cdd07-7962-4543-80c4-7ac33aeccc06"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:17:03.451257 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.451171    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e8cdd07-7962-4543-80c4-7ac33aeccc06-kube-api-access-jmf8s" (OuterVolumeSpecName: "kube-api-access-jmf8s") pod "8e8cdd07-7962-4543-80c4-7ac33aeccc06" (UID: "8e8cdd07-7962-4543-80c4-7ac33aeccc06"). InnerVolumeSpecName "kube-api-access-jmf8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:17:03.549959 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.549891    2549 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8e8cdd07-7962-4543-80c4-7ac33aeccc06-webhook-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:17:03.549959 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.549918    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmf8s\" (UniqueName: \"kubernetes.io/projected/8e8cdd07-7962-4543-80c4-7ac33aeccc06-kube-api-access-jmf8s\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:17:03.549959 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.549927    2549 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e8cdd07-7962-4543-80c4-7ac33aeccc06-metrics-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:17:03.600725 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.600696    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-6fj4g"]
Sep 16 13:17:03.608066 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:03.608031    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-6fj4g"]
Sep 16 13:17:04.925836 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:04.925802    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e8cdd07-7962-4543-80c4-7ac33aeccc06" path="/var/lib/kubelet/pods/8e8cdd07-7962-4543-80c4-7ac33aeccc06/volumes"
Sep 16 13:17:05.292081 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.292051    2549 generic.go:356] "Generic (PLEG): container finished" podID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerID="579439912dac8cd8b7bf1297a610b769944543cf5798e28b2d322db714766157" exitCode=0
Sep 16 13:17:05.292258 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.292129    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb" event={"ID":"fb9037d6-9059-4509-a4aa-b00463ce3788","Type":"ContainerDied","Data":"579439912dac8cd8b7bf1297a610b769944543cf5798e28b2d322db714766157"}
Sep 16 13:17:05.292258 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.292206    2549 scope.go:117] "RemoveContainer" containerID="4ccbbd76d30db2dc9d2f3369a8bfa0ffb52982ec7433eabd61f1da65b973d338"
Sep 16 13:17:05.341178 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.341159    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:17:05.465648 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.465570    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-credential-socket\") pod \"fb9037d6-9059-4509-a4aa-b00463ce3788\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") "
Sep 16 13:17:05.465648 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.465607    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-podinfo\") pod \"fb9037d6-9059-4509-a4aa-b00463ce3788\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") "
Sep 16 13:17:05.465648 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.465632    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-data\") pod \"fb9037d6-9059-4509-a4aa-b00463ce3788\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") "
Sep 16 13:17:05.465904 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.465691    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4xp4\" (UniqueName: \"kubernetes.io/projected/fb9037d6-9059-4509-a4aa-b00463ce3788-kube-api-access-s4xp4\") pod \"fb9037d6-9059-4509-a4aa-b00463ce3788\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") "
Sep 16 13:17:05.465904 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.465714    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-workload-socket\") pod \"fb9037d6-9059-4509-a4aa-b00463ce3788\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") "
Sep 16 13:17:05.465904 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.465750    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-workload-certs\") pod \"fb9037d6-9059-4509-a4aa-b00463ce3788\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") "
Sep 16 13:17:05.465904 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.465785    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9037d6-9059-4509-a4aa-b00463ce3788-istiod-ca-cert\") pod \"fb9037d6-9059-4509-a4aa-b00463ce3788\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") "
Sep 16 13:17:05.465904 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.465812    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-envoy\") pod \"fb9037d6-9059-4509-a4aa-b00463ce3788\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") "
Sep 16 13:17:05.465904 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.465859    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-token\") pod \"fb9037d6-9059-4509-a4aa-b00463ce3788\" (UID: \"fb9037d6-9059-4509-a4aa-b00463ce3788\") "
Sep 16 13:17:05.465904 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.465871    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fb9037d6-9059-4509-a4aa-b00463ce3788" (UID: "fb9037d6-9059-4509-a4aa-b00463ce3788"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:17:05.466211 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.466025    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-data" (OuterVolumeSpecName: "istio-data") pod "fb9037d6-9059-4509-a4aa-b00463ce3788" (UID: "fb9037d6-9059-4509-a4aa-b00463ce3788"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:17:05.466211 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.466041    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fb9037d6-9059-4509-a4aa-b00463ce3788" (UID: "fb9037d6-9059-4509-a4aa-b00463ce3788"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:17:05.466211 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.466055    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fb9037d6-9059-4509-a4aa-b00463ce3788" (UID: "fb9037d6-9059-4509-a4aa-b00463ce3788"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:17:05.466211 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.466187    2549 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-workload-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:17:05.466211 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.466209    2549 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-workload-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:17:05.466418 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.466224    2549 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-credential-socket\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:17:05.466418 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.466238    2549 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-data\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:17:05.466418 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.466222    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb9037d6-9059-4509-a4aa-b00463ce3788-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fb9037d6-9059-4509-a4aa-b00463ce3788" (UID: "fb9037d6-9059-4509-a4aa-b00463ce3788"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:17:05.468306 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.468280    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fb9037d6-9059-4509-a4aa-b00463ce3788" (UID: "fb9037d6-9059-4509-a4aa-b00463ce3788"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 16 13:17:05.468306 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.468292    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb9037d6-9059-4509-a4aa-b00463ce3788-kube-api-access-s4xp4" (OuterVolumeSpecName: "kube-api-access-s4xp4") pod "fb9037d6-9059-4509-a4aa-b00463ce3788" (UID: "fb9037d6-9059-4509-a4aa-b00463ce3788"). InnerVolumeSpecName "kube-api-access-s4xp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:17:05.468513 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.468465    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fb9037d6-9059-4509-a4aa-b00463ce3788" (UID: "fb9037d6-9059-4509-a4aa-b00463ce3788"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:17:05.468599 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.468473    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-token" (OuterVolumeSpecName: "istio-token") pod "fb9037d6-9059-4509-a4aa-b00463ce3788" (UID: "fb9037d6-9059-4509-a4aa-b00463ce3788"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:17:05.566863 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.566832    2549 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-token\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:17:05.566863 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.566856    2549 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-podinfo\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:17:05.567016 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.566869    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4xp4\" (UniqueName: \"kubernetes.io/projected/fb9037d6-9059-4509-a4aa-b00463ce3788-kube-api-access-s4xp4\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:17:05.567016 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.566882    2549 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb9037d6-9059-4509-a4aa-b00463ce3788-istiod-ca-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:17:05.567016 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:05.566893    2549 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb9037d6-9059-4509-a4aa-b00463ce3788-istio-envoy\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:17:06.299543 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:06.299514    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"
Sep 16 13:17:06.299960 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:06.299555    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb" event={"ID":"fb9037d6-9059-4509-a4aa-b00463ce3788","Type":"ContainerDied","Data":"0ce35d7d82af9f60d6cc6c749b6b89cd4e9094ab5dbeec3649b61bf5cd3db678"}
Sep 16 13:17:06.299960 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:06.299612    2549 scope.go:117] "RemoveContainer" containerID="579439912dac8cd8b7bf1297a610b769944543cf5798e28b2d322db714766157"
Sep 16 13:17:06.326132 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:06.326102    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"]
Sep 16 13:17:06.334840 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:06.334816    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-e344f9-openshift-default-6454b58d8-f5wtb"]
Sep 16 13:17:06.920585 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:06.920553    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb9037d6-9059-4509-a4aa-b00463ce3788" path="/var/lib/kubelet/pods/fb9037d6-9059-4509-a4aa-b00463ce3788/volumes"
Sep 16 13:17:37.838367 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:37.838331    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:17:50.209499 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:50.209450    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:17:50.514728 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:17:50.514643    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:18:04.477106 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477064    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-2zkp2"]
Sep 16 13:18:04.477697 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477560    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e8cdd07-7962-4543-80c4-7ac33aeccc06" containerName="manager"
Sep 16 13:18:04.477697 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477580    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e8cdd07-7962-4543-80c4-7ac33aeccc06" containerName="manager"
Sep 16 13:18:04.477697 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477591    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d16bd2ec-b2cd-48a0-baec-aad1054a50c8" containerName="maas-api"
Sep 16 13:18:04.477697 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477599    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d16bd2ec-b2cd-48a0-baec-aad1054a50c8" containerName="maas-api"
Sep 16 13:18:04.477697 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477614    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerName="istio-proxy"
Sep 16 13:18:04.477697 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477624    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerName="istio-proxy"
Sep 16 13:18:04.477697 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477641    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8edbc8e-4ca8-4793-8b70-044026fdb01c" containerName="payload-pre-processing"
Sep 16 13:18:04.477697 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477650    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8edbc8e-4ca8-4793-8b70-044026fdb01c" containerName="payload-pre-processing"
Sep 16 13:18:04.477697 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477662    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afe5e5b7-3fd6-4ef3-bb81-eef937e51d81" containerName="cleanup"
Sep 16 13:18:04.477697 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477671    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="afe5e5b7-3fd6-4ef3-bb81-eef937e51d81" containerName="cleanup"
Sep 16 13:18:04.477697 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477686    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerName="istio-proxy"
Sep 16 13:18:04.477697 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477694    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerName="istio-proxy"
Sep 16 13:18:04.477697 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477704    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4db7d23-81e0-486e-a67c-eed465f33447" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477713    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4db7d23-81e0-486e-a67c-eed465f33447" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477723    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477731    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477744    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477752    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477768    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477777    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477799    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4db7d23-81e0-486e-a67c-eed465f33447" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477807    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4db7d23-81e0-486e-a67c-eed465f33447" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477828    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477837    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477918    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477930    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477939    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477949    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e8cdd07-7962-4543-80c4-7ac33aeccc06" containerName="manager"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477960    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="c46ad49e-0aaf-4908-a1bc-07a0ff0771aa" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477971    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb9037d6-9059-4509-a4aa-b00463ce3788" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477980    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8edbc8e-4ca8-4793-8b70-044026fdb01c" containerName="payload-pre-processing"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477989    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d16bd2ec-b2cd-48a0-baec-aad1054a50c8" containerName="maas-api"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.477999    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4db7d23-81e0-486e-a67c-eed465f33447" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.478007    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="343d4c50-a949-43d1-9374-bbfd4d8f83fa" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.478015    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4db7d23-81e0-486e-a67c-eed465f33447" containerName="istio-proxy"
Sep 16 13:18:04.478509 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.478024    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="afe5e5b7-3fd6-4ef3-bb81-eef937e51d81" containerName="cleanup"
Sep 16 13:18:04.481174 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.481155    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:04.486586 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.486567    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 13:18:04.486693 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.486569    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-b764r\""
Sep 16 13:18:04.486693 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.486635    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 13:18:04.490260 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.490242    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 13:18:04.502068 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.502045    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-2zkp2"]
Sep 16 13:18:04.555015 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.554991    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93aac-41c0-41b0-bd21-b7d78f12a836-metrics-certs\") pod \"maas-controller-669f4b5bdf-2zkp2\" (UID: \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\") " pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:04.555140 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.555035    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6a93aac-41c0-41b0-bd21-b7d78f12a836-webhook-cert\") pod \"maas-controller-669f4b5bdf-2zkp2\" (UID: \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\") " pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:04.555140 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.555080    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnfwf\" (UniqueName: \"kubernetes.io/projected/d6a93aac-41c0-41b0-bd21-b7d78f12a836-kube-api-access-mnfwf\") pod \"maas-controller-669f4b5bdf-2zkp2\" (UID: \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\") " pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:04.655735 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.655693    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93aac-41c0-41b0-bd21-b7d78f12a836-metrics-certs\") pod \"maas-controller-669f4b5bdf-2zkp2\" (UID: \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\") " pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:04.655865 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.655751    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6a93aac-41c0-41b0-bd21-b7d78f12a836-webhook-cert\") pod \"maas-controller-669f4b5bdf-2zkp2\" (UID: \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\") " pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:04.655865 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.655800    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnfwf\" (UniqueName: \"kubernetes.io/projected/d6a93aac-41c0-41b0-bd21-b7d78f12a836-kube-api-access-mnfwf\") pod \"maas-controller-669f4b5bdf-2zkp2\" (UID: \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\") " pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:04.658162 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.658130    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93aac-41c0-41b0-bd21-b7d78f12a836-metrics-certs\") pod \"maas-controller-669f4b5bdf-2zkp2\" (UID: \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\") " pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:04.658290 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.658170    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6a93aac-41c0-41b0-bd21-b7d78f12a836-webhook-cert\") pod \"maas-controller-669f4b5bdf-2zkp2\" (UID: \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\") " pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:04.674791 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.674765    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnfwf\" (UniqueName: \"kubernetes.io/projected/d6a93aac-41c0-41b0-bd21-b7d78f12a836-kube-api-access-mnfwf\") pod \"maas-controller-669f4b5bdf-2zkp2\" (UID: \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\") " pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:04.791555 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:04.791472    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:05.086446 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:05.086419    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-2zkp2"]
Sep 16 13:18:05.087457 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:18:05.087431    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a93aac_41c0_41b0_bd21_b7d78f12a836.slice/crio-6b7294a2afc28e1dc16d3c4ee915f47d6ca6244b3ad93bca3d68da8f04077beb WatchSource:0}: Error finding container 6b7294a2afc28e1dc16d3c4ee915f47d6ca6244b3ad93bca3d68da8f04077beb: Status 404 returned error can't find the container with id 6b7294a2afc28e1dc16d3c4ee915f47d6ca6244b3ad93bca3d68da8f04077beb
Sep 16 13:18:05.594945 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:05.594916    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669f4b5bdf-2zkp2" event={"ID":"d6a93aac-41c0-41b0-bd21-b7d78f12a836","Type":"ContainerStarted","Data":"a579ce07b2eb0d9efc66ad9e8212823f9cc7445ca9069e9ccff0829c65199a4d"}
Sep 16 13:18:05.595339 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:05.594966    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669f4b5bdf-2zkp2" event={"ID":"d6a93aac-41c0-41b0-bd21-b7d78f12a836","Type":"ContainerStarted","Data":"6b7294a2afc28e1dc16d3c4ee915f47d6ca6244b3ad93bca3d68da8f04077beb"}
Sep 16 13:18:05.595339 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:05.595034    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:05.620073 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:05.620001    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-669f4b5bdf-2zkp2" podStartSLOduration=1.180964857 podStartE2EDuration="1.619984593s" totalImagesPullingTime="439.019736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:18:05.619554131 +0000 UTC m=+2369.184375224" watchObservedRunningTime="2026-09-16 13:18:05.619984593 +0000 UTC m=+2369.184805684"
Sep 16 13:18:09.368713 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:09.368678    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:18:16.603098 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:16.603068    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:25.854646 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:25.854613    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:18:25.968793 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:25.968750    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-2zkp2"]
Sep 16 13:18:25.969041 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:25.969018    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-669f4b5bdf-2zkp2" podUID="d6a93aac-41c0-41b0-bd21-b7d78f12a836" containerName="manager" containerID="cri-o://a579ce07b2eb0d9efc66ad9e8212823f9cc7445ca9069e9ccff0829c65199a4d" gracePeriod=30
Sep 16 13:18:26.212640 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.212615    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:26.329955 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.329925    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93aac-41c0-41b0-bd21-b7d78f12a836-metrics-certs\") pod \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\" (UID: \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\") "
Sep 16 13:18:26.330115 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.329980    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnfwf\" (UniqueName: \"kubernetes.io/projected/d6a93aac-41c0-41b0-bd21-b7d78f12a836-kube-api-access-mnfwf\") pod \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\" (UID: \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\") "
Sep 16 13:18:26.330115 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.330010    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6a93aac-41c0-41b0-bd21-b7d78f12a836-webhook-cert\") pod \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\" (UID: \"d6a93aac-41c0-41b0-bd21-b7d78f12a836\") "
Sep 16 13:18:26.331934 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.331891    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6a93aac-41c0-41b0-bd21-b7d78f12a836-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d6a93aac-41c0-41b0-bd21-b7d78f12a836" (UID: "d6a93aac-41c0-41b0-bd21-b7d78f12a836"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:18:26.332068 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.331985    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a93aac-41c0-41b0-bd21-b7d78f12a836-kube-api-access-mnfwf" (OuterVolumeSpecName: "kube-api-access-mnfwf") pod "d6a93aac-41c0-41b0-bd21-b7d78f12a836" (UID: "d6a93aac-41c0-41b0-bd21-b7d78f12a836"). InnerVolumeSpecName "kube-api-access-mnfwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:18:26.332068 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.331984    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6a93aac-41c0-41b0-bd21-b7d78f12a836-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d6a93aac-41c0-41b0-bd21-b7d78f12a836" (UID: "d6a93aac-41c0-41b0-bd21-b7d78f12a836"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:18:26.431143 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.431117    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnfwf\" (UniqueName: \"kubernetes.io/projected/d6a93aac-41c0-41b0-bd21-b7d78f12a836-kube-api-access-mnfwf\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:18:26.431143 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.431142    2549 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d6a93aac-41c0-41b0-bd21-b7d78f12a836-webhook-cert\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:18:26.431293 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.431152    2549 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93aac-41c0-41b0-bd21-b7d78f12a836-metrics-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:18:26.707441 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.707347    2549 generic.go:356] "Generic (PLEG): container finished" podID="d6a93aac-41c0-41b0-bd21-b7d78f12a836" containerID="a579ce07b2eb0d9efc66ad9e8212823f9cc7445ca9069e9ccff0829c65199a4d" exitCode=0
Sep 16 13:18:26.707441 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.707387    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669f4b5bdf-2zkp2"
Sep 16 13:18:26.707441 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.707425    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669f4b5bdf-2zkp2" event={"ID":"d6a93aac-41c0-41b0-bd21-b7d78f12a836","Type":"ContainerDied","Data":"a579ce07b2eb0d9efc66ad9e8212823f9cc7445ca9069e9ccff0829c65199a4d"}
Sep 16 13:18:26.707753 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.707503    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669f4b5bdf-2zkp2" event={"ID":"d6a93aac-41c0-41b0-bd21-b7d78f12a836","Type":"ContainerDied","Data":"6b7294a2afc28e1dc16d3c4ee915f47d6ca6244b3ad93bca3d68da8f04077beb"}
Sep 16 13:18:26.707753 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.707536    2549 scope.go:117] "RemoveContainer" containerID="a579ce07b2eb0d9efc66ad9e8212823f9cc7445ca9069e9ccff0829c65199a4d"
Sep 16 13:18:26.719089 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.719072    2549 scope.go:117] "RemoveContainer" containerID="a579ce07b2eb0d9efc66ad9e8212823f9cc7445ca9069e9ccff0829c65199a4d"
Sep 16 13:18:26.719382 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:18:26.719363    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a579ce07b2eb0d9efc66ad9e8212823f9cc7445ca9069e9ccff0829c65199a4d\": container with ID starting with a579ce07b2eb0d9efc66ad9e8212823f9cc7445ca9069e9ccff0829c65199a4d not found: ID does not exist" containerID="a579ce07b2eb0d9efc66ad9e8212823f9cc7445ca9069e9ccff0829c65199a4d"
Sep 16 13:18:26.719451 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.719395    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a579ce07b2eb0d9efc66ad9e8212823f9cc7445ca9069e9ccff0829c65199a4d"} err="failed to get container status \"a579ce07b2eb0d9efc66ad9e8212823f9cc7445ca9069e9ccff0829c65199a4d\": rpc error: code = NotFound desc = could not find container \"a579ce07b2eb0d9efc66ad9e8212823f9cc7445ca9069e9ccff0829c65199a4d\": container with ID starting with a579ce07b2eb0d9efc66ad9e8212823f9cc7445ca9069e9ccff0829c65199a4d not found: ID does not exist"
Sep 16 13:18:26.733698 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.733676    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-2zkp2"]
Sep 16 13:18:26.738042 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.738020    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-2zkp2"]
Sep 16 13:18:26.920297 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:26.920256    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6a93aac-41c0-41b0-bd21-b7d78f12a836" path="/var/lib/kubelet/pods/d6a93aac-41c0-41b0-bd21-b7d78f12a836/volumes"
Sep 16 13:18:27.413630 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.413580    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:18:27.540846 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.540814    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-5xz2r"]
Sep 16 13:18:27.541228 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.541201    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a93aac-41c0-41b0-bd21-b7d78f12a836" containerName="manager"
Sep 16 13:18:27.541228 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.541222    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a93aac-41c0-41b0-bd21-b7d78f12a836" containerName="manager"
Sep 16 13:18:27.541389 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.541303    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a93aac-41c0-41b0-bd21-b7d78f12a836" containerName="manager"
Sep 16 13:18:27.545836 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.545808    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669f4b5bdf-5xz2r"
Sep 16 13:18:27.549059 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.549026    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 16 13:18:27.549184 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.549059    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 16 13:18:27.549184 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.549115    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 16 13:18:27.549184 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.549134    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-b764r\""
Sep 16 13:18:27.555943 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.555921    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-5xz2r"]
Sep 16 13:18:27.640298 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.640268    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c055becb-f619-468c-9510-b6fae0ffb6a9-webhook-cert\") pod \"maas-controller-669f4b5bdf-5xz2r\" (UID: \"c055becb-f619-468c-9510-b6fae0ffb6a9\") " pod="opendatahub/maas-controller-669f4b5bdf-5xz2r"
Sep 16 13:18:27.640526 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.640360    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5d6d\" (UniqueName: \"kubernetes.io/projected/c055becb-f619-468c-9510-b6fae0ffb6a9-kube-api-access-v5d6d\") pod \"maas-controller-669f4b5bdf-5xz2r\" (UID: \"c055becb-f619-468c-9510-b6fae0ffb6a9\") " pod="opendatahub/maas-controller-669f4b5bdf-5xz2r"
Sep 16 13:18:27.640526 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.640404    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c055becb-f619-468c-9510-b6fae0ffb6a9-metrics-certs\") pod \"maas-controller-669f4b5bdf-5xz2r\" (UID: \"c055becb-f619-468c-9510-b6fae0ffb6a9\") " pod="opendatahub/maas-controller-669f4b5bdf-5xz2r"
Sep 16 13:18:27.741936 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.741847    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c055becb-f619-468c-9510-b6fae0ffb6a9-webhook-cert\") pod \"maas-controller-669f4b5bdf-5xz2r\" (UID: \"c055becb-f619-468c-9510-b6fae0ffb6a9\") " pod="opendatahub/maas-controller-669f4b5bdf-5xz2r"
Sep 16 13:18:27.741936 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.741927    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5d6d\" (UniqueName: \"kubernetes.io/projected/c055becb-f619-468c-9510-b6fae0ffb6a9-kube-api-access-v5d6d\") pod \"maas-controller-669f4b5bdf-5xz2r\" (UID: \"c055becb-f619-468c-9510-b6fae0ffb6a9\") " pod="opendatahub/maas-controller-669f4b5bdf-5xz2r"
Sep 16 13:18:27.742176 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.741958    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c055becb-f619-468c-9510-b6fae0ffb6a9-metrics-certs\") pod \"maas-controller-669f4b5bdf-5xz2r\" (UID: \"c055becb-f619-468c-9510-b6fae0ffb6a9\") " pod="opendatahub/maas-controller-669f4b5bdf-5xz2r"
Sep 16 13:18:27.744432 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.744402    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c055becb-f619-468c-9510-b6fae0ffb6a9-metrics-certs\") pod \"maas-controller-669f4b5bdf-5xz2r\" (UID: \"c055becb-f619-468c-9510-b6fae0ffb6a9\") " pod="opendatahub/maas-controller-669f4b5bdf-5xz2r"
Sep 16 13:18:27.744565 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.744546    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c055becb-f619-468c-9510-b6fae0ffb6a9-webhook-cert\") pod \"maas-controller-669f4b5bdf-5xz2r\" (UID: \"c055becb-f619-468c-9510-b6fae0ffb6a9\") " pod="opendatahub/maas-controller-669f4b5bdf-5xz2r"
Sep 16 13:18:27.750607 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.750588    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5d6d\" (UniqueName: \"kubernetes.io/projected/c055becb-f619-468c-9510-b6fae0ffb6a9-kube-api-access-v5d6d\") pod \"maas-controller-669f4b5bdf-5xz2r\" (UID: \"c055becb-f619-468c-9510-b6fae0ffb6a9\") " pod="opendatahub/maas-controller-669f4b5bdf-5xz2r"
Sep 16 13:18:27.857883 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:27.857846    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669f4b5bdf-5xz2r"
Sep 16 13:18:28.133501 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:28.133459    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669f4b5bdf-5xz2r"]
Sep 16 13:18:28.134891 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:18:28.134863    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc055becb_f619_468c_9510_b6fae0ffb6a9.slice/crio-7b6fcc14c22483e71675100702c2c5d1693335c10654b2159d2ad5f2417f3106 WatchSource:0}: Error finding container 7b6fcc14c22483e71675100702c2c5d1693335c10654b2159d2ad5f2417f3106: Status 404 returned error can't find the container with id 7b6fcc14c22483e71675100702c2c5d1693335c10654b2159d2ad5f2417f3106
Sep 16 13:18:28.720897 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:28.720869    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669f4b5bdf-5xz2r" event={"ID":"c055becb-f619-468c-9510-b6fae0ffb6a9","Type":"ContainerStarted","Data":"7b6fcc14c22483e71675100702c2c5d1693335c10654b2159d2ad5f2417f3106"}
Sep 16 13:18:29.727193 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:29.727154    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669f4b5bdf-5xz2r" event={"ID":"c055becb-f619-468c-9510-b6fae0ffb6a9","Type":"ContainerStarted","Data":"f635903e636cae174c91c67e8b6cf5eb635527b81fc6a6ed007e1bc8c88a2030"}
Sep 16 13:18:29.727626 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:29.727280    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-669f4b5bdf-5xz2r"
Sep 16 13:18:29.756543 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:29.756468    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-669f4b5bdf-5xz2r" podStartSLOduration=2.242523221 podStartE2EDuration="2.756453837s" totalImagesPullingTime="513.930616ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:18:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:18:29.754853109 +0000 UTC m=+2393.319674202" watchObservedRunningTime="2026-09-16 13:18:29.756453837 +0000 UTC m=+2393.321274928"
Sep 16 13:18:40.734896 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:40.734865    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-669f4b5bdf-5xz2r"
Sep 16 13:18:53.675679 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:18:53.675642    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:19:16.446421 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:19:16.446380    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:20:45.830781 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:20:45.830699    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:21:36.626327 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:36.626292    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:21:37.305010 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:37.304979    2549 scope.go:117] "RemoveContainer" containerID="6027f9688a52e85f669a1eb2ed82e56d42dc33c20f841dd1a7ca1f3b8104691f"
Sep 16 13:21:52.156230 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.156198    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"]
Sep 16 13:21:52.159715 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.159693    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.162001 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.161976    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-00d58807-kserve-self-signed-certs\""
Sep 16 13:21:52.168341 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.168316    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"]
Sep 16 13:21:52.190292 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.190262    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:21:52.296429 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.296394    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-tmp-dir\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.296628 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.296445    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-dshm\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.296628 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.296545    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-model-cache\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.296628 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.296604    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c25f0b8-c500-4655-bd62-a018e5dd6a73-tls-certs\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.296787 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.296627    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr27x\" (UniqueName: \"kubernetes.io/projected/1c25f0b8-c500-4655-bd62-a018e5dd6a73-kube-api-access-lr27x\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.296787 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.296650    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-home\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.397425 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.397388    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-dshm\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.397425 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.397429    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-model-cache\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.397683 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.397468    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c25f0b8-c500-4655-bd62-a018e5dd6a73-tls-certs\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.397683 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.397506    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr27x\" (UniqueName: \"kubernetes.io/projected/1c25f0b8-c500-4655-bd62-a018e5dd6a73-kube-api-access-lr27x\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.397683 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.397521    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-home\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.397683 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.397565    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-tmp-dir\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.397914 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.397889    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-home\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.397960 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.397903    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-model-cache\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.397960 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.397930    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-tmp-dir\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.399760 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.399736    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-dshm\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.400055 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.400040    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c25f0b8-c500-4655-bd62-a018e5dd6a73-tls-certs\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.406012 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.405989    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr27x\" (UniqueName: \"kubernetes.io/projected/1c25f0b8-c500-4655-bd62-a018e5dd6a73-kube-api-access-lr27x\") pod \"e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") " pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.469941 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.469884    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:21:52.741711 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.741687    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"]
Sep 16 13:21:52.743641 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:21:52.743612    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c25f0b8_c500_4655_bd62_a018e5dd6a73.slice/crio-4a16ff74660dac594d392629f705d6c164bab990b09708a09bb22e6fc9a4943d WatchSource:0}: Error finding container 4a16ff74660dac594d392629f705d6c164bab990b09708a09bb22e6fc9a4943d: Status 404 returned error can't find the container with id 4a16ff74660dac594d392629f705d6c164bab990b09708a09bb22e6fc9a4943d
Sep 16 13:21:52.755009 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:52.754985    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs" event={"ID":"1c25f0b8-c500-4655-bd62-a018e5dd6a73","Type":"ContainerStarted","Data":"4a16ff74660dac594d392629f705d6c164bab990b09708a09bb22e6fc9a4943d"}
Sep 16 13:21:53.768012 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:53.767972    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs" event={"ID":"1c25f0b8-c500-4655-bd62-a018e5dd6a73","Type":"ContainerStarted","Data":"73e3875cf1bd3ccc26a241139c0c11ee815b23079b902e7570b07241cbba3b1e"}
Sep 16 13:21:53.789705 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:21:53.789663    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs" podStartSLOduration=1.789647949 podStartE2EDuration="1.789647949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:21:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:21:53.787725829 +0000 UTC m=+2597.352546921" watchObservedRunningTime="2026-09-16 13:21:53.789647949 +0000 UTC m=+2597.354469039"
Sep 16 13:22:02.470632 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:02.470539    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:22:02.470632 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:02.470594    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:22:02.483223 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:02.483196    2549 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:22:02.826277 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:02.826194    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:22:35.571197 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:35.571160    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:22:35.899446 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:35.899363    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:22:36.549457 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:36.549425    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"]
Sep 16 13:22:36.573549 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:36.573517    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:22:51.568772 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.568709    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs" podUID="1c25f0b8-c500-4655-bd62-a018e5dd6a73" containerName="main" containerID="cri-o://73e3875cf1bd3ccc26a241139c0c11ee815b23079b902e7570b07241cbba3b1e" gracePeriod=45
Sep 16 13:22:51.816117 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.816089    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:22:51.873570 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.873499    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-tmp-dir\") pod \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") "
Sep 16 13:22:51.873570 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.873541    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-dshm\") pod \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") "
Sep 16 13:22:51.873785 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.873608    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c25f0b8-c500-4655-bd62-a018e5dd6a73-tls-certs\") pod \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") "
Sep 16 13:22:51.873785 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.873633    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-home\") pod \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") "
Sep 16 13:22:51.873785 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.873687    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-model-cache\") pod \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") "
Sep 16 13:22:51.873785 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.873744    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1c25f0b8-c500-4655-bd62-a018e5dd6a73" (UID: "1c25f0b8-c500-4655-bd62-a018e5dd6a73"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:22:51.874000 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.873797    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lr27x\" (UniqueName: \"kubernetes.io/projected/1c25f0b8-c500-4655-bd62-a018e5dd6a73-kube-api-access-lr27x\") pod \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\" (UID: \"1c25f0b8-c500-4655-bd62-a018e5dd6a73\") "
Sep 16 13:22:51.874000 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.873946    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-home" (OuterVolumeSpecName: "home") pod "1c25f0b8-c500-4655-bd62-a018e5dd6a73" (UID: "1c25f0b8-c500-4655-bd62-a018e5dd6a73"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:22:51.874000 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.873957    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-model-cache" (OuterVolumeSpecName: "model-cache") pod "1c25f0b8-c500-4655-bd62-a018e5dd6a73" (UID: "1c25f0b8-c500-4655-bd62-a018e5dd6a73"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:22:51.874117 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.874061    2549 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-home\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:22:51.874117 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.874079    2549 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-model-cache\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:22:51.874117 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.874095    2549 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-tmp-dir\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:22:51.875622 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.875599    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-dshm" (OuterVolumeSpecName: "dshm") pod "1c25f0b8-c500-4655-bd62-a018e5dd6a73" (UID: "1c25f0b8-c500-4655-bd62-a018e5dd6a73"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 16 13:22:51.876081 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.876059    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c25f0b8-c500-4655-bd62-a018e5dd6a73-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1c25f0b8-c500-4655-bd62-a018e5dd6a73" (UID: "1c25f0b8-c500-4655-bd62-a018e5dd6a73"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:22:51.876158 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.876082    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c25f0b8-c500-4655-bd62-a018e5dd6a73-kube-api-access-lr27x" (OuterVolumeSpecName: "kube-api-access-lr27x") pod "1c25f0b8-c500-4655-bd62-a018e5dd6a73" (UID: "1c25f0b8-c500-4655-bd62-a018e5dd6a73"). InnerVolumeSpecName "kube-api-access-lr27x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:22:51.975156 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.975132    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lr27x\" (UniqueName: \"kubernetes.io/projected/1c25f0b8-c500-4655-bd62-a018e5dd6a73-kube-api-access-lr27x\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:22:51.975262 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.975158    2549 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c25f0b8-c500-4655-bd62-a018e5dd6a73-dshm\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:22:51.975262 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:51.975173    2549 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c25f0b8-c500-4655-bd62-a018e5dd6a73-tls-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:22:52.001224 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:52.001155    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:22:52.066914 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:52.066888    2549 generic.go:356] "Generic (PLEG): container finished" podID="1c25f0b8-c500-4655-bd62-a018e5dd6a73" containerID="73e3875cf1bd3ccc26a241139c0c11ee815b23079b902e7570b07241cbba3b1e" exitCode=0
Sep 16 13:22:52.067011 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:52.066935    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"
Sep 16 13:22:52.067060 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:52.066926    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs" event={"ID":"1c25f0b8-c500-4655-bd62-a018e5dd6a73","Type":"ContainerDied","Data":"73e3875cf1bd3ccc26a241139c0c11ee815b23079b902e7570b07241cbba3b1e"}
Sep 16 13:22:52.067060 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:52.067042    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs" event={"ID":"1c25f0b8-c500-4655-bd62-a018e5dd6a73","Type":"ContainerDied","Data":"4a16ff74660dac594d392629f705d6c164bab990b09708a09bb22e6fc9a4943d"}
Sep 16 13:22:52.067159 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:52.067061    2549 scope.go:117] "RemoveContainer" containerID="73e3875cf1bd3ccc26a241139c0c11ee815b23079b902e7570b07241cbba3b1e"
Sep 16 13:22:52.076496 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:52.076462    2549 scope.go:117] "RemoveContainer" containerID="73e3875cf1bd3ccc26a241139c0c11ee815b23079b902e7570b07241cbba3b1e"
Sep 16 13:22:52.076762 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:22:52.076742    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73e3875cf1bd3ccc26a241139c0c11ee815b23079b902e7570b07241cbba3b1e\": container with ID starting with 73e3875cf1bd3ccc26a241139c0c11ee815b23079b902e7570b07241cbba3b1e not found: ID does not exist" containerID="73e3875cf1bd3ccc26a241139c0c11ee815b23079b902e7570b07241cbba3b1e"
Sep 16 13:22:52.076834 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:52.076770    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73e3875cf1bd3ccc26a241139c0c11ee815b23079b902e7570b07241cbba3b1e"} err="failed to get container status \"73e3875cf1bd3ccc26a241139c0c11ee815b23079b902e7570b07241cbba3b1e\": rpc error: code = NotFound desc = could not find container \"73e3875cf1bd3ccc26a241139c0c11ee815b23079b902e7570b07241cbba3b1e\": container with ID starting with 73e3875cf1bd3ccc26a241139c0c11ee815b23079b902e7570b07241cbba3b1e not found: ID does not exist"
Sep 16 13:22:52.089656 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:52.089633    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"]
Sep 16 13:22:52.093996 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:52.093967    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-00d58807-kserve-f69f66b7-9gjzs"]
Sep 16 13:22:52.920396 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:52.920361    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c25f0b8-c500-4655-bd62-a018e5dd6a73" path="/var/lib/kubelet/pods/1c25f0b8-c500-4655-bd62-a018e5dd6a73/volumes"
Sep 16 13:22:55.988762 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:55.988729    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"]
Sep 16 13:22:55.989130 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:55.989107    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c25f0b8-c500-4655-bd62-a018e5dd6a73" containerName="main"
Sep 16 13:22:55.989130 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:55.989119    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c25f0b8-c500-4655-bd62-a018e5dd6a73" containerName="main"
Sep 16 13:22:55.989206 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:55.989193    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c25f0b8-c500-4655-bd62-a018e5dd6a73" containerName="main"
Sep 16 13:22:55.993748 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:55.993726    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:56.015433 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.015407    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"]
Sep 16 13:22:56.109194 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.109160    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6jsn\" (UniqueName: \"kubernetes.io/projected/cf7a2561-c42f-485a-b164-4e5eaaa3d182-kube-api-access-z6jsn\") pod \"maas-api-684fb4cd97-drxx5\" (UID: \"cf7a2561-c42f-485a-b164-4e5eaaa3d182\") " pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:56.109369 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.109200    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf7a2561-c42f-485a-b164-4e5eaaa3d182-maas-api-tls\") pod \"maas-api-684fb4cd97-drxx5\" (UID: \"cf7a2561-c42f-485a-b164-4e5eaaa3d182\") " pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:56.109369 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.109230    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7a2561-c42f-485a-b164-4e5eaaa3d182-openshift-service-ca\") pod \"maas-api-684fb4cd97-drxx5\" (UID: \"cf7a2561-c42f-485a-b164-4e5eaaa3d182\") " pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:56.109369 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.109335    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf7a2561-c42f-485a-b164-4e5eaaa3d182-metrics-certs\") pod \"maas-api-684fb4cd97-drxx5\" (UID: \"cf7a2561-c42f-485a-b164-4e5eaaa3d182\") " pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:56.209949 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.209911    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf7a2561-c42f-485a-b164-4e5eaaa3d182-metrics-certs\") pod \"maas-api-684fb4cd97-drxx5\" (UID: \"cf7a2561-c42f-485a-b164-4e5eaaa3d182\") " pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:56.210144 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.209969    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6jsn\" (UniqueName: \"kubernetes.io/projected/cf7a2561-c42f-485a-b164-4e5eaaa3d182-kube-api-access-z6jsn\") pod \"maas-api-684fb4cd97-drxx5\" (UID: \"cf7a2561-c42f-485a-b164-4e5eaaa3d182\") " pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:56.210144 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.209996    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf7a2561-c42f-485a-b164-4e5eaaa3d182-maas-api-tls\") pod \"maas-api-684fb4cd97-drxx5\" (UID: \"cf7a2561-c42f-485a-b164-4e5eaaa3d182\") " pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:56.210144 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.210027    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7a2561-c42f-485a-b164-4e5eaaa3d182-openshift-service-ca\") pod \"maas-api-684fb4cd97-drxx5\" (UID: \"cf7a2561-c42f-485a-b164-4e5eaaa3d182\") " pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:56.210857 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.210831    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf7a2561-c42f-485a-b164-4e5eaaa3d182-openshift-service-ca\") pod \"maas-api-684fb4cd97-drxx5\" (UID: \"cf7a2561-c42f-485a-b164-4e5eaaa3d182\") " pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:56.212546 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.212519    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf7a2561-c42f-485a-b164-4e5eaaa3d182-maas-api-tls\") pod \"maas-api-684fb4cd97-drxx5\" (UID: \"cf7a2561-c42f-485a-b164-4e5eaaa3d182\") " pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:56.212652 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.212589    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf7a2561-c42f-485a-b164-4e5eaaa3d182-metrics-certs\") pod \"maas-api-684fb4cd97-drxx5\" (UID: \"cf7a2561-c42f-485a-b164-4e5eaaa3d182\") " pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:56.218021 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.217999    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6jsn\" (UniqueName: \"kubernetes.io/projected/cf7a2561-c42f-485a-b164-4e5eaaa3d182-kube-api-access-z6jsn\") pod \"maas-api-684fb4cd97-drxx5\" (UID: \"cf7a2561-c42f-485a-b164-4e5eaaa3d182\") " pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:56.303357 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.303272    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:56.584289 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.584260    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"]
Sep 16 13:22:56.584400 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:22:56.584375    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf7a2561_c42f_485a_b164_4e5eaaa3d182.slice/crio-0154fb5bc55d4575dba6cef0ffaac878031df1ab10ec23c6d673a37296dbb44b WatchSource:0}: Error finding container 0154fb5bc55d4575dba6cef0ffaac878031df1ab10ec23c6d673a37296dbb44b: Status 404 returned error can't find the container with id 0154fb5bc55d4575dba6cef0ffaac878031df1ab10ec23c6d673a37296dbb44b
Sep 16 13:22:56.585806 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:56.585781    2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 16 13:22:57.097645 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:57.097613    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5" event={"ID":"cf7a2561-c42f-485a-b164-4e5eaaa3d182","Type":"ContainerStarted","Data":"0154fb5bc55d4575dba6cef0ffaac878031df1ab10ec23c6d673a37296dbb44b"}
Sep 16 13:22:58.104234 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:58.104196    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5" event={"ID":"cf7a2561-c42f-485a-b164-4e5eaaa3d182","Type":"ContainerStarted","Data":"c79983a603f467d4deabe8a78d95203978408e6b484f3877de6f1a3e8103cd02"}
Sep 16 13:22:58.104745 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:58.104328    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:22:58.125100 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:22:58.125050    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5" podStartSLOduration=2.625165526 podStartE2EDuration="3.125033935s" totalImagesPullingTime="499.868409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-16 13:22:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:22:58.122459141 +0000 UTC m=+2661.687280232" watchObservedRunningTime="2026-09-16 13:22:58.125033935 +0000 UTC m=+2661.689855026"
Sep 16 13:23:04.114574 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:04.114538    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-684fb4cd97-drxx5"
Sep 16 13:23:04.169042 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:04.169007    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"]
Sep 16 13:23:04.169263 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:04.169240    2549 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t" podUID="5d69af9a-61f8-4607-a29a-f0dfae863a92" containerName="maas-api" containerID="cri-o://2e98bdb06009f89b97c08f5e77980286e9e9c1cfb2783c0ad7d62fa6a2257e56" gracePeriod=30
Sep 16 13:23:05.413256 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:05.413234    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 13:23:05.490090 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:05.490064    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d69af9a-61f8-4607-a29a-f0dfae863a92-maas-api-tls\") pod \"5d69af9a-61f8-4607-a29a-f0dfae863a92\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") "
Sep 16 13:23:05.490227 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:05.490105    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d69af9a-61f8-4607-a29a-f0dfae863a92-metrics-certs\") pod \"5d69af9a-61f8-4607-a29a-f0dfae863a92\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") "
Sep 16 13:23:05.490227 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:05.490132    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pdpg\" (UniqueName: \"kubernetes.io/projected/5d69af9a-61f8-4607-a29a-f0dfae863a92-kube-api-access-7pdpg\") pod \"5d69af9a-61f8-4607-a29a-f0dfae863a92\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") "
Sep 16 13:23:05.490227 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:05.490169    2549 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d69af9a-61f8-4607-a29a-f0dfae863a92-openshift-service-ca\") pod \"5d69af9a-61f8-4607-a29a-f0dfae863a92\" (UID: \"5d69af9a-61f8-4607-a29a-f0dfae863a92\") "
Sep 16 13:23:05.490552 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:05.490525    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d69af9a-61f8-4607-a29a-f0dfae863a92-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5d69af9a-61f8-4607-a29a-f0dfae863a92" (UID: "5d69af9a-61f8-4607-a29a-f0dfae863a92"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 16 13:23:05.492155 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:05.492131    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d69af9a-61f8-4607-a29a-f0dfae863a92-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5d69af9a-61f8-4607-a29a-f0dfae863a92" (UID: "5d69af9a-61f8-4607-a29a-f0dfae863a92"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:23:05.492626 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:05.492608    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d69af9a-61f8-4607-a29a-f0dfae863a92-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5d69af9a-61f8-4607-a29a-f0dfae863a92" (UID: "5d69af9a-61f8-4607-a29a-f0dfae863a92"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 16 13:23:05.492685 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:05.492642    2549 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d69af9a-61f8-4607-a29a-f0dfae863a92-kube-api-access-7pdpg" (OuterVolumeSpecName: "kube-api-access-7pdpg") pod "5d69af9a-61f8-4607-a29a-f0dfae863a92" (UID: "5d69af9a-61f8-4607-a29a-f0dfae863a92"). InnerVolumeSpecName "kube-api-access-7pdpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 16 13:23:05.591231 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:05.591170    2549 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5d69af9a-61f8-4607-a29a-f0dfae863a92-maas-api-tls\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:23:05.591231 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:05.591194    2549 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5d69af9a-61f8-4607-a29a-f0dfae863a92-metrics-certs\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:23:05.591231 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:05.591204    2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pdpg\" (UniqueName: \"kubernetes.io/projected/5d69af9a-61f8-4607-a29a-f0dfae863a92-kube-api-access-7pdpg\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:23:05.591231 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:05.591213    2549 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d69af9a-61f8-4607-a29a-f0dfae863a92-openshift-service-ca\") on node \"ip-10-0-128-195.ec2.internal\" DevicePath \"\""
Sep 16 13:23:06.152717 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:06.152680    2549 generic.go:356] "Generic (PLEG): container finished" podID="5d69af9a-61f8-4607-a29a-f0dfae863a92" containerID="2e98bdb06009f89b97c08f5e77980286e9e9c1cfb2783c0ad7d62fa6a2257e56" exitCode=0
Sep 16 13:23:06.152891 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:06.152724    2549 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"
Sep 16 13:23:06.152891 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:06.152726    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t" event={"ID":"5d69af9a-61f8-4607-a29a-f0dfae863a92","Type":"ContainerDied","Data":"2e98bdb06009f89b97c08f5e77980286e9e9c1cfb2783c0ad7d62fa6a2257e56"}
Sep 16 13:23:06.152891 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:06.152784    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d477c8649-bn45t" event={"ID":"5d69af9a-61f8-4607-a29a-f0dfae863a92","Type":"ContainerDied","Data":"26192bac0dd5e00fd2f6da0fb7dd4a8f589fc8812a9a653d66f43b4409c6a2ae"}
Sep 16 13:23:06.152891 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:06.152806    2549 scope.go:117] "RemoveContainer" containerID="2e98bdb06009f89b97c08f5e77980286e9e9c1cfb2783c0ad7d62fa6a2257e56"
Sep 16 13:23:06.162392 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:06.162373    2549 scope.go:117] "RemoveContainer" containerID="2e98bdb06009f89b97c08f5e77980286e9e9c1cfb2783c0ad7d62fa6a2257e56"
Sep 16 13:23:06.162719 ip-10-0-128-195 kubenswrapper[2549]: E0916 13:23:06.162699    2549 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e98bdb06009f89b97c08f5e77980286e9e9c1cfb2783c0ad7d62fa6a2257e56\": container with ID starting with 2e98bdb06009f89b97c08f5e77980286e9e9c1cfb2783c0ad7d62fa6a2257e56 not found: ID does not exist" containerID="2e98bdb06009f89b97c08f5e77980286e9e9c1cfb2783c0ad7d62fa6a2257e56"
Sep 16 13:23:06.162770 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:06.162729    2549 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e98bdb06009f89b97c08f5e77980286e9e9c1cfb2783c0ad7d62fa6a2257e56"} err="failed to get container status \"2e98bdb06009f89b97c08f5e77980286e9e9c1cfb2783c0ad7d62fa6a2257e56\": rpc error: code = NotFound desc = could not find container \"2e98bdb06009f89b97c08f5e77980286e9e9c1cfb2783c0ad7d62fa6a2257e56\": container with ID starting with 2e98bdb06009f89b97c08f5e77980286e9e9c1cfb2783c0ad7d62fa6a2257e56 not found: ID does not exist"
Sep 16 13:23:06.175195 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:06.175172    2549 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"]
Sep 16 13:23:06.179441 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:06.179414    2549 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d477c8649-bn45t"]
Sep 16 13:23:06.921240 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:06.921206    2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d69af9a-61f8-4607-a29a-f0dfae863a92" path="/var/lib/kubelet/pods/5d69af9a-61f8-4607-a29a-f0dfae863a92/volumes"
Sep 16 13:23:32.530667 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:32.529946    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cm822_eae319fe-3165-436d-a422-ccc32ee28537/manager/0.log"
Sep 16 13:23:32.804145 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:32.804068    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-669f4b5bdf-5xz2r_c055becb-f619-468c-9510-b6fae0ffb6a9/manager/0.log"
Sep 16 13:23:32.925811 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:32.925783    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4fz99_e7b26d94-5f27-4f38-a066-70f1d20ae6d9/server/0.log"
Sep 16 13:23:33.042486 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:33.042440    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xpg7x_ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102/manager/0.log"
Sep 16 13:23:33.155092 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:33.155031    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c7bc95455-gvj6l_9f1bce76-0b21-462b-b809-bb07d34c06b0/copy-manifests/0.log"
Sep 16 13:23:33.167353 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:33.167329    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c7bc95455-gvj6l_9f1bce76-0b21-462b-b809-bb07d34c06b0/manager/0.log"
Sep 16 13:23:33.770924 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:33.770890    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-684fb4cd97-drxx5_cf7a2561-c42f-485a-b164-4e5eaaa3d182/maas-api/0.log"
Sep 16 13:23:34.261973 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:34.261946    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-4p6mq_cd49dc67-f74b-4404-ac8c-99ce7552af51/postgres/0.log"
Sep 16 13:23:35.857862 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:35.857826    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-rr4zb_ea450005-75b1-4de5-aa4e-649057dc229a/manager/0.log"
Sep 16 13:23:36.348967 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:36.348938    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-t9znl_9ba27cb0-3e67-4533-9fde-b364c1866e35/discovery/0.log"
Sep 16 13:23:36.580355 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:36.580325    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8568fcf948-vhx9p_ab49eb08-0e42-4208-a0d7-eeb1191ab4fc/kube-auth-proxy/0.log"
Sep 16 13:23:36.836230 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:36.836201    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hlmzd_619b0d74-890d-4627-8337-64acec84c753/payload-pre-processing/0.log"
Sep 16 13:23:36.959617 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:36.959587    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k2d2c_e0444988-d22a-4a4e-ba47-111da27b871b/payload-processing/0.log"
Sep 16 13:23:37.666105 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:37.666080    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-dbhcs_947dbb78-1634-42d7-ac14-01aefcfb8ef8/main/0.log"
Sep 16 13:23:43.973901 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:43.973872    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:23:44.070541 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:44.070509    2549 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log" limit=1024
Sep 16 13:23:47.018935 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:47.018902    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hkcrj_02f43e10-d508-4244-8f0c-534b182fc11d/global-pull-secret-syncer/0.log"
Sep 16 13:23:47.140677 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:47.140647    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5sclw_6704aa38-49e4-45d6-85c9-9bca777aafdc/konnectivity-agent/0.log"
Sep 16 13:23:47.251349 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:47.251318    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-195.ec2.internal_4cf5b75210ff49812e784216b4e945d0/haproxy/0.log"
Sep 16 13:23:52.177868 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:52.177833    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-rr4zb_ea450005-75b1-4de5-aa4e-649057dc229a/manager/0.log"
Sep 16 13:23:53.962055 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:53.962026    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-2p6vt_7bf257e1-b4d9-4361-91fe-c06a3af8d733/monitoring-plugin/0.log"
Sep 16 13:23:54.246743 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:54.246667    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mcffg_56d83072-5edc-40f0-a46e-90b5f91bbbcc/node-exporter/0.log"
Sep 16 13:23:54.272017 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:54.271993    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mcffg_56d83072-5edc-40f0-a46e-90b5f91bbbcc/kube-rbac-proxy/0.log"
Sep 16 13:23:54.295398 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:54.295375    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mcffg_56d83072-5edc-40f0-a46e-90b5f91bbbcc/init-textfile/0.log"
Sep 16 13:23:54.930368 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:54.930344    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65f97c6c5d-znxdq_6e6142c3-ca86-4fb0-bab8-c9749d052038/thanos-query/0.log"
Sep 16 13:23:54.963543 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:54.963518    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65f97c6c5d-znxdq_6e6142c3-ca86-4fb0-bab8-c9749d052038/kube-rbac-proxy-web/0.log"
Sep 16 13:23:54.989518 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:54.989473    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65f97c6c5d-znxdq_6e6142c3-ca86-4fb0-bab8-c9749d052038/kube-rbac-proxy/0.log"
Sep 16 13:23:55.014253 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:55.014234    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65f97c6c5d-znxdq_6e6142c3-ca86-4fb0-bab8-c9749d052038/prom-label-proxy/0.log"
Sep 16 13:23:55.038424 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:55.038406    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65f97c6c5d-znxdq_6e6142c3-ca86-4fb0-bab8-c9749d052038/kube-rbac-proxy-rules/0.log"
Sep 16 13:23:55.067330 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:55.067306    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-65f97c6c5d-znxdq_6e6142c3-ca86-4fb0-bab8-c9749d052038/kube-rbac-proxy-metrics/0.log"
Sep 16 13:23:56.921892 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:56.921863    2549 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"]
Sep 16 13:23:56.922236 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:56.922189    2549 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d69af9a-61f8-4607-a29a-f0dfae863a92" containerName="maas-api"
Sep 16 13:23:56.922236 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:56.922199    2549 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d69af9a-61f8-4607-a29a-f0dfae863a92" containerName="maas-api"
Sep 16 13:23:56.922308 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:56.922259    2549 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d69af9a-61f8-4607-a29a-f0dfae863a92" containerName="maas-api"
Sep 16 13:23:56.925510 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:56.925488    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:56.927886 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:56.927864    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fs84m\"/\"openshift-service-ca.crt\""
Sep 16 13:23:56.928038 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:56.927906    2549 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fs84m\"/\"default-dockercfg-rz5kq\""
Sep 16 13:23:56.928405 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:56.928388    2549 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fs84m\"/\"kube-root-ca.crt\""
Sep 16 13:23:56.938806 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:56.938783    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"]
Sep 16 13:23:57.008789 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.008748    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e98bc0d3-f17f-4257-a044-747fc968ae75-podres\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.008989 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.008834    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e98bc0d3-f17f-4257-a044-747fc968ae75-proc\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.008989 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.008877    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e98bc0d3-f17f-4257-a044-747fc968ae75-lib-modules\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.008989 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.008943    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg96h\" (UniqueName: \"kubernetes.io/projected/e98bc0d3-f17f-4257-a044-747fc968ae75-kube-api-access-rg96h\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.008989 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.008974    2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e98bc0d3-f17f-4257-a044-747fc968ae75-sys\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.109841 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.109808    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e98bc0d3-f17f-4257-a044-747fc968ae75-podres\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.110007 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.109866    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e98bc0d3-f17f-4257-a044-747fc968ae75-proc\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.110007 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.109882    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e98bc0d3-f17f-4257-a044-747fc968ae75-lib-modules\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.110007 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.109934    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg96h\" (UniqueName: \"kubernetes.io/projected/e98bc0d3-f17f-4257-a044-747fc968ae75-kube-api-access-rg96h\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.110007 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.109945    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e98bc0d3-f17f-4257-a044-747fc968ae75-proc\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.110007 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.109952    2549 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e98bc0d3-f17f-4257-a044-747fc968ae75-sys\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.110007 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.109968    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e98bc0d3-f17f-4257-a044-747fc968ae75-podres\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.110007 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.109998    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e98bc0d3-f17f-4257-a044-747fc968ae75-sys\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.110245 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.110062    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e98bc0d3-f17f-4257-a044-747fc968ae75-lib-modules\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.120716 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.120688    2549 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg96h\" (UniqueName: \"kubernetes.io/projected/e98bc0d3-f17f-4257-a044-747fc968ae75-kube-api-access-rg96h\") pod \"perf-node-gather-daemonset-vljld\" (UID: \"e98bc0d3-f17f-4257-a044-747fc968ae75\") " pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.235234 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.235168    2549 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:57.517626 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:57.517597    2549 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"]
Sep 16 13:23:57.519462 ip-10-0-128-195 kubenswrapper[2549]: W0916 13:23:57.519432    2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode98bc0d3_f17f_4257_a044_747fc968ae75.slice/crio-caa03d65e6310e7e963f1c4701ab90bd868152a248e547af171b2b34aa4f8141 WatchSource:0}: Error finding container caa03d65e6310e7e963f1c4701ab90bd868152a248e547af171b2b34aa4f8141: Status 404 returned error can't find the container with id caa03d65e6310e7e963f1c4701ab90bd868152a248e547af171b2b34aa4f8141
Sep 16 13:23:58.423605 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:58.423572    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld" event={"ID":"e98bc0d3-f17f-4257-a044-747fc968ae75","Type":"ContainerStarted","Data":"728ca14b9527ec7ead48bcc5e4063a86da5b47314a4e3d0710a308fc7d48886b"}
Sep 16 13:23:58.424066 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:58.423619    2549 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld" event={"ID":"e98bc0d3-f17f-4257-a044-747fc968ae75","Type":"ContainerStarted","Data":"caa03d65e6310e7e963f1c4701ab90bd868152a248e547af171b2b34aa4f8141"}
Sep 16 13:23:58.424066 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:58.423672    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:23:58.445859 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:58.445814    2549 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld" podStartSLOduration=2.445800862 podStartE2EDuration="2.445800862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-16 13:23:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-16 13:23:58.444272531 +0000 UTC m=+2722.009093622" watchObservedRunningTime="2026-09-16 13:23:58.445800862 +0000 UTC m=+2722.010621952"
Sep 16 13:23:59.646732 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:59.646701    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rgxdk_e2840f8d-0b93-4727-a7f3-fd9eef53c609/dns/0.log"
Sep 16 13:23:59.681335 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:59.681313    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rgxdk_e2840f8d-0b93-4727-a7f3-fd9eef53c609/kube-rbac-proxy/0.log"
Sep 16 13:23:59.795719 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:23:59.795691    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6gq76_42955466-fe7b-4765-9db7-390d2d3e6917/dns-node-resolver/0.log"
Sep 16 13:24:00.657158 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:00.657127    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fxcfd_b9bc16ce-d5ef-4d7b-9632-ab2849397953/node-ca/0.log"
Sep 16 13:24:02.436354 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:02.436321    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-t9znl_9ba27cb0-3e67-4533-9fde-b364c1866e35/discovery/0.log"
Sep 16 13:24:02.519951 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:02.519923    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8568fcf948-vhx9p_ab49eb08-0e42-4208-a0d7-eeb1191ab4fc/kube-auth-proxy/0.log"
Sep 16 13:24:02.619209 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:02.619179    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hlmzd_619b0d74-890d-4627-8337-64acec84c753/payload-pre-processing/0.log"
Sep 16 13:24:02.662064 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:02.662038    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k2d2c_e0444988-d22a-4a4e-ba47-111da27b871b/payload-processing/0.log"
Sep 16 13:24:03.759918 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:03.759887    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lgchs_1016f0df-c95f-49f1-bec3-251e0637e4fa/serve-healthcheck-canary/0.log"
Sep 16 13:24:04.438643 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:04.438616    2549 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fs84m/perf-node-gather-daemonset-vljld"
Sep 16 13:24:04.652363 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:04.652333    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jqgw8_868430e8-ab0a-447e-af10-1f0b5da8c360/kube-rbac-proxy/0.log"
Sep 16 13:24:04.697181 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:04.697110    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jqgw8_868430e8-ab0a-447e-af10-1f0b5da8c360/exporter/0.log"
Sep 16 13:24:04.724031 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:04.724005    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jqgw8_868430e8-ab0a-447e-af10-1f0b5da8c360/extractor/0.log"
Sep 16 13:24:07.448056 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:07.448025    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cm822_eae319fe-3165-436d-a422-ccc32ee28537/manager/0.log"
Sep 16 13:24:08.001176 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:08.001086    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-669f4b5bdf-5xz2r_c055becb-f619-468c-9510-b6fae0ffb6a9/manager/0.log"
Sep 16 13:24:08.048930 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:08.048904    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-4fz99_e7b26d94-5f27-4f38-a066-70f1d20ae6d9/server/0.log"
Sep 16 13:24:08.191062 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:08.191027    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xpg7x_ebcbdbb1-eaa5-4c4b-b2f3-8f94baad6102/manager/0.log"
Sep 16 13:24:08.303340 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:08.303314    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c7bc95455-gvj6l_9f1bce76-0b21-462b-b809-bb07d34c06b0/manager/0.log"
Sep 16 13:24:08.327001 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:08.326975    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c7bc95455-gvj6l_9f1bce76-0b21-462b-b809-bb07d34c06b0/copy-manifests/0.log"
Sep 16 13:24:08.425752 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:08.425725    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-t9znl_9ba27cb0-3e67-4533-9fde-b364c1866e35/discovery/0.log"
Sep 16 13:24:08.464659 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:08.464634    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8568fcf948-vhx9p_ab49eb08-0e42-4208-a0d7-eeb1191ab4fc/kube-auth-proxy/0.log"
Sep 16 13:24:08.531811 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:08.531784    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hlmzd_619b0d74-890d-4627-8337-64acec84c753/payload-pre-processing/0.log"
Sep 16 13:24:08.557566 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:08.557497    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k2d2c_e0444988-d22a-4a4e-ba47-111da27b871b/payload-processing/0.log"
Sep 16 13:24:09.978256 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:09.978216    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-5lddq_4eafe9a1-ae1d-4320-8616-b3478f533829/openshift-lws-operator/0.log"
Sep 16 13:24:10.767175 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:10.767145    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-t9znl_9ba27cb0-3e67-4533-9fde-b364c1866e35/discovery/0.log"
Sep 16 13:24:10.806340 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:10.806312    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8568fcf948-vhx9p_ab49eb08-0e42-4208-a0d7-eeb1191ab4fc/kube-auth-proxy/0.log"
Sep 16 13:24:10.871335 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:10.871312    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-hlmzd_619b0d74-890d-4627-8337-64acec84c753/payload-pre-processing/0.log"
Sep 16 13:24:10.895970 ip-10-0-128-195 kubenswrapper[2549]: I0916 13:24:10.895945    2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-k2d2c_e0444988-d22a-4a4e-ba47-111da27b871b/payload-processing/0.log"