Sep 09 05:49:38.652856 ip-10-0-138-92 systemd[1]: Starting Kubernetes Kubelet...
Sep 09 05:49:39.048184 ip-10-0-138-92 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 05:49:39.048184 ip-10-0-138-92 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 09 05:49:39.048184 ip-10-0-138-92 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 05:49:39.048184 ip-10-0-138-92 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 09 05:49:39.048184 ip-10-0-138-92 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 09 05:49:39.049883 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.049794    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 09 05:49:39.052695 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052678    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 05:49:39.052695 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052692    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 05:49:39.052695 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052696    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 05:49:39.052695 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052699    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 05:49:39.052695 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052702    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052706    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052709    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052711    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052714    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052717    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052720    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052722    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052725    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052734    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052738    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052741    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052745    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052749    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052752    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052756    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052759    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052761    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052764    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052766    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 05:49:39.052867 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052769    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052772    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052774    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052777    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052779    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052782    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052784    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052789    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052792    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052795    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052798    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052801    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052805    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052809    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052813    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052816    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052819    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052822    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052825    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 05:49:39.053384 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052828    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052831    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052833    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052836    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052838    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052841    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052843    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052845    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052848    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052850    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052853    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052855    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052857    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052861    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052863    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052866    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052869    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052872    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052874    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052877    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 05:49:39.053869 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052879    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052882    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052884    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052887    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052889    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052892    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052895    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052898    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052900    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052903    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052905    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052908    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052911    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052913    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052915    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052918    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052921    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052923    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052925    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052928    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 05:49:39.054371 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052930    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052932    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052935    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052937    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052939    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052942    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052944    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052947    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052949    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052952    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.052954    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.053017    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.053021    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.053024    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.053026    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.053029    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054522    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054531    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054534    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054537    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 05:49:39.054858 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054540    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054544    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054547    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054550    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054566    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054569    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054572    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054574    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054577    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054580    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054582    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054585    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054587    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054590    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054593    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054596    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054599    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054602    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054605    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 05:49:39.055324 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054609    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054613    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054616    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054619    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054622    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054626    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054629    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054632    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054635    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054638    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054641    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054643    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054645    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054649    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054652    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054655    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054658    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054660    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054663    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054665    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 05:49:39.055810 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054668    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054670    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054672    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054676    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054679    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054682    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054684    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054688    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054691    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054693    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054696    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054698    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054701    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054703    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054706    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054708    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054711    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054714    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054716    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054719    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 05:49:39.056295 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054721    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054723    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054726    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054728    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054731    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054733    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054737    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054739    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054742    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054745    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054747    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054750    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054752    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054754    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054757    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054759    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054762    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054764    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054767    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054770    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 05:49:39.056787 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054773    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054775    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054778    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054780    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054783    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054785    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054788    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054790    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054793    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054795    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054797    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054800    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054802    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054805    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054807    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.054809    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055176    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055180    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055183    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055186    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 05:49:39.057285 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055189    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055192    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055195    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055197    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055200    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055202    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055204    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055207    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055209    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055212    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055214    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055217    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055219    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055222    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055226    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055230    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055233    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055238    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055241    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 05:49:39.057891 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055244    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055247    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055250    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055252    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055255    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055258    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055260    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055262    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055265    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055268    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055270    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055273    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055276    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055279    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055282    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055284    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055287    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055289    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055291    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055294    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 05:49:39.058364 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055296    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055298    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055301    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055303    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055307    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055309    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055311    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055314    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055316    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055319    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055321    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055324    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055326    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055329    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055332    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055335    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055337    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055340    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055342    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 05:49:39.058963 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055346    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055349    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055352    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055355    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055358    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055360    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055363    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055365    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055368    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055370    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055372    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055375    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055377    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055380    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055382    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055384    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055387    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055390    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055393    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055395    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 05:49:39.059426 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055398    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055400    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055403    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055405    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055408    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055410    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055412    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055415    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055417    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055420    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055424    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055426    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055429    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055431    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055433    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055436    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.055439    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055522    2583 flags.go:64] FLAG: --address="0.0.0.0"
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055565    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055572    2583 flags.go:64] FLAG: --anonymous-auth="true"
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055577    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 09 05:49:39.059935 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055581    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055585    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055589    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055593    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055596    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055599    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055602    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055605    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055608    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055611    2583 flags.go:64] FLAG: --cgroup-root=""
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055614    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055617    2583 flags.go:64] FLAG: --client-ca-file=""
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055620    2583 flags.go:64] FLAG: --cloud-provider="external"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055623    2583 flags.go:64] FLAG: --cluster-dns="[]"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055627    2583 flags.go:64] FLAG: --cluster-domain=""
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055630    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055633    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055636    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055639    2583 flags.go:64] FLAG: --container-log-max-files="5"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055643    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055646    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055649    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055652    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055655    2583 flags.go:64] FLAG: --contention-profiling="false"
Sep 09 05:49:39.060461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055657    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055660    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055663    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055666    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055670    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055673    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055676    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055678    2583 flags.go:64] FLAG: --enable-load-reader="false"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055683    2583 flags.go:64] FLAG: --enable-server="true"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055687    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055691    2583 flags.go:64] FLAG: --event-burst="100"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055694    2583 flags.go:64] FLAG: --event-qps="50"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055697    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055700    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055703    2583 flags.go:64] FLAG: --eviction-hard=""
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055706    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055709    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055712    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055715    2583 flags.go:64] FLAG: --eviction-soft=""
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055717    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055720    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055723    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055726    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055729    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055731    2583 flags.go:64] FLAG: --fail-swap-on="true"
Sep 09 05:49:39.061055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055734    2583 flags.go:64] FLAG: --feature-gates=""
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055738    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055740    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055743    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055746    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055749    2583 flags.go:64] FLAG: --healthz-port="10248"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055752    2583 flags.go:64] FLAG: --help="false"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055754    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055757    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055760    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055763    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055766    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055769    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055772    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055774    2583 flags.go:64] FLAG: --image-service-endpoint=""
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055778    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055781    2583 flags.go:64] FLAG: --kube-api-burst="100"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055785    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055788    2583 flags.go:64] FLAG: --kube-api-qps="50"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055790    2583 flags.go:64] FLAG: --kube-reserved=""
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055793    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055796    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055799    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055801    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 09 05:49:39.061694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055804    2583 flags.go:64] FLAG: --lock-file=""
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055807    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055810    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055813    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055819    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055822    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055825    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055828    2583 flags.go:64] FLAG: --logging-format="text"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055831    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055834    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055837    2583 flags.go:64] FLAG: --manifest-url=""
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055839    2583 flags.go:64] FLAG: --manifest-url-header=""
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055843    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055846    2583 flags.go:64] FLAG: --max-open-files="1000000"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055851    2583 flags.go:64] FLAG: --max-pods="110"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055854    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055856    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055859    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055862    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055866    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055869    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055871    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055878    2583 flags.go:64] FLAG: --node-status-max-images="50"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055883    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055886    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 09 05:49:39.062290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055889    2583 flags.go:64] FLAG: --pod-cidr=""
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055893    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055898    2583 flags.go:64] FLAG: --pod-manifest-path=""
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055901    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055904    2583 flags.go:64] FLAG: --pods-per-core="0"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055907    2583 flags.go:64] FLAG: --port="10250"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055910    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055912    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ee00a615f1c50829"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055916    2583 flags.go:64] FLAG: --qos-reserved=""
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055919    2583 flags.go:64] FLAG: --read-only-port="10255"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055921    2583 flags.go:64] FLAG: --register-node="true"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055924    2583 flags.go:64] FLAG: --register-with-taints=""
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055928    2583 flags.go:64] FLAG: --registry-burst="10"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055930    2583 flags.go:64] FLAG: --registry-qps="5"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055933    2583 flags.go:64] FLAG: --reserved-cpus=""
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055936    2583 flags.go:64] FLAG: --reserved-memory=""
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055939    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055942    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055945    2583 flags.go:64] FLAG: --rotate-certificates="false"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055948    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055950    2583 flags.go:64] FLAG: --runonce="false"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055953    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055956    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055959    2583 flags.go:64] FLAG: --seccomp-default="false"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055961    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 09 05:49:39.062906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055964    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055968    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055971    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055974    2583 flags.go:64] FLAG: --storage-driver-password="root"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055977    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055981    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055984    2583 flags.go:64] FLAG: --storage-driver-user="root"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055987    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055990    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055993    2583 flags.go:64] FLAG: --system-cgroups=""
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.055996    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.056001    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.056004    2583 flags.go:64] FLAG: --tls-cert-file=""
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.056007    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.056011    2583 flags.go:64] FLAG: --tls-min-version=""
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.056013    2583 flags.go:64] FLAG: --tls-private-key-file=""
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.056016    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.056019    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.056022    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.056024    2583 flags.go:64] FLAG: --v="2"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.056028    2583 flags.go:64] FLAG: --version="false"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.056033    2583 flags.go:64] FLAG: --vmodule=""
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.056036    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.056039    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056182    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 05:49:39.063537 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056187    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056190    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056193    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056196    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056198    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056201    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056203    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056206    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056209    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056212    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056214    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056222    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056226    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056229    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056231    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056234    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056237    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056245    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056249    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 05:49:39.064178 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056252    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056255    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056258    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056260    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056263    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056265    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056268    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056270    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056273    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056276    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056278    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056280    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056284    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056287    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056290    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056293    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056296    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056298    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056301    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 05:49:39.065000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056304    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056307    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056311    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056314    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056317    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056321    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056326    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056331    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056334    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056336    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056339    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056343    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056352    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056355    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056358    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056361    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056363    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056366    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056368    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056371    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 05:49:39.065777 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056373    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056376    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056378    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056380    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056383    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056385    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056388    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056390    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056392    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056395    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056397    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056400    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056402    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056404    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056408    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056411    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056413    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056416    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056418    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056421    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 05:49:39.066458 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056424    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056426    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056429    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056431    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056434    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056442    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056445    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056447    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056449    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056452    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056454    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056456    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056459    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056461    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056464    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056466    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056469    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056471    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056473    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 05:49:39.067029 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.056476    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 05:49:39.067872 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.057178    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 05:49:39.067872 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.066145    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 09 05:49:39.067872 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.066164    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 09 05:49:39.067872 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.066941    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 09 05:49:39.067872 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.066955    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 09 05:49:39.067872 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067046    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 05:49:39.067872 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067056    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 05:49:39.067872 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067063    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 05:49:39.067872 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067070    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 05:49:39.067872 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067076    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 05:49:39.067872 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067081    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 05:49:39.067872 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067086    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 05:49:39.067872 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067090    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 05:49:39.067872 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067094    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067098    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067102    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067107    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067111    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067115    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067119    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067123    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067127    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067131    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067137    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067143    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067148    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067152    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067157    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067161    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067166    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067170    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067174    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 05:49:39.068483 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067179    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067183    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067188    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067192    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067196    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067200    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067204    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067209    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067213    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067217    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067220    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067224    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067228    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067233    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067237    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067241    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067245    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067249    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067253    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067257    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 05:49:39.069071 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067261    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067265    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067269    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067273    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067277    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067281    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067285    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067289    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067296    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067300    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067304    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067308    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067312    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067316    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067321    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067325    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067330    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067334    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067338    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067342    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 05:49:39.069721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067346    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067350    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067353    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067357    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067362    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067366    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067370    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067374    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067378    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067382    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067386    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067390    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067394    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067399    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067402    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067407    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067411    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067415    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067419    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067423    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 05:49:39.070221 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067427    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067430    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067434    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067438    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067442    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067446    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067450    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067454    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067459    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067463    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067467    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067471    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.067479    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067675    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067684    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 09 05:49:39.071061 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067689    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067694    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067698    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067702    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067706    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067711    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067715    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067719    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067723    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067727    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067732    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067739    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067745    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067750    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067754    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067758    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067763    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067767    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067771    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 09 05:49:39.071637 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067775    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067779    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067783    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067787    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067791    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067796    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067800    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067804    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067808    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067812    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067816    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067820    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067824    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067828    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067831    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067835    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067839    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067843    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067848    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067852    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 09 05:49:39.072237 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067858    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067865    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067868    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067873    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067877    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067881    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067886    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067890    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067894    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067898    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067904    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067909    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067913    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067918    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067923    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067927    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067932    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067937    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067941    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067945    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 09 05:49:39.072749 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067949    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067953    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067957    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067961    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067965    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067969    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067973    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067977    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067982    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067986    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067990    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067994    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.067998    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068002    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068006    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068010    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068014    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068019    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068023    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 09 05:49:39.073277 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068027    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068031    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068035    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068039    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068042    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068047    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068051    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068055    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068059    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068063    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068069    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068073    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068077    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068081    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068085    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068089    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068093    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068097    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 09 05:49:39.073768 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:39.068101    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 09 05:49:39.074274 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.068109    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 09 05:49:39.074274 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.068268    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 09 05:49:39.074274 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.071892    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 09 05:49:39.074274 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.073221    2583 server.go:1019] "Starting client certificate rotation"
Sep 09 05:49:39.074274 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.073323    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 05:49:39.074274 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.073360    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 09 05:49:39.075667 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.075650    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 05:49:39.076833 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.076811    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 09 05:49:39.089871 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.089851    2583 log.go:25] "Validated CRI v1 runtime API"
Sep 09 05:49:39.093460 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.093445    2583 log.go:25] "Validated CRI v1 image API"
Sep 09 05:49:39.094465 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.094446    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 09 05:49:39.099009 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.098983    2583 fs.go:135] Filesystem UUIDs: map[4e70a32e-54f8-4757-aee6-c4e937e0bfc1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e0661927-72f3-445e-abcb-3b4c2e992bc7:/dev/nvme0n1p3]
Sep 09 05:49:39.099084 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.099009    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 09 05:49:39.103336 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.103319    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 05:49:39.105537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.105417    2583 manager.go:216] Machine: {Timestamp:2026-09-09 05:49:39.104083426 +0000 UTC m=+0.334579969 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099805 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21f3f714d19c8f0d77a9aed966d2f9 SystemUUID:ec21f3f7-14d1-9c8f-0d77-a9aed966d2f9 BootID:7c87941b-a312-4ec8-9ff3-dd2e713491d9 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b1:74:d0:68:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b1:74:d0:68:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:a9:f8:b1:0d:cb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 09 05:49:39.105537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.105532    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 09 05:49:39.105660 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.105625    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 09 05:49:39.108418 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.108390    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 09 05:49:39.108599 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.108421    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-92.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 09 05:49:39.109638 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.109626    2583 topology_manager.go:138] "Creating topology manager with none policy"
Sep 09 05:49:39.109693 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.109644    2583 container_manager_linux.go:309] "Creating device plugin manager"
Sep 09 05:49:39.109693 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.109661    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 05:49:39.110357 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.110346    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 09 05:49:39.111503 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.111491    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 09 05:49:39.115334 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.115320    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 05:49:39.115459 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.115449    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 09 05:49:39.115514 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.115488    2583 kubelet.go:486] "Attempting to sync node with API server"
Sep 09 05:49:39.115514 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.115501    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 09 05:49:39.115632 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.115520    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 09 05:49:39.115632 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.115534    2583 kubelet.go:398] "Adding apiserver pod source"
Sep 09 05:49:39.115632 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.115574    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 09 05:49:39.118951 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.117651    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 05:49:39.118951 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.117731    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 09 05:49:39.120265 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.120247    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 09 05:49:39.122371 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.122352    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8xhrn"
Sep 09 05:49:39.122425 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.122396    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 09 05:49:39.122425 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.122423    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 09 05:49:39.122623 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.122609    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 09 05:49:39.122661 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.122628    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 09 05:49:39.122661 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.122634    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 09 05:49:39.122661 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.122640    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 09 05:49:39.122661 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.122648    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 09 05:49:39.122661 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.122653    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 09 05:49:39.123084 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.123076    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 09 05:49:39.123084 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.123084    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 09 05:49:39.123141 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.123091    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 09 05:49:39.123141 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.123096    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 09 05:49:39.123141 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.123104    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 09 05:49:39.123141 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.123111    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 09 05:49:39.123825 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.123816    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 09 05:49:39.123825 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.123825    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 09 05:49:39.126928 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.126908    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-92.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 09 05:49:39.127008 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.126987    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 09 05:49:39.127047 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.127003    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 09 05:49:39.127604 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.127593    2583 server.go:1268] "Started kubelet"
Sep 09 05:49:39.127721 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.127670    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 09 05:49:39.127768 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.127744    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 09 05:49:39.127807 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.127683    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 09 05:49:39.128337 ip-10-0-138-92 systemd[1]: Started Kubernetes Kubelet.
Sep 09 05:49:39.128861 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.128765    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 09 05:49:39.129679 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.129665    2583 server.go:310] "Adding debug handlers to kubelet server"
Sep 09 05:49:39.129930 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.129916    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8xhrn"
Sep 09 05:49:39.132812 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.132794    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 09 05:49:39.133326 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.133303    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 09 05:49:39.133611 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.133593    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 09 05:49:39.133717 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.133682    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found"
Sep 09 05:49:39.134116 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.134098    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 09 05:49:39.134116 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.134103    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 09 05:49:39.134116 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.134121    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 09 05:49:39.134289 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.134224    2583 reconstruct.go:97] "Volume reconstruction finished"
Sep 09 05:49:39.134289 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.134231    2583 reconciler.go:29] "Reconciler: start to sync state"
Sep 09 05:49:39.134531 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.134518    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 09 05:49:39.134531 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.134532    2583 factory.go:55] Registering systemd factory
Sep 09 05:49:39.134628 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.134538    2583 factory.go:223] Registration of the systemd container factory successfully
Sep 09 05:49:39.134777 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.134764    2583 factory.go:153] Registering CRI-O factory
Sep 09 05:49:39.134828 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.134781    2583 factory.go:223] Registration of the crio container factory successfully
Sep 09 05:49:39.134828 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.134798    2583 factory.go:103] Registering Raw factory
Sep 09 05:49:39.134828 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.134811    2583 manager.go:1196] Started watching for new ooms in manager
Sep 09 05:49:39.135231 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.135213    2583 manager.go:349] Starting recovery of all containers
Sep 09 05:49:39.135313 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.134197    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-92.ec2.internal.18d39110fbe0f003  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-92.ec2.internal,UID:ip-10-0-138-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-92.ec2.internal,},FirstTimestamp:2026-09-09 05:49:39.127545859 +0000 UTC m=+0.358042402,LastTimestamp:2026-09-09 05:49:39.127545859 +0000 UTC m=+0.358042402,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-92.ec2.internal,}"
Sep 09 05:49:39.139717 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.139694    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 05:49:39.142786 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.142762    2583 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-92.ec2.internal\" not found" node="ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.146323 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.146297    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 09 05:49:39.147332 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.147316    2583 manager.go:354] Recovery completed
Sep 09 05:49:39.151922 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.151909    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 05:49:39.153795 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.153780    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 05:49:39.153860 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.153809    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 05:49:39.153860 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.153819    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientPID"
Sep 09 05:49:39.154342 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.154319    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 09 05:49:39.154342 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.154330    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 09 05:49:39.154443 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.154346    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 09 05:49:39.154443 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.154379    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 05:49:39.156289 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.156276    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 05:49:39.156344 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.156297    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 05:49:39.156344 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.156306    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientPID"
Sep 09 05:49:39.156419 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.156408    2583 policy_none.go:49] "None policy: Start"
Sep 09 05:49:39.156454 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.156425    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 09 05:49:39.156454 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.156439    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 09 05:49:39.158403 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.158392    2583 policy_none.go:47] "Start"
Sep 09 05:49:39.192798 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.192589    2583 manager.go:337] "Starting Device Plugin manager"
Sep 09 05:49:39.220233 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.192859    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 09 05:49:39.220233 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.192877    2583 server.go:87] "Starting device plugin registration server"
Sep 09 05:49:39.220233 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.193161    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 09 05:49:39.220233 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.193175    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 09 05:49:39.220233 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.193288    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 09 05:49:39.220233 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.193368    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 09 05:49:39.220233 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.193376    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 09 05:49:39.220233 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.193901    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 09 05:49:39.220233 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.193945    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-92.ec2.internal\" not found"
Sep 09 05:49:39.237678 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.237650    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 09 05:49:39.237774 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.237721    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 09 05:49:39.237774 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.237747    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 09 05:49:39.237868 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.237792    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 09 05:49:39.240024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.240004    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 05:49:39.293884 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.293858    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 05:49:39.294808 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.294782    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 05:49:39.294904 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.294823    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 05:49:39.294904 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.294834    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientPID"
Sep 09 05:49:39.294904 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.294858    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.303617 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.303572    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.303617 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.303593    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-92.ec2.internal\": node \"ip-10-0-138-92.ec2.internal\" not found"
Sep 09 05:49:39.319363 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.319342    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found"
Sep 09 05:49:39.338292 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.338264    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal"]
Sep 09 05:49:39.338346 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.338334    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 05:49:39.340001 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.339987    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 05:49:39.340072 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.340014    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 05:49:39.340072 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.340023    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientPID"
Sep 09 05:49:39.342182 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.342167    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 05:49:39.342290 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.342278    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.342328 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.342309    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 05:49:39.342863 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.342841    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 05:49:39.342987 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.342870    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 05:49:39.342987 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.342875    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 05:49:39.342987 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.342886    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientPID"
Sep 09 05:49:39.342987 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.342892    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 05:49:39.342987 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.342904    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientPID"
Sep 09 05:49:39.345197 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.345182    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.345242 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.345209    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 09 05:49:39.346432 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.346417    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientMemory"
Sep 09 05:49:39.346523 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.346449    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasNoDiskPressure"
Sep 09 05:49:39.346523 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.346463    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientPID"
Sep 09 05:49:39.374305 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.374282    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-92.ec2.internal\" not found" node="ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.378628 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.378612    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-92.ec2.internal\" not found" node="ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.420120 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.420096    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found"
Sep 09 05:49:39.437040 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.437017    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/78c2031cec8330fa6e5af941ca09b22c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal\" (UID: \"78c2031cec8330fa6e5af941ca09b22c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.437114 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.437044    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78c2031cec8330fa6e5af941ca09b22c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal\" (UID: \"78c2031cec8330fa6e5af941ca09b22c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.437114 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.437059    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9e63e8088430f44e6db524784e88a1e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-92.ec2.internal\" (UID: \"b9e63e8088430f44e6db524784e88a1e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.520699 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.520660    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found"
Sep 09 05:49:39.538001 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.537972    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78c2031cec8330fa6e5af941ca09b22c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal\" (UID: \"78c2031cec8330fa6e5af941ca09b22c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.538077 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.538009    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9e63e8088430f44e6db524784e88a1e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-92.ec2.internal\" (UID: \"b9e63e8088430f44e6db524784e88a1e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.538077 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.538024    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/78c2031cec8330fa6e5af941ca09b22c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal\" (UID: \"78c2031cec8330fa6e5af941ca09b22c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.538077 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.538038    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/78c2031cec8330fa6e5af941ca09b22c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal\" (UID: \"78c2031cec8330fa6e5af941ca09b22c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.538077 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.538057    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9e63e8088430f44e6db524784e88a1e-config\") pod \"kube-apiserver-proxy-ip-10-0-138-92.ec2.internal\" (UID: \"b9e63e8088430f44e6db524784e88a1e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.538077 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.538049    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/78c2031cec8330fa6e5af941ca09b22c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal\" (UID: \"78c2031cec8330fa6e5af941ca09b22c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.621504 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.621421    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found"
Sep 09 05:49:39.676853 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.676824    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.681787 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:39.681614    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:39.722207 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.722175    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found"
Sep 09 05:49:39.822715 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.822683    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found"
Sep 09 05:49:39.923257 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:39.923179    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found"
Sep 09 05:49:40.023727 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.023691    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found"
Sep 09 05:49:40.053769 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.053743    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 05:49:40.072467 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.072445    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 09 05:49:40.072467 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.072455    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 05:49:40.072642 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.072596    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 05:49:40.072642 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.072596    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 05:49:40.072642 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.072600    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 09 05:49:40.117137 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.117109    2583 apiserver.go:52] "Watching apiserver"
Sep 09 05:49:40.127475 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.127453    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 09 05:49:40.127810 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.127790    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-c4d7g","openshift-multus/multus-additional-cni-plugins-bhzcv","openshift-multus/network-metrics-daemon-xk8g9","openshift-ovn-kubernetes/ovnkube-node-t6h79","kube-system/global-pull-secret-syncer-vrjtc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp","openshift-cluster-node-tuning-operator/tuned-5v5gl","openshift-dns/node-resolver-rw6xb","openshift-image-registry/node-ca-8ffll","openshift-multus/multus-c6khh","openshift-network-diagnostics/network-check-target-mx47c","openshift-network-operator/iptables-alerter-jp4fx"]
Sep 09 05:49:40.130362 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.130344    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c4d7g"
Sep 09 05:49:40.132618 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.132432    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.132618 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.132441    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 09 05:49:40.132776 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.132680    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 09 05:49:40.132776 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.132688    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8nhk5\""
Sep 09 05:49:40.132874 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.132855    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 09 05:49:40.133882 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.133855    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:40.134365 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.134330    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 09 05:49:40.134626 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.134604    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:40.134728 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.134699    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:49:40.134962 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.134825    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 09 05:49:40.134962 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.134849    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 09 05:49:40.134962 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.134904    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 09 05:49:40.134962 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.134916    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 09 05:49:40.135173 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.135000    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 05:44:39 +0000 UTC" deadline="2028-04-15 07:38:31.767436653 +0000 UTC"
Sep 09 05:49:40.135173 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.135032    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14017h48m51.632407025s"
Sep 09 05:49:40.135173 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.135138    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-h2966\""
Sep 09 05:49:40.137506 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.137486    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.139415 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.139396    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:40.139485 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.139464    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:49:40.140048 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.139904    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 09 05:49:40.140048 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.139924    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 09 05:49:40.140048 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.139938    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 09 05:49:40.140048 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.139924    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sdkmc\""
Sep 09 05:49:40.140048 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.139961    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 09 05:49:40.140397 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.140384    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 09 05:49:40.140443 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.140396    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 09 05:49:40.141291 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.141275    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs\") pod \"network-metrics-daemon-xk8g9\" (UID: \"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f\") " pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:40.141356 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.141306    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a1ae559-6c27-4b42-8340-426579c69ea3-agent-certs\") pod \"konnectivity-agent-c4d7g\" (UID: \"9a1ae559-6c27-4b42-8340-426579c69ea3\") " pod="kube-system/konnectivity-agent-c4d7g"
Sep 09 05:49:40.141356 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.141330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-system-cni-dir\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.141427 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.141391    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-cnibin\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.141476 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.141422    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.141476 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.141450    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49zrc\" (UniqueName: \"kubernetes.io/projected/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-kube-api-access-49zrc\") pod \"network-metrics-daemon-xk8g9\" (UID: \"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f\") " pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:40.141597 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.141476    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a1ae559-6c27-4b42-8340-426579c69ea3-konnectivity-ca\") pod \"konnectivity-agent-c4d7g\" (UID: \"9a1ae559-6c27-4b42-8340-426579c69ea3\") " pod="kube-system/konnectivity-agent-c4d7g"
Sep 09 05:49:40.141597 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.141503    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.141597 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.141526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.141737 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.141550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.141737 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.141646    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.141737 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.141656    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgsmb\" (UniqueName: \"kubernetes.io/projected/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-kube-api-access-fgsmb\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.143683 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.143667    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 09 05:49:40.143888 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.143864    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 09 05:49:40.143996 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.143904    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 09 05:49:40.143996 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.143956    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wbfsk\""
Sep 09 05:49:40.144132 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.143994    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.144718 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.144703    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 05:49:40.144792 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.144783    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal"
Sep 09 05:49:40.146088 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.146069    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 09 05:49:40.146236 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.146198    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 09 05:49:40.146236 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.146210    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hckmc\""
Sep 09 05:49:40.146388 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.146334    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rw6xb"
Sep 09 05:49:40.146658 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.146637    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 09 05:49:40.148461 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.148444    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 09 05:49:40.148592 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.148466    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 09 05:49:40.148709 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.148694    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nm762\""
Sep 09 05:49:40.148797 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.148784    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8ffll"
Sep 09 05:49:40.150738 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.150715    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 09 05:49:40.151465 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.151105    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 09 05:49:40.151465 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.151439    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9j88h\""
Sep 09 05:49:40.151607 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.151513    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 09 05:49:40.151916 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.151885    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.154399 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.154378    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:40.154485 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.154461    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:49:40.154539 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.154524    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 09 05:49:40.154696 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.154676    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2kj79\""
Sep 09 05:49:40.154780 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.154763    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 09 05:49:40.157256 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.157239    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal"]
Sep 09 05:49:40.157345 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.157269    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal"]
Sep 09 05:49:40.157408 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.157349    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jp4fx"
Sep 09 05:49:40.159504 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.159485    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 09 05:49:40.159634 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.159617    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 09 05:49:40.159695 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.159625    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 09 05:49:40.159767 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.159753    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8l7lw\""
Sep 09 05:49:40.169415 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.169391    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2s8d5"
Sep 09 05:49:40.174980 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.174934    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2s8d5"
Sep 09 05:49:40.235248 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.235225    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 09 05:49:40.242084 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.242192 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242100    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-kubelet\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.242192 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242124    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/573250df-73f1-405f-95a7-c9eb69888998-tmp\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.242192 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242149    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/520a7d10-525f-4833-82e4-af34cfb43113-kubelet-config\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:40.242192 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242176    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-cnibin\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.242343 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242203    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-var-lib-openvswitch\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.242343 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242226    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.242343 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242247    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-cni-bin\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.242343 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242266    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-sysconfig\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.242343 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242279    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-run\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.242343 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242299    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.242343 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-run-multus-certs\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.242648 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242350    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49zrc\" (UniqueName: \"kubernetes.io/projected/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-kube-api-access-49zrc\") pod \"network-metrics-daemon-xk8g9\" (UID: \"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f\") " pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:40.242648 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242373    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-run-netns\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.242648 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242397    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4465feb9-358b-48f9-a63a-e34c3abe33bf-ovn-node-metrics-cert\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.242648 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242419    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-sysctl-conf\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.242648 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242462    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-run-k8s-cni-cncf-io\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.242648 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242487    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-run-ovn\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.242648 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242527    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.242648 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-modprobe-d\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.242648 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242595    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkm64\" (UniqueName: \"kubernetes.io/projected/573250df-73f1-405f-95a7-c9eb69888998-kube-api-access-kkm64\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.242648 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242618    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242656    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-multus-cni-dir\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242718    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242739    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-multus-socket-dir-parent\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242764    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-cni-netd\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242803    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-system-cni-dir\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242829    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-run-openvswitch\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242858    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-system-cni-dir\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242858    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2p8f\" (UniqueName: \"kubernetes.io/projected/65baeca2-3753-4a1a-8fbe-59ad7bb331ef-kube-api-access-g2p8f\") pod \"node-resolver-rw6xb\" (UID: \"65baeca2-3753-4a1a-8fbe-59ad7bb331ef\") " pod="openshift-dns/node-resolver-rw6xb"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242910    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-multus-conf-dir\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9838eb73-668a-4167-8daa-1c5c4db99b05-serviceca\") pod \"node-ca-8ffll\" (UID: \"9838eb73-668a-4167-8daa-1c5c4db99b05\") " pod="openshift-image-registry/node-ca-8ffll"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242944    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-run-netns\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242861    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242963    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-var-lib-kubelet\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.242984    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-hostroot\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.243024 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243000    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2lft\" (UniqueName: \"kubernetes.io/projected/0d73c116-33c9-4d2b-8488-78fb13a23ecf-kube-api-access-v2lft\") pod \"iptables-alerter-jp4fx\" (UID: \"0d73c116-33c9-4d2b-8488-78fb13a23ecf\") " pod="openshift-network-operator/iptables-alerter-jp4fx"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243044    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-log-socket\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243063    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-kubernetes\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-slash\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243092    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4465feb9-358b-48f9-a63a-e34c3abe33bf-ovnkube-script-lib\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243112    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6srm\" (UniqueName: \"kubernetes.io/projected/ba67c02d-705a-4b65-822c-f08d1ff5716e-kube-api-access-w6srm\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243131    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-sysctl-d\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243145    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqfq2\" (UniqueName: \"kubernetes.io/projected/9838eb73-668a-4167-8daa-1c5c4db99b05-kube-api-access-zqfq2\") pod \"node-ca-8ffll\" (UID: \"9838eb73-668a-4167-8daa-1c5c4db99b05\") " pod="openshift-image-registry/node-ca-8ffll"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243159    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/947af4fe-d70e-4ead-ab39-5e74d11099b9-multus-daemon-config\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243175    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-etc-kubernetes\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243196    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m6c7\" (UniqueName: \"kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7\") pod \"network-check-target-mx47c\" (UID: \"04c271b8-a067-4a6e-9508-829869c6319d\") " pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243221    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-cnibin\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243244    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243268    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-systemd-units\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243303    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-var-lib-kubelet\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243323    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9838eb73-668a-4167-8daa-1c5c4db99b05-host\") pod \"node-ca-8ffll\" (UID: \"9838eb73-668a-4167-8daa-1c5c4db99b05\") " pod="openshift-image-registry/node-ca-8ffll"
Sep 09 05:49:40.243691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243303    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-cnibin\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243345    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-system-cni-dir\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243375    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-var-lib-cni-multus\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243394    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q8bc\" (UniqueName: \"kubernetes.io/projected/947af4fe-d70e-4ead-ab39-5e74d11099b9-kube-api-access-5q8bc\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243397    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243417    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4465feb9-358b-48f9-a63a-e34c3abe33bf-env-overrides\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243444    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65baeca2-3753-4a1a-8fbe-59ad7bb331ef-hosts-file\") pod \"node-resolver-rw6xb\" (UID: \"65baeca2-3753-4a1a-8fbe-59ad7bb331ef\") " pod="openshift-dns/node-resolver-rw6xb"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243459    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/947af4fe-d70e-4ead-ab39-5e74d11099b9-cni-binary-copy\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243472    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-var-lib-cni-bin\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243485    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/520a7d10-525f-4833-82e4-af34cfb43113-dbus\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243499    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d73c116-33c9-4d2b-8488-78fb13a23ecf-iptables-alerter-script\") pod \"iptables-alerter-jp4fx\" (UID: \"0d73c116-33c9-4d2b-8488-78fb13a23ecf\") " pod="openshift-network-operator/iptables-alerter-jp4fx"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243519    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a1ae559-6c27-4b42-8340-426579c69ea3-konnectivity-ca\") pod \"konnectivity-agent-c4d7g\" (UID: \"9a1ae559-6c27-4b42-8340-426579c69ea3\") " pod="kube-system/konnectivity-agent-c4d7g"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243536    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgsmb\" (UniqueName: \"kubernetes.io/projected/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-kube-api-access-fgsmb\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243550    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-run-systemd\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-node-log\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243604    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ztln\" (UniqueName: \"kubernetes.io/projected/4465feb9-358b-48f9-a63a-e34c3abe33bf-kube-api-access-9ztln\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.244456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243632    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243668    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-device-dir\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-sys-fs\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243725    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a1ae559-6c27-4b42-8340-426579c69ea3-agent-certs\") pod \"konnectivity-agent-c4d7g\" (UID: \"9a1ae559-6c27-4b42-8340-426579c69ea3\") " pod="kube-system/konnectivity-agent-c4d7g"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243834    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-socket-dir\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243872    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-host\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243913    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-systemd\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243953    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.243993    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9a1ae559-6c27-4b42-8340-426579c69ea3-konnectivity-ca\") pod \"konnectivity-agent-c4d7g\" (UID: \"9a1ae559-6c27-4b42-8340-426579c69ea3\") " pod="kube-system/konnectivity-agent-c4d7g"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.244056    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs\") pod \"network-metrics-daemon-xk8g9\" (UID: \"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f\") " pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.244064    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.244087    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-etc-openvswitch\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.244104    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-registration-dir\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.244122    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-sys\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.244133    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.244144    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-lib-modules\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.244172    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65baeca2-3753-4a1a-8fbe-59ad7bb331ef-tmp-dir\") pod \"node-resolver-rw6xb\" (UID: \"65baeca2-3753-4a1a-8fbe-59ad7bb331ef\") " pod="openshift-dns/node-resolver-rw6xb"
Sep 09 05:49:40.245211 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.244193    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4465feb9-358b-48f9-a63a-e34c3abe33bf-ovnkube-config\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.245977 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.244229    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs podName:3d5ac5a4-7dcf-404a-a23a-a6700b982b7f nodeName:}" failed. No retries permitted until 2026-09-09 05:49:40.744193055 +0000 UTC m=+1.974689616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs") pod "network-metrics-daemon-xk8g9" (UID: "3d5ac5a4-7dcf-404a-a23a-a6700b982b7f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 05:49:40.245977 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.244291    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-etc-selinux\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.245977 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.244319    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/573250df-73f1-405f-95a7-c9eb69888998-etc-tuned\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.245977 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.244339    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-cni-binary-copy\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.245977 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.244349    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d73c116-33c9-4d2b-8488-78fb13a23ecf-host-slash\") pod \"iptables-alerter-jp4fx\" (UID: \"0d73c116-33c9-4d2b-8488-78fb13a23ecf\") " pod="openshift-network-operator/iptables-alerter-jp4fx"
Sep 09 05:49:40.247946 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.247929    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9a1ae559-6c27-4b42-8340-426579c69ea3-agent-certs\") pod \"konnectivity-agent-c4d7g\" (UID: \"9a1ae559-6c27-4b42-8340-426579c69ea3\") " pod="kube-system/konnectivity-agent-c4d7g"
Sep 09 05:49:40.250684 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.250660    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgsmb\" (UniqueName: \"kubernetes.io/projected/e6726e06-34b8-4f2e-a7c6-8c44d438ec95-kube-api-access-fgsmb\") pod \"multus-additional-cni-plugins-bhzcv\" (UID: \"e6726e06-34b8-4f2e-a7c6-8c44d438ec95\") " pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.250771 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.250758    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49zrc\" (UniqueName: \"kubernetes.io/projected/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-kube-api-access-49zrc\") pod \"network-metrics-daemon-xk8g9\" (UID: \"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f\") " pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:40.282945 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:40.282912    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e63e8088430f44e6db524784e88a1e.slice/crio-da2658126ddf579715125b17da05167d79a5e1645cdf8c338e7a6da41771c503 WatchSource:0}: Error finding container da2658126ddf579715125b17da05167d79a5e1645cdf8c338e7a6da41771c503: Status 404 returned error can't find the container with id da2658126ddf579715125b17da05167d79a5e1645cdf8c338e7a6da41771c503
Sep 09 05:49:40.283701 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:40.283681    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c2031cec8330fa6e5af941ca09b22c.slice/crio-c8404715d2368b40ab80bf4903200612e005e8778c6d44caf4657c897830fd37 WatchSource:0}: Error finding container c8404715d2368b40ab80bf4903200612e005e8778c6d44caf4657c897830fd37: Status 404 returned error can't find the container with id c8404715d2368b40ab80bf4903200612e005e8778c6d44caf4657c897830fd37
Sep 09 05:49:40.292666 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.292648    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 05:49:40.345305 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345278    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-run-openvswitch\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.345485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345311    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2p8f\" (UniqueName: \"kubernetes.io/projected/65baeca2-3753-4a1a-8fbe-59ad7bb331ef-kube-api-access-g2p8f\") pod \"node-resolver-rw6xb\" (UID: \"65baeca2-3753-4a1a-8fbe-59ad7bb331ef\") " pod="openshift-dns/node-resolver-rw6xb"
Sep 09 05:49:40.345485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345326    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-multus-conf-dir\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.345485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345347    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9838eb73-668a-4167-8daa-1c5c4db99b05-serviceca\") pod \"node-ca-8ffll\" (UID: \"9838eb73-668a-4167-8daa-1c5c4db99b05\") " pod="openshift-image-registry/node-ca-8ffll"
Sep 09 05:49:40.345485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345362    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-run-netns\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.345485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345376    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-var-lib-kubelet\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.345485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345390    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-hostroot\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.345485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345390    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-run-openvswitch\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.345485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2lft\" (UniqueName: \"kubernetes.io/projected/0d73c116-33c9-4d2b-8488-78fb13a23ecf-kube-api-access-v2lft\") pod \"iptables-alerter-jp4fx\" (UID: \"0d73c116-33c9-4d2b-8488-78fb13a23ecf\") " pod="openshift-network-operator/iptables-alerter-jp4fx"
Sep 09 05:49:40.345485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345426    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-multus-conf-dir\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.345485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345454    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-hostroot\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.345485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345462    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-run-netns\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.345485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345475    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-log-socket\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.345485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345480    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-var-lib-kubelet\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345510    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-log-socket\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-kubernetes\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-slash\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345575    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-kubernetes\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345590    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4465feb9-358b-48f9-a63a-e34c3abe33bf-ovnkube-script-lib\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345616    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6srm\" (UniqueName: \"kubernetes.io/projected/ba67c02d-705a-4b65-822c-f08d1ff5716e-kube-api-access-w6srm\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345618    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-slash\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345640    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-sysctl-d\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345663    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqfq2\" (UniqueName: \"kubernetes.io/projected/9838eb73-668a-4167-8daa-1c5c4db99b05-kube-api-access-zqfq2\") pod \"node-ca-8ffll\" (UID: \"9838eb73-668a-4167-8daa-1c5c4db99b05\") " pod="openshift-image-registry/node-ca-8ffll"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345689    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/947af4fe-d70e-4ead-ab39-5e74d11099b9-multus-daemon-config\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345712    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-etc-kubernetes\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345737    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6c7\" (UniqueName: \"kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7\") pod \"network-check-target-mx47c\" (UID: \"04c271b8-a067-4a6e-9508-829869c6319d\") " pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345762    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-systemd-units\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345779    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-sysctl-d\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345785    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-var-lib-kubelet\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9838eb73-668a-4167-8daa-1c5c4db99b05-host\") pod \"node-ca-8ffll\" (UID: \"9838eb73-668a-4167-8daa-1c5c4db99b05\") " pod="openshift-image-registry/node-ca-8ffll"
Sep 09 05:49:40.346188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345831    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-var-lib-kubelet\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345836    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-system-cni-dir\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345874    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-systemd-units\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345887    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-system-cni-dir\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-var-lib-cni-multus\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345917    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9838eb73-668a-4167-8daa-1c5c4db99b05-host\") pod \"node-ca-8ffll\" (UID: \"9838eb73-668a-4167-8daa-1c5c4db99b05\") " pod="openshift-image-registry/node-ca-8ffll"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345907    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-etc-kubernetes\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q8bc\" (UniqueName: \"kubernetes.io/projected/947af4fe-d70e-4ead-ab39-5e74d11099b9-kube-api-access-5q8bc\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345948    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9838eb73-668a-4167-8daa-1c5c4db99b05-serviceca\") pod \"node-ca-8ffll\" (UID: \"9838eb73-668a-4167-8daa-1c5c4db99b05\") " pod="openshift-image-registry/node-ca-8ffll"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345951    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-var-lib-cni-multus\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.345959    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4465feb9-358b-48f9-a63a-e34c3abe33bf-env-overrides\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346019    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65baeca2-3753-4a1a-8fbe-59ad7bb331ef-hosts-file\") pod \"node-resolver-rw6xb\" (UID: \"65baeca2-3753-4a1a-8fbe-59ad7bb331ef\") " pod="openshift-dns/node-resolver-rw6xb"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/947af4fe-d70e-4ead-ab39-5e74d11099b9-cni-binary-copy\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346077    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-var-lib-cni-bin\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/520a7d10-525f-4833-82e4-af34cfb43113-dbus\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346078    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/65baeca2-3753-4a1a-8fbe-59ad7bb331ef-hosts-file\") pod \"node-resolver-rw6xb\" (UID: \"65baeca2-3753-4a1a-8fbe-59ad7bb331ef\") " pod="openshift-dns/node-resolver-rw6xb"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346153    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d73c116-33c9-4d2b-8488-78fb13a23ecf-iptables-alerter-script\") pod \"iptables-alerter-jp4fx\" (UID: \"0d73c116-33c9-4d2b-8488-78fb13a23ecf\") " pod="openshift-network-operator/iptables-alerter-jp4fx"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346112    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-var-lib-cni-bin\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.346901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346185    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-run-systemd\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346222    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-run-systemd\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346224    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-node-log\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346247    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-node-log\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346248    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ztln\" (UniqueName: \"kubernetes.io/projected/4465feb9-358b-48f9-a63a-e34c3abe33bf-kube-api-access-9ztln\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346258    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4465feb9-358b-48f9-a63a-e34c3abe33bf-ovnkube-script-lib\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346295    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/520a7d10-525f-4833-82e4-af34cfb43113-dbus\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346295    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346336    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346338    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-device-dir\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346371    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4465feb9-358b-48f9-a63a-e34c3abe33bf-env-overrides\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346376    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-device-dir\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346373    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-sys-fs\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346412    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-sys-fs\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346433    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-socket-dir\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346461    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-host\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-systemd\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.347757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346570    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-systemd\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346609    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-etc-openvswitch\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346635    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-etc-openvswitch\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346614    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-host\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346636    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-registration-dir\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-socket-dir\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346686    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-sys\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346694    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-registration-dir\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346703    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-lib-modules\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346714    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d73c116-33c9-4d2b-8488-78fb13a23ecf-iptables-alerter-script\") pod \"iptables-alerter-jp4fx\" (UID: \"0d73c116-33c9-4d2b-8488-78fb13a23ecf\") " pod="openshift-network-operator/iptables-alerter-jp4fx"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346729    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65baeca2-3753-4a1a-8fbe-59ad7bb331ef-tmp-dir\") pod \"node-resolver-rw6xb\" (UID: \"65baeca2-3753-4a1a-8fbe-59ad7bb331ef\") " pod="openshift-dns/node-resolver-rw6xb"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346755    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4465feb9-358b-48f9-a63a-e34c3abe33bf-ovnkube-config\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346771    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-lib-modules\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346777    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-etc-selinux\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/573250df-73f1-405f-95a7-c9eb69888998-etc-tuned\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346819    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/947af4fe-d70e-4ead-ab39-5e74d11099b9-cni-binary-copy\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346825    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d73c116-33c9-4d2b-8488-78fb13a23ecf-host-slash\") pod \"iptables-alerter-jp4fx\" (UID: \"0d73c116-33c9-4d2b-8488-78fb13a23ecf\") " pod="openshift-network-operator/iptables-alerter-jp4fx"
Sep 09 05:49:40.348350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346854    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d73c116-33c9-4d2b-8488-78fb13a23ecf-host-slash\") pod \"iptables-alerter-jp4fx\" (UID: \"0d73c116-33c9-4d2b-8488-78fb13a23ecf\") " pod="openshift-network-operator/iptables-alerter-jp4fx"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346837    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/947af4fe-d70e-4ead-ab39-5e74d11099b9-multus-daemon-config\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346870    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ba67c02d-705a-4b65-822c-f08d1ff5716e-etc-selinux\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346897    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-sys\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346904    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-kubelet\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346927    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/573250df-73f1-405f-95a7-c9eb69888998-tmp\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346951    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/520a7d10-525f-4833-82e4-af34cfb43113-kubelet-config\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346973    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-cnibin\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346982    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-kubelet\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346984    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65baeca2-3753-4a1a-8fbe-59ad7bb331ef-tmp-dir\") pod \"node-resolver-rw6xb\" (UID: \"65baeca2-3753-4a1a-8fbe-59ad7bb331ef\") " pod="openshift-dns/node-resolver-rw6xb"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.346996    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-var-lib-openvswitch\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347021    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347026    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-cnibin\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347044    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/520a7d10-525f-4833-82e4-af34cfb43113-kubelet-config\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347054    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-cni-bin\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347090    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-sysconfig\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347067    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-run-ovn-kubernetes\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347055    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-var-lib-openvswitch\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.348862 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-run\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347115    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-cni-bin\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347150    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-sysconfig\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-run-multus-certs\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347185    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-run-netns\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347185    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-run\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347222    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-run-multus-certs\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347238    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-run-netns\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347268    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4465feb9-358b-48f9-a63a-e34c3abe33bf-ovn-node-metrics-cert\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347307    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-sysctl-conf\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347332    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-run-k8s-cni-cncf-io\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347338    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4465feb9-358b-48f9-a63a-e34c3abe33bf-ovnkube-config\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347355    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-run-ovn\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347380    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347387    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-host-run-k8s-cni-cncf-io\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347410    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-run-ovn\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347421    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.349583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-modprobe-d\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347484    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-sysctl-conf\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347490    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/573250df-73f1-405f-95a7-c9eb69888998-etc-modprobe-d\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347486    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkm64\" (UniqueName: \"kubernetes.io/projected/573250df-73f1-405f-95a7-c9eb69888998-kube-api-access-kkm64\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347527    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347570    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-multus-cni-dir\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347594    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-multus-socket-dir-parent\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347617    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-cni-netd\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.347643    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347678    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4465feb9-358b-48f9-a63a-e34c3abe33bf-host-cni-netd\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347689    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-multus-cni-dir\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.347704    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret podName:520a7d10-525f-4833-82e4-af34cfb43113 nodeName:}" failed. No retries permitted until 2026-09-09 05:49:40.847677685 +0000 UTC m=+2.078174236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret") pod "global-pull-secret-syncer-vrjtc" (UID: "520a7d10-525f-4833-82e4-af34cfb43113") : object "kube-system"/"original-pull-secret" not registered
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.347721    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/947af4fe-d70e-4ead-ab39-5e74d11099b9-multus-socket-dir-parent\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.349359    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4465feb9-358b-48f9-a63a-e34c3abe33bf-ovn-node-metrics-cert\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.349575    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/573250df-73f1-405f-95a7-c9eb69888998-tmp\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.350400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.349613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/573250df-73f1-405f-95a7-c9eb69888998-etc-tuned\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.356400 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.356380    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 05:49:40.356400 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.356401    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 05:49:40.356507 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.356411    2583 projected.go:196] Error preparing data for projected volume kube-api-access-5m6c7 for pod openshift-network-diagnostics/network-check-target-mx47c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 05:49:40.356507 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.356456    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7 podName:04c271b8-a067-4a6e-9508-829869c6319d nodeName:}" failed. No retries permitted until 2026-09-09 05:49:40.856443878 +0000 UTC m=+2.086940421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5m6c7" (UniqueName: "kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7") pod "network-check-target-mx47c" (UID: "04c271b8-a067-4a6e-9508-829869c6319d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 05:49:40.358485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.358457    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2lft\" (UniqueName: \"kubernetes.io/projected/0d73c116-33c9-4d2b-8488-78fb13a23ecf-kube-api-access-v2lft\") pod \"iptables-alerter-jp4fx\" (UID: \"0d73c116-33c9-4d2b-8488-78fb13a23ecf\") " pod="openshift-network-operator/iptables-alerter-jp4fx"
Sep 09 05:49:40.359179 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.359141    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2p8f\" (UniqueName: \"kubernetes.io/projected/65baeca2-3753-4a1a-8fbe-59ad7bb331ef-kube-api-access-g2p8f\") pod \"node-resolver-rw6xb\" (UID: \"65baeca2-3753-4a1a-8fbe-59ad7bb331ef\") " pod="openshift-dns/node-resolver-rw6xb"
Sep 09 05:49:40.359327 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.359311    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkm64\" (UniqueName: \"kubernetes.io/projected/573250df-73f1-405f-95a7-c9eb69888998-kube-api-access-kkm64\") pod \"tuned-5v5gl\" (UID: \"573250df-73f1-405f-95a7-c9eb69888998\") " pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.359489 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.359471    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqfq2\" (UniqueName: \"kubernetes.io/projected/9838eb73-668a-4167-8daa-1c5c4db99b05-kube-api-access-zqfq2\") pod \"node-ca-8ffll\" (UID: \"9838eb73-668a-4167-8daa-1c5c4db99b05\") " pod="openshift-image-registry/node-ca-8ffll"
Sep 09 05:49:40.359572 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.359538    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ztln\" (UniqueName: \"kubernetes.io/projected/4465feb9-358b-48f9-a63a-e34c3abe33bf-kube-api-access-9ztln\") pod \"ovnkube-node-t6h79\" (UID: \"4465feb9-358b-48f9-a63a-e34c3abe33bf\") " pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.359809 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.359791    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6srm\" (UniqueName: \"kubernetes.io/projected/ba67c02d-705a-4b65-822c-f08d1ff5716e-kube-api-access-w6srm\") pod \"aws-ebs-csi-driver-node-6x7rp\" (UID: \"ba67c02d-705a-4b65-822c-f08d1ff5716e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.360223 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.360200    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q8bc\" (UniqueName: \"kubernetes.io/projected/947af4fe-d70e-4ead-ab39-5e74d11099b9-kube-api-access-5q8bc\") pod \"multus-c6khh\" (UID: \"947af4fe-d70e-4ead-ab39-5e74d11099b9\") " pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.448841 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.448765    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c4d7g"
Sep 09 05:49:40.459068 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:40.459044    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1ae559_6c27_4b42_8340_426579c69ea3.slice/crio-73c8784c961ab30007845fe93ea50f8cedd3affb58a4a6656a5788c2d52e5121 WatchSource:0}: Error finding container 73c8784c961ab30007845fe93ea50f8cedd3affb58a4a6656a5788c2d52e5121: Status 404 returned error can't find the container with id 73c8784c961ab30007845fe93ea50f8cedd3affb58a4a6656a5788c2d52e5121
Sep 09 05:49:40.471875 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.471853    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bhzcv"
Sep 09 05:49:40.479941 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:40.479921    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6726e06_34b8_4f2e_a7c6_8c44d438ec95.slice/crio-53a268c5664af325ef56f78e4d3260635d428e1c72a2f1953f143daec9390532 WatchSource:0}: Error finding container 53a268c5664af325ef56f78e4d3260635d428e1c72a2f1953f143daec9390532: Status 404 returned error can't find the container with id 53a268c5664af325ef56f78e4d3260635d428e1c72a2f1953f143daec9390532
Sep 09 05:49:40.488870 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.488852    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:49:40.496848 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:40.496827    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4465feb9_358b_48f9_a63a_e34c3abe33bf.slice/crio-0b7db1612b3c9934147ddd95bed55b1383c5538918ba4f9b89017fd0f81ba4e3 WatchSource:0}: Error finding container 0b7db1612b3c9934147ddd95bed55b1383c5538918ba4f9b89017fd0f81ba4e3: Status 404 returned error can't find the container with id 0b7db1612b3c9934147ddd95bed55b1383c5538918ba4f9b89017fd0f81ba4e3
Sep 09 05:49:40.504155 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.504134    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp"
Sep 09 05:49:40.511708 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:40.511682    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba67c02d_705a_4b65_822c_f08d1ff5716e.slice/crio-4ad7f963fe66154288d7317a47ee7653f1b5fe6001001f287515c304b1b5207b WatchSource:0}: Error finding container 4ad7f963fe66154288d7317a47ee7653f1b5fe6001001f287515c304b1b5207b: Status 404 returned error can't find the container with id 4ad7f963fe66154288d7317a47ee7653f1b5fe6001001f287515c304b1b5207b
Sep 09 05:49:40.522078 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.522061    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5v5gl"
Sep 09 05:49:40.530200 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:40.530172    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod573250df_73f1_405f_95a7_c9eb69888998.slice/crio-1b8dc6c0d1f18a35f434171fe941f569fd6b3126fcb249d49ee973ac73087b8a WatchSource:0}: Error finding container 1b8dc6c0d1f18a35f434171fe941f569fd6b3126fcb249d49ee973ac73087b8a: Status 404 returned error can't find the container with id 1b8dc6c0d1f18a35f434171fe941f569fd6b3126fcb249d49ee973ac73087b8a
Sep 09 05:49:40.543074 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.543052    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rw6xb"
Sep 09 05:49:40.550844 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:40.550823    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65baeca2_3753_4a1a_8fbe_59ad7bb331ef.slice/crio-bea8ce2d8059f220654fb832b503ebe9c439ae0d54dfab440e963198f9cfefa4 WatchSource:0}: Error finding container bea8ce2d8059f220654fb832b503ebe9c439ae0d54dfab440e963198f9cfefa4: Status 404 returned error can't find the container with id bea8ce2d8059f220654fb832b503ebe9c439ae0d54dfab440e963198f9cfefa4
Sep 09 05:49:40.561339 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.561320    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8ffll"
Sep 09 05:49:40.568263 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.568245    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c6khh"
Sep 09 05:49:40.569228 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:40.569210    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9838eb73_668a_4167_8daa_1c5c4db99b05.slice/crio-49b13a09b7c054bbf5acf601efb7b1c0585a2a5d29f4713a278effc83a60a64a WatchSource:0}: Error finding container 49b13a09b7c054bbf5acf601efb7b1c0585a2a5d29f4713a278effc83a60a64a: Status 404 returned error can't find the container with id 49b13a09b7c054bbf5acf601efb7b1c0585a2a5d29f4713a278effc83a60a64a
Sep 09 05:49:40.575900 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:40.575882    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947af4fe_d70e_4ead_ab39_5e74d11099b9.slice/crio-8b26a5dbf264a4fb4d0635767357d4da0b9a67e5786810662f659ed86af51052 WatchSource:0}: Error finding container 8b26a5dbf264a4fb4d0635767357d4da0b9a67e5786810662f659ed86af51052: Status 404 returned error can't find the container with id 8b26a5dbf264a4fb4d0635767357d4da0b9a67e5786810662f659ed86af51052
Sep 09 05:49:40.593368 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.593347    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jp4fx"
Sep 09 05:49:40.601950 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:49:40.601931    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d73c116_33c9_4d2b_8488_78fb13a23ecf.slice/crio-3f26b8d2dce7e679a5b5731d930971b79211aacaa090b3dc8ff6cea2997ac259 WatchSource:0}: Error finding container 3f26b8d2dce7e679a5b5731d930971b79211aacaa090b3dc8ff6cea2997ac259: Status 404 returned error can't find the container with id 3f26b8d2dce7e679a5b5731d930971b79211aacaa090b3dc8ff6cea2997ac259
Sep 09 05:49:40.751033 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.751005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs\") pod \"network-metrics-daemon-xk8g9\" (UID: \"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f\") " pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:40.751148 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.751117    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 05:49:40.751195 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.751179    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs podName:3d5ac5a4-7dcf-404a-a23a-a6700b982b7f nodeName:}" failed. No retries permitted until 2026-09-09 05:49:41.751164436 +0000 UTC m=+2.981660968 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs") pod "network-metrics-daemon-xk8g9" (UID: "3d5ac5a4-7dcf-404a-a23a-a6700b982b7f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 05:49:40.851775 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.851732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:40.851945 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.851914    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 05:49:40.852025 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.852007    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret podName:520a7d10-525f-4833-82e4-af34cfb43113 nodeName:}" failed. No retries permitted until 2026-09-09 05:49:41.851984566 +0000 UTC m=+3.082481104 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret") pod "global-pull-secret-syncer-vrjtc" (UID: "520a7d10-525f-4833-82e4-af34cfb43113") : object "kube-system"/"original-pull-secret" not registered
Sep 09 05:49:40.952803 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.952764    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6c7\" (UniqueName: \"kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7\") pod \"network-check-target-mx47c\" (UID: \"04c271b8-a067-4a6e-9508-829869c6319d\") " pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:40.952982 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.952961    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 05:49:40.953063 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.952991    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 05:49:40.953063 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.953004    2583 projected.go:196] Error preparing data for projected volume kube-api-access-5m6c7 for pod openshift-network-diagnostics/network-check-target-mx47c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 05:49:40.953171 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:40.953065    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7 podName:04c271b8-a067-4a6e-9508-829869c6319d nodeName:}" failed. No retries permitted until 2026-09-09 05:49:41.953044812 +0000 UTC m=+3.183541363 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m6c7" (UniqueName: "kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7") pod "network-check-target-mx47c" (UID: "04c271b8-a067-4a6e-9508-829869c6319d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 05:49:40.956051 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:40.956025    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 05:49:41.093958 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.093658    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 05:49:41.178610 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.178465    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 05:44:40 +0000 UTC" deadline="2028-02-29 03:26:04.177376061 +0000 UTC"
Sep 09 05:49:41.178610 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.178506    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12909h36m22.998875626s"
Sep 09 05:49:41.289894 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.289813    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79" event={"ID":"4465feb9-358b-48f9-a63a-e34c3abe33bf","Type":"ContainerStarted","Data":"0b7db1612b3c9934147ddd95bed55b1383c5538918ba4f9b89017fd0f81ba4e3"}
Sep 09 05:49:41.300029 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.299989    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" event={"ID":"78c2031cec8330fa6e5af941ca09b22c","Type":"ContainerStarted","Data":"c8404715d2368b40ab80bf4903200612e005e8778c6d44caf4657c897830fd37"}
Sep 09 05:49:41.309074 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.309039    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal" event={"ID":"b9e63e8088430f44e6db524784e88a1e","Type":"ContainerStarted","Data":"da2658126ddf579715125b17da05167d79a5e1645cdf8c338e7a6da41771c503"}
Sep 09 05:49:41.317580 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.317547    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c6khh" event={"ID":"947af4fe-d70e-4ead-ab39-5e74d11099b9","Type":"ContainerStarted","Data":"8b26a5dbf264a4fb4d0635767357d4da0b9a67e5786810662f659ed86af51052"}
Sep 09 05:49:41.358138 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.357571    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5v5gl" event={"ID":"573250df-73f1-405f-95a7-c9eb69888998","Type":"ContainerStarted","Data":"1b8dc6c0d1f18a35f434171fe941f569fd6b3126fcb249d49ee973ac73087b8a"}
Sep 09 05:49:41.380091 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.379978    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp" event={"ID":"ba67c02d-705a-4b65-822c-f08d1ff5716e","Type":"ContainerStarted","Data":"4ad7f963fe66154288d7317a47ee7653f1b5fe6001001f287515c304b1b5207b"}
Sep 09 05:49:41.401265 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.401226    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzcv" event={"ID":"e6726e06-34b8-4f2e-a7c6-8c44d438ec95","Type":"ContainerStarted","Data":"53a268c5664af325ef56f78e4d3260635d428e1c72a2f1953f143daec9390532"}
Sep 09 05:49:41.421958 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.421920    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c4d7g" event={"ID":"9a1ae559-6c27-4b42-8340-426579c69ea3","Type":"ContainerStarted","Data":"73c8784c961ab30007845fe93ea50f8cedd3affb58a4a6656a5788c2d52e5121"}
Sep 09 05:49:41.445312 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.445272    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jp4fx" event={"ID":"0d73c116-33c9-4d2b-8488-78fb13a23ecf","Type":"ContainerStarted","Data":"3f26b8d2dce7e679a5b5731d930971b79211aacaa090b3dc8ff6cea2997ac259"}
Sep 09 05:49:41.460671 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.460633    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8ffll" event={"ID":"9838eb73-668a-4167-8daa-1c5c4db99b05","Type":"ContainerStarted","Data":"49b13a09b7c054bbf5acf601efb7b1c0585a2a5d29f4713a278effc83a60a64a"}
Sep 09 05:49:41.476601 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.476565    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rw6xb" event={"ID":"65baeca2-3753-4a1a-8fbe-59ad7bb331ef","Type":"ContainerStarted","Data":"bea8ce2d8059f220654fb832b503ebe9c439ae0d54dfab440e963198f9cfefa4"}
Sep 09 05:49:41.758445 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.758343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs\") pod \"network-metrics-daemon-xk8g9\" (UID: \"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f\") " pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:41.758668 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:41.758505    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 05:49:41.758668 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:41.758573    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs podName:3d5ac5a4-7dcf-404a-a23a-a6700b982b7f nodeName:}" failed. No retries permitted until 2026-09-09 05:49:43.758551941 +0000 UTC m=+4.989048497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs") pod "network-metrics-daemon-xk8g9" (UID: "3d5ac5a4-7dcf-404a-a23a-a6700b982b7f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 05:49:41.859985 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.859293    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:41.859985 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:41.859469    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 05:49:41.859985 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:41.859545    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret podName:520a7d10-525f-4833-82e4-af34cfb43113 nodeName:}" failed. No retries permitted until 2026-09-09 05:49:43.859512773 +0000 UTC m=+5.090009330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret") pod "global-pull-secret-syncer-vrjtc" (UID: "520a7d10-525f-4833-82e4-af34cfb43113") : object "kube-system"/"original-pull-secret" not registered
Sep 09 05:49:41.960597 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.960552    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6c7\" (UniqueName: \"kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7\") pod \"network-check-target-mx47c\" (UID: \"04c271b8-a067-4a6e-9508-829869c6319d\") " pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:41.960802 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:41.960753    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 05:49:41.960802 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:41.960776    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 05:49:41.960802 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:41.960791    2583 projected.go:196] Error preparing data for projected volume kube-api-access-5m6c7 for pod openshift-network-diagnostics/network-check-target-mx47c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 05:49:41.960982 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:41.960853    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7 podName:04c271b8-a067-4a6e-9508-829869c6319d nodeName:}" failed. No retries permitted until 2026-09-09 05:49:43.960831938 +0000 UTC m=+5.191328473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m6c7" (UniqueName: "kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7") pod "network-check-target-mx47c" (UID: "04c271b8-a067-4a6e-9508-829869c6319d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 05:49:41.972775 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:41.972710    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 09 05:49:42.179423 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:42.179299    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 05:44:40 +0000 UTC" deadline="2028-05-24 11:04:38.67201687 +0000 UTC"
Sep 09 05:49:42.179423 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:42.179370    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14957h14m56.492651184s"
Sep 09 05:49:42.238868 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:42.238831    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:42.239040 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:42.238989    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:49:42.239442 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:42.239418    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:42.239551 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:42.239529    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:49:42.239625 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:42.239595    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:42.239625 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:42.239686    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:49:43.779696 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:43.779653    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs\") pod \"network-metrics-daemon-xk8g9\" (UID: \"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f\") " pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:43.780362 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:43.779878    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 05:49:43.780362 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:43.779949    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs podName:3d5ac5a4-7dcf-404a-a23a-a6700b982b7f nodeName:}" failed. No retries permitted until 2026-09-09 05:49:47.779928333 +0000 UTC m=+9.010424874 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs") pod "network-metrics-daemon-xk8g9" (UID: "3d5ac5a4-7dcf-404a-a23a-a6700b982b7f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 05:49:43.881034 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:43.880995    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:43.881242 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:43.881183    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 05:49:43.881326 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:43.881273    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret podName:520a7d10-525f-4833-82e4-af34cfb43113 nodeName:}" failed. No retries permitted until 2026-09-09 05:49:47.881243562 +0000 UTC m=+9.111740109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret") pod "global-pull-secret-syncer-vrjtc" (UID: "520a7d10-525f-4833-82e4-af34cfb43113") : object "kube-system"/"original-pull-secret" not registered
Sep 09 05:49:43.982058 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:43.982018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6c7\" (UniqueName: \"kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7\") pod \"network-check-target-mx47c\" (UID: \"04c271b8-a067-4a6e-9508-829869c6319d\") " pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:43.982260 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:43.982242    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 05:49:43.982326 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:43.982264    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 05:49:43.982326 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:43.982279    2583 projected.go:196] Error preparing data for projected volume kube-api-access-5m6c7 for pod openshift-network-diagnostics/network-check-target-mx47c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 05:49:43.982429 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:43.982343    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7 podName:04c271b8-a067-4a6e-9508-829869c6319d nodeName:}" failed. No retries permitted until 2026-09-09 05:49:47.982323571 +0000 UTC m=+9.212820105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m6c7" (UniqueName: "kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7") pod "network-check-target-mx47c" (UID: "04c271b8-a067-4a6e-9508-829869c6319d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 05:49:44.238017 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:44.237929    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:44.238188 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:44.238083    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:49:44.238540 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:44.238497    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:44.238540 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:44.238502    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:44.238710 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:44.238581    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:49:44.238758 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:44.238705    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:49:46.239844 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:46.238944    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:46.239844 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:46.239085    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:49:46.239844 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:46.239479    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:46.239844 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:46.239589    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:49:46.239844 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:46.239675    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:46.239844 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:46.239792    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:49:47.819096 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:47.819062    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs\") pod \"network-metrics-daemon-xk8g9\" (UID: \"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f\") " pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:47.819456 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:47.819212    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 05:49:47.819456 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:47.819274    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs podName:3d5ac5a4-7dcf-404a-a23a-a6700b982b7f nodeName:}" failed. No retries permitted until 2026-09-09 05:49:55.819255999 +0000 UTC m=+17.049752543 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs") pod "network-metrics-daemon-xk8g9" (UID: "3d5ac5a4-7dcf-404a-a23a-a6700b982b7f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 05:49:47.920154 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:47.919641    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:47.920154 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:47.919819    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 05:49:47.920154 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:47.919865    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret podName:520a7d10-525f-4833-82e4-af34cfb43113 nodeName:}" failed. No retries permitted until 2026-09-09 05:49:55.919852489 +0000 UTC m=+17.150349020 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret") pod "global-pull-secret-syncer-vrjtc" (UID: "520a7d10-525f-4833-82e4-af34cfb43113") : object "kube-system"/"original-pull-secret" not registered
Sep 09 05:49:48.021292 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:48.020664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6c7\" (UniqueName: \"kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7\") pod \"network-check-target-mx47c\" (UID: \"04c271b8-a067-4a6e-9508-829869c6319d\") " pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:48.021292 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:48.020877    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 05:49:48.021292 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:48.020899    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 05:49:48.021292 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:48.020911    2583 projected.go:196] Error preparing data for projected volume kube-api-access-5m6c7 for pod openshift-network-diagnostics/network-check-target-mx47c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 05:49:48.021292 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:48.020974    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7 podName:04c271b8-a067-4a6e-9508-829869c6319d nodeName:}" failed. No retries permitted until 2026-09-09 05:49:56.020953471 +0000 UTC m=+17.251450018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m6c7" (UniqueName: "kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7") pod "network-check-target-mx47c" (UID: "04c271b8-a067-4a6e-9508-829869c6319d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 05:49:48.239038 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:48.238956    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:48.239038 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:48.239002    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:48.239254 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:48.239080    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:48.239254 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:48.239086    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:49:48.239254 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:48.239189    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:49:48.239404 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:48.239279    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:49:50.238281 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:50.238238    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:50.238281 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:50.238261    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:50.238796 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:50.238238    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:50.238796 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:50.238372    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:49:50.238796 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:50.238477    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:49:50.238796 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:50.238645    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:49:52.238210 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:52.238181    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:52.238210 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:52.238196    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:52.238742 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:52.238287    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:49:52.238742 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:52.238360    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:49:52.238742 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:52.238401    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:52.238742 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:52.238486    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:49:54.238180 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:54.238147    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:54.238180 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:54.238172    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:54.238657 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:54.238255    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:54.238657 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:54.238280    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:49:54.238657 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:54.238374    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:49:54.238657 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:54.238460    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:49:55.880369 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:55.880330    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs\") pod \"network-metrics-daemon-xk8g9\" (UID: \"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f\") " pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:55.880867 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:55.880489    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 05:49:55.880867 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:55.880578    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs podName:3d5ac5a4-7dcf-404a-a23a-a6700b982b7f nodeName:}" failed. No retries permitted until 2026-09-09 05:50:11.88054294 +0000 UTC m=+33.111039493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs") pod "network-metrics-daemon-xk8g9" (UID: "3d5ac5a4-7dcf-404a-a23a-a6700b982b7f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 05:49:55.981725 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:55.981690    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:55.981879 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:55.981812    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 05:49:55.981879 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:55.981862    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret podName:520a7d10-525f-4833-82e4-af34cfb43113 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:11.981848343 +0000 UTC m=+33.212344873 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret") pod "global-pull-secret-syncer-vrjtc" (UID: "520a7d10-525f-4833-82e4-af34cfb43113") : object "kube-system"/"original-pull-secret" not registered
Sep 09 05:49:56.082591 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:56.082534    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6c7\" (UniqueName: \"kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7\") pod \"network-check-target-mx47c\" (UID: \"04c271b8-a067-4a6e-9508-829869c6319d\") " pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:56.082752 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:56.082706    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 05:49:56.082752 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:56.082728    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 05:49:56.082752 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:56.082738    2583 projected.go:196] Error preparing data for projected volume kube-api-access-5m6c7 for pod openshift-network-diagnostics/network-check-target-mx47c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 05:49:56.082859 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:56.082791    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7 podName:04c271b8-a067-4a6e-9508-829869c6319d nodeName:}" failed. No retries permitted until 2026-09-09 05:50:12.082775664 +0000 UTC m=+33.313272194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m6c7" (UniqueName: "kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7") pod "network-check-target-mx47c" (UID: "04c271b8-a067-4a6e-9508-829869c6319d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 05:49:56.238436 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:56.238366    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:56.238600 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:56.238367    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:56.238600 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:56.238468    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:49:56.238600 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:56.238367    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:56.238600 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:56.238542    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:49:56.238794 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:56.238627    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:49:58.238875 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:58.238835    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:49:58.239332 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:58.238839    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:49:58.239332 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:58.238961    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:49:58.239332 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:49:58.238974    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:49:58.239332 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:58.239053    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:49:58.239332 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:49:58.239145    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:50:00.238251 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:00.238045    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:50:00.238575 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:00.238051    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:50:00.238575 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:00.238306    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:50:00.238575 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:00.238089    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:50:00.238575 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:00.238372    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:50:00.238575 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:00.238432    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:50:00.533056 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:00.532863    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79" event={"ID":"4465feb9-358b-48f9-a63a-e34c3abe33bf","Type":"ContainerStarted","Data":"d25baf9a51520d2c3fc53dc942cecabf33e9974d3ef1f59c28b15f48b7f2ad52"}
Sep 09 05:50:00.545676 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:00.545478    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal" event={"ID":"b9e63e8088430f44e6db524784e88a1e","Type":"ContainerStarted","Data":"44f2fcd4721fe8c39c5c19dd7fceca77add809f4ae40f2c0be7cf499a72cd83a"}
Sep 09 05:50:00.547791 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:00.547759    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c6khh" event={"ID":"947af4fe-d70e-4ead-ab39-5e74d11099b9","Type":"ContainerStarted","Data":"b52e3ed7c67aedff64822564cc120e5b2cc980033b8ecfce39d4a2c98f833c7a"}
Sep 09 05:50:00.550510 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:00.550474    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5v5gl" event={"ID":"573250df-73f1-405f-95a7-c9eb69888998","Type":"ContainerStarted","Data":"a47af5e8bf7296436417b373d12960a0c048161ca7f22ccc15320d72d6a03e44"}
Sep 09 05:50:00.559393 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:00.559340    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal" podStartSLOduration=20.559323524 podStartE2EDuration="20.559323524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 05:49:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:00.559075634 +0000 UTC m=+21.789572187" watchObservedRunningTime="2026-09-09 05:50:00.559323524 +0000 UTC m=+21.789820077"
Sep 09 05:50:00.598132 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:00.598072    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5v5gl" podStartSLOduration=2.055958098 podStartE2EDuration="21.598056772s" totalImagesPullingTime="19.542098674s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 05:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:00.579831726 +0000 UTC m=+21.810328278" watchObservedRunningTime="2026-09-09 05:50:00.598056772 +0000 UTC m=+21.828553325"
Sep 09 05:50:00.598258 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:00.598237    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-c6khh" podStartSLOduration=1.857932454 podStartE2EDuration="21.598230718s" totalImagesPullingTime="19.740298264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 05:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:00.597763755 +0000 UTC m=+21.828260399" watchObservedRunningTime="2026-09-09 05:50:00.598230718 +0000 UTC m=+21.828727270"
Sep 09 05:50:01.554354 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.554318    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8ffll" event={"ID":"9838eb73-668a-4167-8daa-1c5c4db99b05","Type":"ContainerStarted","Data":"e9656ae73bf80f109eb3adb0d5766253da19541cbcd7568becdb240826602194"}
Sep 09 05:50:01.556240 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.556210    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rw6xb" event={"ID":"65baeca2-3753-4a1a-8fbe-59ad7bb331ef","Type":"ContainerStarted","Data":"6fdd4a711811c237c37565d1d923b8aa45cfc6ca14308264559b828fc059921b"}
Sep 09 05:50:01.559473 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.559445    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79" event={"ID":"4465feb9-358b-48f9-a63a-e34c3abe33bf","Type":"ContainerStarted","Data":"eef0ec745022afce07f2e64c0f9e39b3a443388d27ae7d758d5896165f2c7d04"}
Sep 09 05:50:01.559573 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.559503    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79" event={"ID":"4465feb9-358b-48f9-a63a-e34c3abe33bf","Type":"ContainerStarted","Data":"79d7650ca282a00e4a58d555ec38a4136d5cab19b5f3dc5edff7e78bc4e6e1c2"}
Sep 09 05:50:01.559573 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.559537    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79" event={"ID":"4465feb9-358b-48f9-a63a-e34c3abe33bf","Type":"ContainerStarted","Data":"4a5e26ac02dc09493e0754c5ffa2e48c75c78b8a9befcb10209550f84bae715f"}
Sep 09 05:50:01.559652 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.559601    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79" event={"ID":"4465feb9-358b-48f9-a63a-e34c3abe33bf","Type":"ContainerStarted","Data":"763af107ad10bc2686ee10deecf265d54058acbefbb441496f993ecae25efc2a"}
Sep 09 05:50:01.559652 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.559632    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79" event={"ID":"4465feb9-358b-48f9-a63a-e34c3abe33bf","Type":"ContainerStarted","Data":"fba1e2b5e3892250f5e0047a9a784b50e2463e34fb870cde060246ef2e85e8bf"}
Sep 09 05:50:01.560821 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.560794    2583 generic.go:356] "Generic (PLEG): container finished" podID="78c2031cec8330fa6e5af941ca09b22c" containerID="f1984fd5e2fa7113b3c2afe78677d126562e6186f511035737cc4a59edb08052" exitCode=0
Sep 09 05:50:01.560911 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.560841    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" event={"ID":"78c2031cec8330fa6e5af941ca09b22c","Type":"ContainerDied","Data":"f1984fd5e2fa7113b3c2afe78677d126562e6186f511035737cc4a59edb08052"}
Sep 09 05:50:01.562337 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.562318    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp" event={"ID":"ba67c02d-705a-4b65-822c-f08d1ff5716e","Type":"ContainerStarted","Data":"c9ba4cb68fe57d547e04f5173ed35b0358da0717c772a5feb38076f5614e27d8"}
Sep 09 05:50:01.563743 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.563721    2583 generic.go:356] "Generic (PLEG): container finished" podID="e6726e06-34b8-4f2e-a7c6-8c44d438ec95" containerID="92d1ef3cc0db4c4b03744288ff783348dfb02d168579e35c5bc9a5d15083ccbc" exitCode=0
Sep 09 05:50:01.563819 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.563784    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzcv" event={"ID":"e6726e06-34b8-4f2e-a7c6-8c44d438ec95","Type":"ContainerDied","Data":"92d1ef3cc0db4c4b03744288ff783348dfb02d168579e35c5bc9a5d15083ccbc"}
Sep 09 05:50:01.565278 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.565259    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c4d7g" event={"ID":"9a1ae559-6c27-4b42-8340-426579c69ea3","Type":"ContainerStarted","Data":"bbbba7041f0a5498c0e0e9e848d63e5685d4fb081e3472cacbff7e0457907b8d"}
Sep 09 05:50:01.568285 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.568246    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8ffll" podStartSLOduration=3.124836437 podStartE2EDuration="22.568230705s" totalImagesPullingTime="19.443394268s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 05:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:01.568046371 +0000 UTC m=+22.798542924" watchObservedRunningTime="2026-09-09 05:50:01.568230705 +0000 UTC m=+22.798727258"
Sep 09 05:50:01.620724 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.620666    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rw6xb" podStartSLOduration=3.102131917 podStartE2EDuration="22.62064589s" totalImagesPullingTime="19.518513973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 05:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:01.62054427 +0000 UTC m=+22.851040824" watchObservedRunningTime="2026-09-09 05:50:01.62064589 +0000 UTC m=+22.851142444"
Sep 09 05:50:01.634121 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:01.634077    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c4d7g" podStartSLOduration=3.080522869 podStartE2EDuration="22.634062626s" totalImagesPullingTime="19.553539757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:01.63393468 +0000 UTC m=+22.864431232" watchObservedRunningTime="2026-09-09 05:50:01.634062626 +0000 UTC m=+22.864559177"
Sep 09 05:50:02.127194 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:02.127004    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 09 05:50:02.206999 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:02.206805    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T05:50:02.127191428Z","UUID":"2e8e6645-3d7e-4e32-9157-ebc2f5417c29","Handler":null,"Name":"","Endpoint":""}
Sep 09 05:50:02.208415 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:02.208384    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 09 05:50:02.208415 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:02.208418    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 09 05:50:02.238421 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:02.238392    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:50:02.238615 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:02.238432    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:50:02.238615 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:02.238512    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:50:02.238615 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:02.238393    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:50:02.238784 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:02.238660    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:50:02.238784 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:02.238734    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:50:02.570275 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:02.570233    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jp4fx" event={"ID":"0d73c116-33c9-4d2b-8488-78fb13a23ecf","Type":"ContainerStarted","Data":"b8c77bebe16ae14020281040d05cf9321310c1b0d37bb4181c6d0fadf20d2c5f"}
Sep 09 05:50:02.572448 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:02.572419    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" event={"ID":"78c2031cec8330fa6e5af941ca09b22c","Type":"ContainerStarted","Data":"adad41ae6853245d88f969f5fb8816f4650413ca7288ddcf0872de6f3e36dccc"}
Sep 09 05:50:02.574688 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:02.574648    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp" event={"ID":"ba67c02d-705a-4b65-822c-f08d1ff5716e","Type":"ContainerStarted","Data":"788ffe03279fe2ca76cc6e3a7b6a8a515af7b5dbc886287070b0502affb390a3"}
Sep 09 05:50:02.585355 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:02.585309    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jp4fx" podStartSLOduration=4.111976097 podStartE2EDuration="23.585289187s" totalImagesPullingTime="19.47331309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 05:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:02.585165791 +0000 UTC m=+23.815662345" watchObservedRunningTime="2026-09-09 05:50:02.585289187 +0000 UTC m=+23.815785740"
Sep 09 05:50:02.598941 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:02.598897    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" podStartSLOduration=22.598877965 podStartE2EDuration="22.598877965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 05:49:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:02.598421502 +0000 UTC m=+23.828918057" watchObservedRunningTime="2026-09-09 05:50:02.598877965 +0000 UTC m=+23.829374519"
Sep 09 05:50:02.608541 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:02.608513    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c4d7g"
Sep 09 05:50:03.581694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:03.581545    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79" event={"ID":"4465feb9-358b-48f9-a63a-e34c3abe33bf","Type":"ContainerStarted","Data":"930cc0755e66a7b3bdc3b3270bc0a0bb9eeeaaf05007a3e499b397f4e677d7f8"}
Sep 09 05:50:04.238660 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:04.238575    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:50:04.238660 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:04.238615    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:50:04.238660 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:04.238615    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:50:04.238933 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:04.238700    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:50:04.238933 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:04.238786    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:50:04.238933 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:04.238862    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:50:04.586477 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:04.586363    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp" event={"ID":"ba67c02d-705a-4b65-822c-f08d1ff5716e","Type":"ContainerStarted","Data":"048444c909ec3fb648f90abf83998473a25bfb012f554220cb79e78784bba06d"}
Sep 09 05:50:04.604870 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:04.604814    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6x7rp" podStartSLOduration=3.283804001 podStartE2EDuration="25.604798859s" totalImagesPullingTime="22.320994858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 05:49:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:04.604217826 +0000 UTC m=+25.834714380" watchObservedRunningTime="2026-09-09 05:50:04.604798859 +0000 UTC m=+25.835295409"
Sep 09 05:50:04.667635 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:04.667591    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c4d7g"
Sep 09 05:50:04.668385 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:04.668357    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c4d7g"
Sep 09 05:50:05.589659 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:05.589594    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c4d7g"
Sep 09 05:50:06.238610 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:06.238579    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:50:06.238610 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:06.238594    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:50:06.238610 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:06.238609    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:50:06.238810 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:06.238694    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:50:06.238810 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:06.238728    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:50:06.238810 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:06.238798    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:50:06.593277 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:06.593252    2583 generic.go:356] "Generic (PLEG): container finished" podID="e6726e06-34b8-4f2e-a7c6-8c44d438ec95" containerID="344531756de9e1e727493fc5ae907237ba78e4938ee97d082165f3b464b69892" exitCode=0
Sep 09 05:50:06.593830 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:06.593333    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzcv" event={"ID":"e6726e06-34b8-4f2e-a7c6-8c44d438ec95","Type":"ContainerDied","Data":"344531756de9e1e727493fc5ae907237ba78e4938ee97d082165f3b464b69892"}
Sep 09 05:50:06.597292 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:06.597271    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79" event={"ID":"4465feb9-358b-48f9-a63a-e34c3abe33bf","Type":"ContainerStarted","Data":"7b3ff84f55e29e165c4190f62889cce7ddbc5f8cd496dc39416fc0b468606d59"}
Sep 09 05:50:06.597578 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:06.597538    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:50:06.597692 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:06.597629    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:50:06.604390 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:06.604283    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:50:06.612976 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:06.612958    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:50:06.613070 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:06.613044    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:50:06.644876 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:06.644815    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79" podStartSLOduration=7.746111801 podStartE2EDuration="27.64480219s" totalImagesPullingTime="19.898690389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 05:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:06.644353487 +0000 UTC m=+27.874850038" watchObservedRunningTime="2026-09-09 05:50:06.64480219 +0000 UTC m=+27.875298742"
Sep 09 05:50:07.697592 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:07.697348    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vrjtc"]
Sep 09 05:50:07.698192 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:07.697701    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:50:07.698192 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:07.697817    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:50:07.698568 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:07.698526    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mx47c"]
Sep 09 05:50:07.698670 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:07.698655    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:50:07.698768 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:07.698750    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:50:07.698906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:07.698888    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xk8g9"]
Sep 09 05:50:07.699003 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:07.698989    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:50:07.699121 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:07.699104    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:50:08.457016 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:08.456981    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:08.547792 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:08.547754    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:08.603640 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:08.603603    2583 generic.go:356] "Generic (PLEG): container finished" podID="e6726e06-34b8-4f2e-a7c6-8c44d438ec95" containerID="0f1e5b5a10e5e66464e526b69ba3b027f3a6b40b1754522e13f3e9dc972b5376" exitCode=0
Sep 09 05:50:08.603788 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:08.603685    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzcv" event={"ID":"e6726e06-34b8-4f2e-a7c6-8c44d438ec95","Type":"ContainerDied","Data":"0f1e5b5a10e5e66464e526b69ba3b027f3a6b40b1754522e13f3e9dc972b5376"}
Sep 09 05:50:08.636224 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:08.636194    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:09.238931 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:09.238899    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:50:09.239298 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:09.238984    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:50:09.239298 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:09.239004    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:50:09.239298 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:09.239075    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:50:09.239298 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:09.239178    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:50:09.239298 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:09.239261    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:50:09.621107 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:09.621038    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:09.721050 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:09.721024    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:10.610541 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:10.610508    2583 generic.go:356] "Generic (PLEG): container finished" podID="e6726e06-34b8-4f2e-a7c6-8c44d438ec95" containerID="1dc7afee6698ae0d4ffc0fa2172d5ab5dbfc37c1ef0a457b4860e639ff9cd0c6" exitCode=0
Sep 09 05:50:10.610975 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:10.610545    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzcv" event={"ID":"e6726e06-34b8-4f2e-a7c6-8c44d438ec95","Type":"ContainerDied","Data":"1dc7afee6698ae0d4ffc0fa2172d5ab5dbfc37c1ef0a457b4860e639ff9cd0c6"}
Sep 09 05:50:11.238092 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:11.238055    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:50:11.238286 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:11.238112    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:50:11.238286 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:11.238210    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:50:11.238286 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:11.238227    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xk8g9" podUID="3d5ac5a4-7dcf-404a-a23a-a6700b982b7f"
Sep 09 05:50:11.238445 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:11.238311    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mx47c" podUID="04c271b8-a067-4a6e-9508-829869c6319d"
Sep 09 05:50:11.238445 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:11.238423    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrjtc" podUID="520a7d10-525f-4833-82e4-af34cfb43113"
Sep 09 05:50:11.756418 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:11.756374    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:11.809498 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:11.809462    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:11.891832 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:11.891796    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs\") pod \"network-metrics-daemon-xk8g9\" (UID: \"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f\") " pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:50:11.892021 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:11.891918    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 05:50:11.892021 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:11.891978    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs podName:3d5ac5a4-7dcf-404a-a23a-a6700b982b7f nodeName:}" failed. No retries permitted until 2026-09-09 05:50:43.891961644 +0000 UTC m=+65.122458174 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs") pod "network-metrics-daemon-xk8g9" (UID: "3d5ac5a4-7dcf-404a-a23a-a6700b982b7f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 09 05:50:11.992473 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:11.992392    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:50:11.992655 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:11.992538    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 09 05:50:11.992655 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:11.992622    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret podName:520a7d10-525f-4833-82e4-af34cfb43113 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:43.992604748 +0000 UTC m=+65.223101281 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret") pod "global-pull-secret-syncer-vrjtc" (UID: "520a7d10-525f-4833-82e4-af34cfb43113") : object "kube-system"/"original-pull-secret" not registered
Sep 09 05:50:12.093489 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:12.093451    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6c7\" (UniqueName: \"kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7\") pod \"network-check-target-mx47c\" (UID: \"04c271b8-a067-4a6e-9508-829869c6319d\") " pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:50:12.093698 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:12.093664    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 09 05:50:12.093698 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:12.093693    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 09 05:50:12.093811 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:12.093706    2583 projected.go:196] Error preparing data for projected volume kube-api-access-5m6c7 for pod openshift-network-diagnostics/network-check-target-mx47c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 05:50:12.093811 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:12.093774    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7 podName:04c271b8-a067-4a6e-9508-829869c6319d nodeName:}" failed. No retries permitted until 2026-09-09 05:50:44.093754724 +0000 UTC m=+65.324251260 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5m6c7" (UniqueName: "kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7") pod "network-check-target-mx47c" (UID: "04c271b8-a067-4a6e-9508-829869c6319d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 09 05:50:12.494748 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:12.494710    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:12.595125 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:12.595087    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:13.025975 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.025943    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeReady"
Sep 09 05:50:13.026380 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.026063    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 09 05:50:13.066045 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.065971    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bhz8k"]
Sep 09 05:50:13.068168 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.067848    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:13.068715 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.068696    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qphbh"]
Sep 09 05:50:13.070136 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.070113    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qphbh"
Sep 09 05:50:13.070302 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.070281    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 09 05:50:13.070517 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.070490    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 09 05:50:13.070640 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.070606    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sfr25\""
Sep 09 05:50:13.072418 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.072398    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 09 05:50:13.072810 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.072699    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lskth\""
Sep 09 05:50:13.072810 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.072707    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 09 05:50:13.072810 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.072735    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 09 05:50:13.081595 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.081573    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bhz8k"]
Sep 09 05:50:13.081688 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.081627    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qphbh"]
Sep 09 05:50:13.200896 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.200842    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcb0044b-a0cc-4cfe-bff9-b03a025cddc7-cert\") pod \"ingress-canary-qphbh\" (UID: \"bcb0044b-a0cc-4cfe-bff9-b03a025cddc7\") " pod="openshift-ingress-canary/ingress-canary-qphbh"
Sep 09 05:50:13.200896 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.200901    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92f78221-304b-4f78-8bd4-e5cce75dc050-tmp-dir\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:13.201119 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.200973    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbn9d\" (UniqueName: \"kubernetes.io/projected/bcb0044b-a0cc-4cfe-bff9-b03a025cddc7-kube-api-access-qbn9d\") pod \"ingress-canary-qphbh\" (UID: \"bcb0044b-a0cc-4cfe-bff9-b03a025cddc7\") " pod="openshift-ingress-canary/ingress-canary-qphbh"
Sep 09 05:50:13.201119 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.201008    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:13.201119 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.201038    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmqrn\" (UniqueName: \"kubernetes.io/projected/92f78221-304b-4f78-8bd4-e5cce75dc050-kube-api-access-mmqrn\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:13.201119 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.201099    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92f78221-304b-4f78-8bd4-e5cce75dc050-config-volume\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:13.210383 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.210351    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:13.238692 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.238661    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:50:13.238843 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.238672    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:50:13.239062 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.238672    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:50:13.242172 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.242149    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 05:50:13.242172 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.242161    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 05:50:13.242330 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.242303    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 05:50:13.242398 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.242341    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 05:50:13.242398 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.242385    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wnkgt\""
Sep 09 05:50:13.242489 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.242385    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hh975\""
Sep 09 05:50:13.269373 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.269343    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:13.302477 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.302443    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:13.302663 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.302506    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmqrn\" (UniqueName: \"kubernetes.io/projected/92f78221-304b-4f78-8bd4-e5cce75dc050-kube-api-access-mmqrn\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:13.302663 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.302543    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92f78221-304b-4f78-8bd4-e5cce75dc050-config-volume\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:13.302663 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.302602    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcb0044b-a0cc-4cfe-bff9-b03a025cddc7-cert\") pod \"ingress-canary-qphbh\" (UID: \"bcb0044b-a0cc-4cfe-bff9-b03a025cddc7\") " pod="openshift-ingress-canary/ingress-canary-qphbh"
Sep 09 05:50:13.302663 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.302624    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92f78221-304b-4f78-8bd4-e5cce75dc050-tmp-dir\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:13.302663 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:13.302638    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 05:50:13.302901 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.302672    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbn9d\" (UniqueName: \"kubernetes.io/projected/bcb0044b-a0cc-4cfe-bff9-b03a025cddc7-kube-api-access-qbn9d\") pod \"ingress-canary-qphbh\" (UID: \"bcb0044b-a0cc-4cfe-bff9-b03a025cddc7\") " pod="openshift-ingress-canary/ingress-canary-qphbh"
Sep 09 05:50:13.302901 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:13.302708    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls podName:92f78221-304b-4f78-8bd4-e5cce75dc050 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:13.802685674 +0000 UTC m=+35.033182209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls") pod "dns-default-bhz8k" (UID: "92f78221-304b-4f78-8bd4-e5cce75dc050") : secret "dns-default-metrics-tls" not found
Sep 09 05:50:13.303080 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.303061    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92f78221-304b-4f78-8bd4-e5cce75dc050-tmp-dir\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:13.303190 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.303172    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/92f78221-304b-4f78-8bd4-e5cce75dc050-config-volume\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:13.307449 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.307422    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bcb0044b-a0cc-4cfe-bff9-b03a025cddc7-cert\") pod \"ingress-canary-qphbh\" (UID: \"bcb0044b-a0cc-4cfe-bff9-b03a025cddc7\") " pod="openshift-ingress-canary/ingress-canary-qphbh"
Sep 09 05:50:13.311796 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.311771    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmqrn\" (UniqueName: \"kubernetes.io/projected/92f78221-304b-4f78-8bd4-e5cce75dc050-kube-api-access-mmqrn\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:13.312021 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.312003    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbn9d\" (UniqueName: \"kubernetes.io/projected/bcb0044b-a0cc-4cfe-bff9-b03a025cddc7-kube-api-access-qbn9d\") pod \"ingress-canary-qphbh\" (UID: \"bcb0044b-a0cc-4cfe-bff9-b03a025cddc7\") " pod="openshift-ingress-canary/ingress-canary-qphbh"
Sep 09 05:50:13.390106 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.390065    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qphbh"
Sep 09 05:50:13.806432 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:13.806393    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:13.806620 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:13.806594    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 05:50:13.806693 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:13.806675    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls podName:92f78221-304b-4f78-8bd4-e5cce75dc050 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:14.806653624 +0000 UTC m=+36.037150178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls") pod "dns-default-bhz8k" (UID: "92f78221-304b-4f78-8bd4-e5cce75dc050") : secret "dns-default-metrics-tls" not found
Sep 09 05:50:14.815507 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:14.815314    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:14.815889 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:14.815452    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 05:50:14.815889 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:14.815587    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls podName:92f78221-304b-4f78-8bd4-e5cce75dc050 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:16.815572174 +0000 UTC m=+38.046068717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls") pod "dns-default-bhz8k" (UID: "92f78221-304b-4f78-8bd4-e5cce75dc050") : secret "dns-default-metrics-tls" not found
Sep 09 05:50:14.922543 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:14.922518    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qphbh"]
Sep 09 05:50:14.927512 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:50:14.927480    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcb0044b_a0cc_4cfe_bff9_b03a025cddc7.slice/crio-6d04585e3b331529707d0b556c25b4f0438ba706157667ebf1593a033029f668 WatchSource:0}: Error finding container 6d04585e3b331529707d0b556c25b4f0438ba706157667ebf1593a033029f668: Status 404 returned error can't find the container with id 6d04585e3b331529707d0b556c25b4f0438ba706157667ebf1593a033029f668
Sep 09 05:50:15.625764 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:15.625688    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qphbh" event={"ID":"bcb0044b-a0cc-4cfe-bff9-b03a025cddc7","Type":"ContainerStarted","Data":"6d04585e3b331529707d0b556c25b4f0438ba706157667ebf1593a033029f668"}
Sep 09 05:50:15.631400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:15.631371    2583 generic.go:356] "Generic (PLEG): container finished" podID="e6726e06-34b8-4f2e-a7c6-8c44d438ec95" containerID="cdf9b15a9ec273b24f0b17ec370aa4a3cd5d9cb9e29a47f0ee7e7b075feb36d8" exitCode=0
Sep 09 05:50:15.631548 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:15.631415    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzcv" event={"ID":"e6726e06-34b8-4f2e-a7c6-8c44d438ec95","Type":"ContainerDied","Data":"cdf9b15a9ec273b24f0b17ec370aa4a3cd5d9cb9e29a47f0ee7e7b075feb36d8"}
Sep 09 05:50:16.638486 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:16.638432    2583 generic.go:356] "Generic (PLEG): container finished" podID="e6726e06-34b8-4f2e-a7c6-8c44d438ec95" containerID="c92bfdc467ed7d16a9a8c7053d5fdaf5b26ae48644c631572ddf40bb8272df11" exitCode=0
Sep 09 05:50:16.639287 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:16.638525    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzcv" event={"ID":"e6726e06-34b8-4f2e-a7c6-8c44d438ec95","Type":"ContainerDied","Data":"c92bfdc467ed7d16a9a8c7053d5fdaf5b26ae48644c631572ddf40bb8272df11"}
Sep 09 05:50:16.640043 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:16.640021    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:16.740747 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:16.740709    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:16.830829 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:16.830792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:16.830991 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:16.830954    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 05:50:16.831033 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:16.831023    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls podName:92f78221-304b-4f78-8bd4-e5cce75dc050 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:20.831005181 +0000 UTC m=+42.061501711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls") pod "dns-default-bhz8k" (UID: "92f78221-304b-4f78-8bd4-e5cce75dc050") : secret "dns-default-metrics-tls" not found
Sep 09 05:50:17.420807 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.420755    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-w64nm"]
Sep 09 05:50:17.428787 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.428763    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:17.436371 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.436348    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w64nm"]
Sep 09 05:50:17.436483 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.436454    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:17.438568 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.438524    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 09 05:50:17.438686 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.438643    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 09 05:50:17.438748 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.438714    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xqjvr\""
Sep 09 05:50:17.438937 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.438922    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 09 05:50:17.439017 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.438958    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 09 05:50:17.490607 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.490578    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:17.536722 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.536651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:17.536722 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.536710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdd27137-ac0c-40b6-b325-9964f25e4408-data-volume\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:17.536899 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.536784    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cdd27137-ac0c-40b6-b325-9964f25e4408-crio-socket\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:17.536899 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.536852    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:17.536899 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.536888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqlgj\" (UniqueName: \"kubernetes.io/projected/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-api-access-lqlgj\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:17.638112 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.637911    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:17.638240 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.638157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdd27137-ac0c-40b6-b325-9964f25e4408-data-volume\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:17.638240 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:17.638027    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 05:50:17.638240 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.638195    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cdd27137-ac0c-40b6-b325-9964f25e4408-crio-socket\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:17.638391 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:17.638247    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm podName:cdd27137-ac0c-40b6-b325-9964f25e4408 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:18.138228786 +0000 UTC m=+39.368725336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w64nm" (UID: "cdd27137-ac0c-40b6-b325-9964f25e4408") : configmap "kube-rbac-proxy" not found
Sep 09 05:50:17.638391 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.638263    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:17.638391 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.638294    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqlgj\" (UniqueName: \"kubernetes.io/projected/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-api-access-lqlgj\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:17.638531 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:17.638400    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 05:50:17.638531 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.638413    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cdd27137-ac0c-40b6-b325-9964f25e4408-crio-socket\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:17.638531 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:17.638474    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls podName:cdd27137-ac0c-40b6-b325-9964f25e4408 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:18.138452419 +0000 UTC m=+39.368948953 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w64nm" (UID: "cdd27137-ac0c-40b6-b325-9964f25e4408") : secret "insights-runtime-extractor-tls" not found
Sep 09 05:50:17.638531 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.638497    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdd27137-ac0c-40b6-b325-9964f25e4408-data-volume\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:17.644300 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.644276    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bhzcv" event={"ID":"e6726e06-34b8-4f2e-a7c6-8c44d438ec95","Type":"ContainerStarted","Data":"980d3a2eb0ad835c211ea6b660670f0e890e0244a6feb4163d70b8e7d7f23a81"}
Sep 09 05:50:17.649217 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.649189    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqlgj\" (UniqueName: \"kubernetes.io/projected/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-api-access-lqlgj\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:17.667821 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.666230    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bhzcv" podStartSLOduration=8.400143271 podStartE2EDuration="38.666207803s" totalImagesPullingTime="30.266064532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 05:49:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:17.664172746 +0000 UTC m=+38.894669299" watchObservedRunningTime="2026-09-09 05:50:17.666207803 +0000 UTC m=+38.896704356"
Sep 09 05:50:17.781104 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.781065    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:17.870229 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.870201    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:17.922012 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:17.921983    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:18.143499 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.143414    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:18.143499 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.143485    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:18.143680 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:18.143536    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 05:50:18.143680 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:18.143611    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 05:50:18.143680 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:18.143619    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm podName:cdd27137-ac0c-40b6-b325-9964f25e4408 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:19.14360116 +0000 UTC m=+40.374097690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w64nm" (UID: "cdd27137-ac0c-40b6-b325-9964f25e4408") : configmap "kube-rbac-proxy" not found
Sep 09 05:50:18.143680 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:18.143650    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls podName:cdd27137-ac0c-40b6-b325-9964f25e4408 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:19.143639168 +0000 UTC m=+40.374135698 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w64nm" (UID: "cdd27137-ac0c-40b6-b325-9964f25e4408") : secret "insights-runtime-extractor-tls" not found
Sep 09 05:50:18.212340 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.212295    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:18.313281 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.313252    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:18.409522 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.409444    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-58pqj"]
Sep 09 05:50:18.412619 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.412593    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:18.433675 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.433648    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-58pqj"]
Sep 09 05:50:18.433790 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.433739    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-58pqj"
Sep 09 05:50:18.436188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.436167    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 09 05:50:18.437182 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.437162    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-thpn4\""
Sep 09 05:50:18.437276 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.437206    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 09 05:50:18.483935 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.483900    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:18.546008 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.545977    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:18.546999 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.546979    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvzm2\" (UniqueName: \"kubernetes.io/projected/c7e68f07-fb31-40d3-ad09-e7e7fe100bc1-kube-api-access-qvzm2\") pod \"migrator-fdbb8fdff-58pqj\" (UID: \"c7e68f07-fb31-40d3-ad09-e7e7fe100bc1\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-58pqj"
Sep 09 05:50:18.647591 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.647542    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvzm2\" (UniqueName: \"kubernetes.io/projected/c7e68f07-fb31-40d3-ad09-e7e7fe100bc1-kube-api-access-qvzm2\") pod \"migrator-fdbb8fdff-58pqj\" (UID: \"c7e68f07-fb31-40d3-ad09-e7e7fe100bc1\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-58pqj"
Sep 09 05:50:18.649133 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.649069    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qphbh" event={"ID":"bcb0044b-a0cc-4cfe-bff9-b03a025cddc7","Type":"ContainerStarted","Data":"351f533f31cfcf444e973424de75529c0f5030ac138b3a2ce4bdd28364000dca"}
Sep 09 05:50:18.655733 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.655713    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvzm2\" (UniqueName: \"kubernetes.io/projected/c7e68f07-fb31-40d3-ad09-e7e7fe100bc1-kube-api-access-qvzm2\") pod \"migrator-fdbb8fdff-58pqj\" (UID: \"c7e68f07-fb31-40d3-ad09-e7e7fe100bc1\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-58pqj"
Sep 09 05:50:18.663388 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.663308    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qphbh" podStartSLOduration=3.007968477 podStartE2EDuration="5.663291268s" totalImagesPullingTime="2.655322791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:18.662440106 +0000 UTC m=+39.892936659" watchObservedRunningTime="2026-09-09 05:50:18.663291268 +0000 UTC m=+39.893787820"
Sep 09 05:50:18.742573 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.742518    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-58pqj"
Sep 09 05:50:18.895027 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.894994    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:18.996188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:18.996112    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:19.026121 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:19.026085    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-58pqj"]
Sep 09 05:50:19.030419 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:50:19.030388    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7e68f07_fb31_40d3_ad09_e7e7fe100bc1.slice/crio-ec142d9c98c1f617e4fd24d2d360a95970c7874bd36a2b8a74d8a30f25cf707e WatchSource:0}: Error finding container ec142d9c98c1f617e4fd24d2d360a95970c7874bd36a2b8a74d8a30f25cf707e: Status 404 returned error can't find the container with id ec142d9c98c1f617e4fd24d2d360a95970c7874bd36a2b8a74d8a30f25cf707e
Sep 09 05:50:19.153055 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:19.153021    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:19.153193 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:19.153117    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:19.153193 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:19.153151    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 05:50:19.153280 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:19.153210    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm podName:cdd27137-ac0c-40b6-b325-9964f25e4408 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:21.153195459 +0000 UTC m=+42.383691989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w64nm" (UID: "cdd27137-ac0c-40b6-b325-9964f25e4408") : configmap "kube-rbac-proxy" not found
Sep 09 05:50:19.153280 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:19.153241    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 05:50:19.153342 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:19.153286    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls podName:cdd27137-ac0c-40b6-b325-9964f25e4408 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:21.153272519 +0000 UTC m=+42.383769049 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w64nm" (UID: "cdd27137-ac0c-40b6-b325-9964f25e4408") : secret "insights-runtime-extractor-tls" not found
Sep 09 05:50:19.582534 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:19.582503    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rw6xb_65baeca2-3753-4a1a-8fbe-59ad7bb331ef/dns-node-resolver/0.log"
Sep 09 05:50:19.653610 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:19.653574    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-58pqj" event={"ID":"c7e68f07-fb31-40d3-ad09-e7e7fe100bc1","Type":"ContainerStarted","Data":"ec142d9c98c1f617e4fd24d2d360a95970c7874bd36a2b8a74d8a30f25cf707e"}
Sep 09 05:50:20.081214 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.081179    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-tjfpl"]
Sep 09 05:50:20.101287 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.101262    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-tjfpl"]
Sep 09 05:50:20.101431 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.101386    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-tjfpl"
Sep 09 05:50:20.104069 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.104049    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 09 05:50:20.104174 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.104118    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 09 05:50:20.104345 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.104332    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 09 05:50:20.105037 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.105010    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-g75pk\""
Sep 09 05:50:20.105150 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.105053    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 09 05:50:20.119495 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.119444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:20.174103 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.174060    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:20.182128 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.182107    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8ffll_9838eb73-668a-4167-8daa-1c5c4db99b05/node-ca/0.log"
Sep 09 05:50:20.261471 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.261423    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ca10fb26-063d-41fb-a2f2-77c104846c17-signing-cabundle\") pod \"service-ca-75d99c484-tjfpl\" (UID: \"ca10fb26-063d-41fb-a2f2-77c104846c17\") " pod="openshift-service-ca/service-ca-75d99c484-tjfpl"
Sep 09 05:50:20.261471 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.261461    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hvrk\" (UniqueName: \"kubernetes.io/projected/ca10fb26-063d-41fb-a2f2-77c104846c17-kube-api-access-9hvrk\") pod \"service-ca-75d99c484-tjfpl\" (UID: \"ca10fb26-063d-41fb-a2f2-77c104846c17\") " pod="openshift-service-ca/service-ca-75d99c484-tjfpl"
Sep 09 05:50:20.261687 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.261495    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ca10fb26-063d-41fb-a2f2-77c104846c17-signing-key\") pod \"service-ca-75d99c484-tjfpl\" (UID: \"ca10fb26-063d-41fb-a2f2-77c104846c17\") " pod="openshift-service-ca/service-ca-75d99c484-tjfpl"
Sep 09 05:50:20.362959 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.362873    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ca10fb26-063d-41fb-a2f2-77c104846c17-signing-cabundle\") pod \"service-ca-75d99c484-tjfpl\" (UID: \"ca10fb26-063d-41fb-a2f2-77c104846c17\") " pod="openshift-service-ca/service-ca-75d99c484-tjfpl"
Sep 09 05:50:20.362959 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.362916    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hvrk\" (UniqueName: \"kubernetes.io/projected/ca10fb26-063d-41fb-a2f2-77c104846c17-kube-api-access-9hvrk\") pod \"service-ca-75d99c484-tjfpl\" (UID: \"ca10fb26-063d-41fb-a2f2-77c104846c17\") " pod="openshift-service-ca/service-ca-75d99c484-tjfpl"
Sep 09 05:50:20.363169 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.363055    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ca10fb26-063d-41fb-a2f2-77c104846c17-signing-key\") pod \"service-ca-75d99c484-tjfpl\" (UID: \"ca10fb26-063d-41fb-a2f2-77c104846c17\") " pod="openshift-service-ca/service-ca-75d99c484-tjfpl"
Sep 09 05:50:20.363657 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.363638    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ca10fb26-063d-41fb-a2f2-77c104846c17-signing-cabundle\") pod \"service-ca-75d99c484-tjfpl\" (UID: \"ca10fb26-063d-41fb-a2f2-77c104846c17\") " pod="openshift-service-ca/service-ca-75d99c484-tjfpl"
Sep 09 05:50:20.365824 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.365803    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ca10fb26-063d-41fb-a2f2-77c104846c17-signing-key\") pod \"service-ca-75d99c484-tjfpl\" (UID: \"ca10fb26-063d-41fb-a2f2-77c104846c17\") " pod="openshift-service-ca/service-ca-75d99c484-tjfpl"
Sep 09 05:50:20.370703 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.370682    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hvrk\" (UniqueName: \"kubernetes.io/projected/ca10fb26-063d-41fb-a2f2-77c104846c17-kube-api-access-9hvrk\") pod \"service-ca-75d99c484-tjfpl\" (UID: \"ca10fb26-063d-41fb-a2f2-77c104846c17\") " pod="openshift-service-ca/service-ca-75d99c484-tjfpl"
Sep 09 05:50:20.412524 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.412488    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-tjfpl"
Sep 09 05:50:20.791399 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.791376    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-tjfpl"]
Sep 09 05:50:20.794668 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:50:20.794641    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca10fb26_063d_41fb_a2f2_77c104846c17.slice/crio-caa08680cd9f371c7ea0f53b8c53bf39116bc46345d7912ee4f81527a0923838 WatchSource:0}: Error finding container caa08680cd9f371c7ea0f53b8c53bf39116bc46345d7912ee4f81527a0923838: Status 404 returned error can't find the container with id caa08680cd9f371c7ea0f53b8c53bf39116bc46345d7912ee4f81527a0923838
Sep 09 05:50:20.868037 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.868007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:20.868174 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:20.868160    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 09 05:50:20.868229 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:20.868218    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls podName:92f78221-304b-4f78-8bd4-e5cce75dc050 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:28.868200821 +0000 UTC m=+50.098697370 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls") pod "dns-default-bhz8k" (UID: "92f78221-304b-4f78-8bd4-e5cce75dc050") : secret "dns-default-metrics-tls" not found
Sep 09 05:50:20.960121 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:20.960050    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:21.170616 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:21.170583    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:21.170765 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:21.170646    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:21.170765 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:21.170735    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 09 05:50:21.170765 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:21.170751    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 05:50:21.170852 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:21.170788    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm podName:cdd27137-ac0c-40b6-b325-9964f25e4408 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:25.170775457 +0000 UTC m=+46.401271987 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm") pod "insights-runtime-extractor-w64nm" (UID: "cdd27137-ac0c-40b6-b325-9964f25e4408") : configmap "kube-rbac-proxy" not found
Sep 09 05:50:21.170852 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:21.170809    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls podName:cdd27137-ac0c-40b6-b325-9964f25e4408 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:25.170793988 +0000 UTC m=+46.401290518 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w64nm" (UID: "cdd27137-ac0c-40b6-b325-9964f25e4408") : secret "insights-runtime-extractor-tls" not found
Sep 09 05:50:21.183506 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:21.183487    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qphbh_bcb0044b-a0cc-4cfe-bff9-b03a025cddc7/serve-healthcheck-canary/0.log"
Sep 09 05:50:21.661596 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:21.661540    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-58pqj" event={"ID":"c7e68f07-fb31-40d3-ad09-e7e7fe100bc1","Type":"ContainerStarted","Data":"17ffa13ddf1c0c25776010c0b1d547bf637d2ec7d8a24636c4399bd5236bad96"}
Sep 09 05:50:21.661769 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:21.661627    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-58pqj" event={"ID":"c7e68f07-fb31-40d3-ad09-e7e7fe100bc1","Type":"ContainerStarted","Data":"8e865d6ce3b5d6fb7cd7a809ed019a7e899aa4fe0536f7e58485032304264255"}
Sep 09 05:50:21.662925 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:21.662897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-tjfpl" event={"ID":"ca10fb26-063d-41fb-a2f2-77c104846c17","Type":"ContainerStarted","Data":"caa08680cd9f371c7ea0f53b8c53bf39116bc46345d7912ee4f81527a0923838"}
Sep 09 05:50:21.678994 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:21.678940    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-58pqj" podStartSLOduration=2.182602355 podStartE2EDuration="3.678919536s" totalImagesPullingTime="1.496317181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:21.678076679 +0000 UTC m=+42.908573230" watchObservedRunningTime="2026-09-09 05:50:21.678919536 +0000 UTC m=+42.909416090"
Sep 09 05:50:23.004154 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:23.004117    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:23.670012 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:23.669969    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-tjfpl" event={"ID":"ca10fb26-063d-41fb-a2f2-77c104846c17","Type":"ContainerStarted","Data":"4e0f0309330019e21c3a74ac76d72e671fc90895f26da8c43b3640ef6d336e06"}
Sep 09 05:50:23.685319 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:23.685121    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-tjfpl" podStartSLOduration=1.377300854 podStartE2EDuration="3.685096336s" totalImagesPullingTime="2.307795482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:23.684899653 +0000 UTC m=+44.915396206" watchObservedRunningTime="2026-09-09 05:50:23.685096336 +0000 UTC m=+44.915592887"
Sep 09 05:50:23.807710 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:23.807673    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:24.791444 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:24.791377    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:24.848487 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:24.848461    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:24.927340 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:24.927303    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:25.026865 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:25.026835    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:25.127520 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:25.127495    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:25.203259 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:25.203225    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:25.203452 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:25.203331    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:25.203501 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:25.203488    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 09 05:50:25.203584 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:25.203574    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls podName:cdd27137-ac0c-40b6-b325-9964f25e4408 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:33.203534859 +0000 UTC m=+54.434031396 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls") pod "insights-runtime-extractor-w64nm" (UID: "cdd27137-ac0c-40b6-b325-9964f25e4408") : secret "insights-runtime-extractor-tls" not found
Sep 09 05:50:25.203858 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:25.203836    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cdd27137-ac0c-40b6-b325-9964f25e4408-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:25.239002 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:25.238969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:25.681363 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:25.681330    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:26.083916 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:26.083829    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:26.948108 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:26.948069    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:27.197900 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:27.197866    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:27.285887 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:27.285798    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:27.486414 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:27.486383    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:27.686588 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:27.686538    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:27.880826 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:27.880795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:28.394326 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:28.394287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:28.494839 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:28.494803    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:28.880408 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:28.880380    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:28.933078 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:28.933035    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:28.935426 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:28.935406    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/92f78221-304b-4f78-8bd4-e5cce75dc050-metrics-tls\") pod \"dns-default-bhz8k\" (UID: \"92f78221-304b-4f78-8bd4-e5cce75dc050\") " pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:28.979606 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:28.979571    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:29.150646 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:29.150546    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:29.250782 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:29.250750    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:29.260606 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:29.260579    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bhz8k"]
Sep 09 05:50:29.265010 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:50:29.264987    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f78221_304b_4f78_8bd4_e5cce75dc050.slice/crio-29f81e05e394d6266905483b0b879ec9a86b28b2d5501c31b4a9357416dd9404 WatchSource:0}: Error finding container 29f81e05e394d6266905483b0b879ec9a86b28b2d5501c31b4a9357416dd9404: Status 404 returned error can't find the container with id 29f81e05e394d6266905483b0b879ec9a86b28b2d5501c31b4a9357416dd9404
Sep 09 05:50:29.350969 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:29.350939    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:29.450920 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:29.450842    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:29.510321 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:29.510293    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:29.679353 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:29.679323    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:29.686160 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:29.686132    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bhz8k" event={"ID":"92f78221-304b-4f78-8bd4-e5cce75dc050","Type":"ContainerStarted","Data":"29f81e05e394d6266905483b0b879ec9a86b28b2d5501c31b4a9357416dd9404"}
Sep 09 05:50:29.827472 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:29.827402    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:29.927656 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:29.927617    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:29.996854 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:29.996822    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:30.246266 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:30.246201    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:30.344044 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:30.344011    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:30.687053 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:30.687020    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:30.851779 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:30.851737    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:30.901760 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:30.901724    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:31.034544 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:31.034466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:31.135412 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:31.135370    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:31.242640 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:31.242614    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:31.455550 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:31.455512    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:31.513274 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:31.513225    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:31.693128 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:31.693091    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bhz8k" event={"ID":"92f78221-304b-4f78-8bd4-e5cce75dc050","Type":"ContainerStarted","Data":"3f933ec93f25d74a9a31b37e31dc7258825b68ae8a20b1458f0a0c1281af00eb"}
Sep 09 05:50:31.886052 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:31.886022    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:32.280946 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:32.280914    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:32.482324 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:32.482288    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:32.700912 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:32.700877    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bhz8k" event={"ID":"92f78221-304b-4f78-8bd4-e5cce75dc050","Type":"ContainerStarted","Data":"d67981484f61ffdc33eef9c8bf5ed0030c54f81a87814ec916fb155629207681"}
Sep 09 05:50:32.701396 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:32.700992    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:32.717787 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:32.717737    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bhz8k" podStartSLOduration=17.439393613 podStartE2EDuration="19.717723123s" totalImagesPullingTime="2.27832951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:50:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:32.716278088 +0000 UTC m=+53.946774643" watchObservedRunningTime="2026-09-09 05:50:32.717723123 +0000 UTC m=+53.948219675"
Sep 09 05:50:32.881571 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:32.881521    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:33.267849 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:33.267815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:33.270256 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:33.270232    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cdd27137-ac0c-40b6-b325-9964f25e4408-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-w64nm\" (UID: \"cdd27137-ac0c-40b6-b325-9964f25e4408\") " pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:33.345361 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:33.345327    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-w64nm"
Sep 09 05:50:33.478182 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:33.478144    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:33.612003 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:33.611936    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-w64nm"]
Sep 09 05:50:33.615005 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:50:33.614982    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdd27137_ac0c_40b6_b325_9964f25e4408.slice/crio-f97d109e235779372a8f08900962f6ed31b0bdb47f0dc0c02ec12ec60ee2b641 WatchSource:0}: Error finding container f97d109e235779372a8f08900962f6ed31b0bdb47f0dc0c02ec12ec60ee2b641: Status 404 returned error can't find the container with id f97d109e235779372a8f08900962f6ed31b0bdb47f0dc0c02ec12ec60ee2b641
Sep 09 05:50:33.705548 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:33.705517    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w64nm" event={"ID":"cdd27137-ac0c-40b6-b325-9964f25e4408","Type":"ContainerStarted","Data":"9c47e7853a850373551b8c5190b5c23d0567a1338d3e004e451f74141326fdc2"}
Sep 09 05:50:33.705982 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:33.705600    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w64nm" event={"ID":"cdd27137-ac0c-40b6-b325-9964f25e4408","Type":"ContainerStarted","Data":"f97d109e235779372a8f08900962f6ed31b0bdb47f0dc0c02ec12ec60ee2b641"}
Sep 09 05:50:34.085816 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:34.085790    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:34.290367 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:34.290337    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:34.489470 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:34.489444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:34.710646 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:34.710537    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w64nm" event={"ID":"cdd27137-ac0c-40b6-b325-9964f25e4408","Type":"ContainerStarted","Data":"50064de4294dc78ba815eea0a9554314ddcd9053b845d09c97d7cbf04176c82e"}
Sep 09 05:50:34.881182 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:34.881125    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:35.479700 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:35.479668    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:35.685109 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:35.685074    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:35.890419 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:35.890385    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:36.460844 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:36.460810    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:36.562705 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:36.562670    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:36.719458 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:36.719376    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-w64nm" event={"ID":"cdd27137-ac0c-40b6-b325-9964f25e4408","Type":"ContainerStarted","Data":"340af991a93b3135fb4e00912883b5d6c9ca7da19702a862d32b7764ba379937"}
Sep 09 05:50:36.736865 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:36.736818    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-w64nm" podStartSLOduration=17.516876514 podStartE2EDuration="19.736803148s" totalImagesPullingTime="2.219926634s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 05:50:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:36.735730251 +0000 UTC m=+57.966226804" watchObservedRunningTime="2026-09-09 05:50:36.736803148 +0000 UTC m=+57.967299700"
Sep 09 05:50:38.617999 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:38.617970    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-t6h79"
Sep 09 05:50:39.351923 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.351891    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78d56968d6-nz8dv"]
Sep 09 05:50:39.354518 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.354498    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78d56968d6-nz8dv"
Sep 09 05:50:39.358235 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.358212    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 09 05:50:39.358235 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.358230    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8chw8\""
Sep 09 05:50:39.358406 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.358245    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 09 05:50:39.358406 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.358212    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 09 05:50:39.358406 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.358228    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 09 05:50:39.364815 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.364798    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78d56968d6-nz8dv"]
Sep 09 05:50:39.413744 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.413718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b377958-8128-4cf9-9afa-19e6885d6bb5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78d56968d6-nz8dv\" (UID: \"4b377958-8128-4cf9-9afa-19e6885d6bb5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78d56968d6-nz8dv"
Sep 09 05:50:39.413884 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.413750    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djmgr\" (UniqueName: \"kubernetes.io/projected/4b377958-8128-4cf9-9afa-19e6885d6bb5-kube-api-access-djmgr\") pod \"managed-serviceaccount-addon-agent-78d56968d6-nz8dv\" (UID: \"4b377958-8128-4cf9-9afa-19e6885d6bb5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78d56968d6-nz8dv"
Sep 09 05:50:39.470853 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.470827    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-p2q5w"]
Sep 09 05:50:39.472565 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.472542    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-p2q5w"
Sep 09 05:50:39.476419 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.476391    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 09 05:50:39.476419 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.476395    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wl8w9\""
Sep 09 05:50:39.476636 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.476483    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 09 05:50:39.486394 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.486370    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-p2q5w"]
Sep 09 05:50:39.518049 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.515159    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggsvv\" (UniqueName: \"kubernetes.io/projected/6d37742e-f304-4942-b1fd-84b1ca8aac5a-kube-api-access-ggsvv\") pod \"downloads-85d98c998f-p2q5w\" (UID: \"6d37742e-f304-4942-b1fd-84b1ca8aac5a\") " pod="openshift-console/downloads-85d98c998f-p2q5w"
Sep 09 05:50:39.518049 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.515219    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b377958-8128-4cf9-9afa-19e6885d6bb5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78d56968d6-nz8dv\" (UID: \"4b377958-8128-4cf9-9afa-19e6885d6bb5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78d56968d6-nz8dv"
Sep 09 05:50:39.518049 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.515252    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djmgr\" (UniqueName: \"kubernetes.io/projected/4b377958-8128-4cf9-9afa-19e6885d6bb5-kube-api-access-djmgr\") pod \"managed-serviceaccount-addon-agent-78d56968d6-nz8dv\" (UID: \"4b377958-8128-4cf9-9afa-19e6885d6bb5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78d56968d6-nz8dv"
Sep 09 05:50:39.519099 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.519062    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4b377958-8128-4cf9-9afa-19e6885d6bb5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-78d56968d6-nz8dv\" (UID: \"4b377958-8128-4cf9-9afa-19e6885d6bb5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78d56968d6-nz8dv"
Sep 09 05:50:39.525662 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.525637    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djmgr\" (UniqueName: \"kubernetes.io/projected/4b377958-8128-4cf9-9afa-19e6885d6bb5-kube-api-access-djmgr\") pod \"managed-serviceaccount-addon-agent-78d56968d6-nz8dv\" (UID: \"4b377958-8128-4cf9-9afa-19e6885d6bb5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78d56968d6-nz8dv"
Sep 09 05:50:39.545335 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.545310    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:39.552210 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.552184    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7947bd4866-2jlwv"]
Sep 09 05:50:39.553960 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.553937    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.556391 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.556372    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 09 05:50:39.556544 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.556527    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 09 05:50:39.556773 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.556753    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 09 05:50:39.557169 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.557152    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gpg8k\""
Sep 09 05:50:39.561861 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.561843    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 09 05:50:39.569505 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.569489    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7947bd4866-2jlwv"]
Sep 09 05:50:39.615643 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.615547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jqzg\" (UniqueName: \"kubernetes.io/projected/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-kube-api-access-6jqzg\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.615643 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.615623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-installation-pull-secrets\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.615643 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.615643    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-bound-sa-token\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.615867 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.615673    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-ca-trust-extracted\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.615867 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.615754    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggsvv\" (UniqueName: \"kubernetes.io/projected/6d37742e-f304-4942-b1fd-84b1ca8aac5a-kube-api-access-ggsvv\") pod \"downloads-85d98c998f-p2q5w\" (UID: \"6d37742e-f304-4942-b1fd-84b1ca8aac5a\") " pod="openshift-console/downloads-85d98c998f-p2q5w"
Sep 09 05:50:39.615867 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.615791    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-image-registry-private-configuration\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.615867 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.615811    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-registry-tls\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.615992 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.615921    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-registry-certificates\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.615992 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.615938    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-trusted-ca\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.624903 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.624877    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:39.627225 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.627207    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggsvv\" (UniqueName: \"kubernetes.io/projected/6d37742e-f304-4942-b1fd-84b1ca8aac5a-kube-api-access-ggsvv\") pod \"downloads-85d98c998f-p2q5w\" (UID: \"6d37742e-f304-4942-b1fd-84b1ca8aac5a\") " pod="openshift-console/downloads-85d98c998f-p2q5w"
Sep 09 05:50:39.679615 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.679593    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78d56968d6-nz8dv"
Sep 09 05:50:39.716963 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.716932    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jqzg\" (UniqueName: \"kubernetes.io/projected/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-kube-api-access-6jqzg\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.717151 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.716983    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-installation-pull-secrets\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.717151 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.717005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-bound-sa-token\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.717151 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.717052    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-ca-trust-extracted\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.717151 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.717092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-image-registry-private-configuration\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.717151 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.717129    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-registry-tls\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.717151 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.717152    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-registry-certificates\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.717460 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.717177    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-trusted-ca\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.717595 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.717568    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-ca-trust-extracted\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.718094 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.718036    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-registry-certificates\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.718234 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.718213    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-trusted-ca\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.719913 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.719890    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-registry-tls\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.720117 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.720101    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-installation-pull-secrets\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.720151 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.720141    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-image-registry-private-configuration\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.725136 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.725100    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jqzg\" (UniqueName: \"kubernetes.io/projected/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-kube-api-access-6jqzg\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.725324 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.725302    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/634c8c44-a831-4eb6-8a08-f8d4a4dc5f89-bound-sa-token\") pod \"image-registry-7947bd4866-2jlwv\" (UID: \"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89\") " pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.781159 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.781118    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-p2q5w"
Sep 09 05:50:39.863165 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.863136    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:39.950201 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:39.950170    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78d56968d6-nz8dv"]
Sep 09 05:50:39.953026 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:50:39.953001    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b377958_8128_4cf9_9afa_19e6885d6bb5.slice/crio-93d70ab6d9b1b4fe343b2e35b3e8e955b80fed278de179f089c9097a9825690c WatchSource:0}: Error finding container 93d70ab6d9b1b4fe343b2e35b3e8e955b80fed278de179f089c9097a9825690c: Status 404 returned error can't find the container with id 93d70ab6d9b1b4fe343b2e35b3e8e955b80fed278de179f089c9097a9825690c
Sep 09 05:50:40.055624 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:40.055596    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-p2q5w"]
Sep 09 05:50:40.058721 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:50:40.058696    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d37742e_f304_4942_b1fd_84b1ca8aac5a.slice/crio-698268c6cbf694d3de4a13ba102f9d0b647ad9307e563d9cf564fd08c42ee2e0 WatchSource:0}: Error finding container 698268c6cbf694d3de4a13ba102f9d0b647ad9307e563d9cf564fd08c42ee2e0: Status 404 returned error can't find the container with id 698268c6cbf694d3de4a13ba102f9d0b647ad9307e563d9cf564fd08c42ee2e0
Sep 09 05:50:40.069456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:40.069435    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:40.131891 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:40.131810    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7947bd4866-2jlwv"]
Sep 09 05:50:40.134568 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:50:40.134528    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634c8c44_a831_4eb6_8a08_f8d4a4dc5f89.slice/crio-ddcb20bcdd560bc3891efd0b6e64275bfa5019ceaa32a397efe13ef2036ad5d4 WatchSource:0}: Error finding container ddcb20bcdd560bc3891efd0b6e64275bfa5019ceaa32a397efe13ef2036ad5d4: Status 404 returned error can't find the container with id ddcb20bcdd560bc3891efd0b6e64275bfa5019ceaa32a397efe13ef2036ad5d4
Sep 09 05:50:40.144026 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:40.143997    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:40.738172 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:40.738059    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-p2q5w" event={"ID":"6d37742e-f304-4942-b1fd-84b1ca8aac5a","Type":"ContainerStarted","Data":"698268c6cbf694d3de4a13ba102f9d0b647ad9307e563d9cf564fd08c42ee2e0"}
Sep 09 05:50:40.742642 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:40.742001    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7947bd4866-2jlwv" event={"ID":"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89","Type":"ContainerStarted","Data":"7d44d99030220be43bfbcf6c69db7d65185d7204e41c7f6aa26d9d7ca6bed538"}
Sep 09 05:50:40.742642 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:40.742050    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7947bd4866-2jlwv" event={"ID":"634c8c44-a831-4eb6-8a08-f8d4a4dc5f89","Type":"ContainerStarted","Data":"ddcb20bcdd560bc3891efd0b6e64275bfa5019ceaa32a397efe13ef2036ad5d4"}
Sep 09 05:50:40.742642 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:40.742237    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:50:40.743906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:40.743883    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78d56968d6-nz8dv" event={"ID":"4b377958-8128-4cf9-9afa-19e6885d6bb5","Type":"ContainerStarted","Data":"93d70ab6d9b1b4fe343b2e35b3e8e955b80fed278de179f089c9097a9825690c"}
Sep 09 05:50:40.760987 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:40.760924    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7947bd4866-2jlwv" podStartSLOduration=1.760902567 podStartE2EDuration="1.760902567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:50:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:40.759946356 +0000 UTC m=+61.990442922" watchObservedRunningTime="2026-09-09 05:50:40.760902567 +0000 UTC m=+61.991399121"
Sep 09 05:50:42.708170 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:42.708088    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bhz8k"
Sep 09 05:50:42.731485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:42.731448    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:42.753983 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:42.753936    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78d56968d6-nz8dv" event={"ID":"4b377958-8128-4cf9-9afa-19e6885d6bb5","Type":"ContainerStarted","Data":"9255b3b99aafdcc8d353ce62ea88d3cd2a22a57dc1f4c37f310a18cac2c55280"}
Sep 09 05:50:42.769724 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:42.768900    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-78d56968d6-nz8dv" podStartSLOduration=1.296393336 podStartE2EDuration="3.768879452s" totalImagesPullingTime="2.472486116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:42.768748612 +0000 UTC m=+63.999245168" watchObservedRunningTime="2026-09-09 05:50:42.768879452 +0000 UTC m=+63.999376007"
Sep 09 05:50:42.793467 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:42.793436    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:42.846129 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:42.846096    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:43.957512 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:43.957473    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs\") pod \"network-metrics-daemon-xk8g9\" (UID: \"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f\") " pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:50:43.960094 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:43.960065    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 09 05:50:43.970860 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:43.970835    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d5ac5a4-7dcf-404a-a23a-a6700b982b7f-metrics-certs\") pod \"network-metrics-daemon-xk8g9\" (UID: \"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f\") " pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:50:44.058414 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.058376    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:50:44.061026 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.060993    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 09 05:50:44.071413 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.071382    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/520a7d10-525f-4833-82e4-af34cfb43113-original-pull-secret\") pod \"global-pull-secret-syncer-vrjtc\" (UID: \"520a7d10-525f-4833-82e4-af34cfb43113\") " pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:50:44.156569 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.156521    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrjtc"
Sep 09 05:50:44.158864 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.158828    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m6c7\" (UniqueName: \"kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7\") pod \"network-check-target-mx47c\" (UID: \"04c271b8-a067-4a6e-9508-829869c6319d\") " pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:50:44.161812 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.161731    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 09 05:50:44.163958 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.163941    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wnkgt\""
Sep 09 05:50:44.171789 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.171767    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xk8g9"
Sep 09 05:50:44.171889 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.171825    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 09 05:50:44.183195 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.183170    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m6c7\" (UniqueName: \"kubernetes.io/projected/04c271b8-a067-4a6e-9508-829869c6319d-kube-api-access-5m6c7\") pod \"network-check-target-mx47c\" (UID: \"04c271b8-a067-4a6e-9508-829869c6319d\") " pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:50:44.453031 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.453001    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hh975\""
Sep 09 05:50:44.455755 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.455713    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vrjtc"]
Sep 09 05:50:44.458818 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:50:44.458789    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520a7d10_525f_4833_82e4_af34cfb43113.slice/crio-8ed228ecb89733355df4e86bbf1d04b544ac1d5be35ba9816cc81dcef28d7496 WatchSource:0}: Error finding container 8ed228ecb89733355df4e86bbf1d04b544ac1d5be35ba9816cc81dcef28d7496: Status 404 returned error can't find the container with id 8ed228ecb89733355df4e86bbf1d04b544ac1d5be35ba9816cc81dcef28d7496
Sep 09 05:50:44.460727 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.460708    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:50:44.479524 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.479496    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xk8g9"]
Sep 09 05:50:44.484619 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:50:44.484544    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d5ac5a4_7dcf_404a_a23a_a6700b982b7f.slice/crio-f98ff11ee48b98272b6af17923da3483c550720c169f45b43c2ec51a2c29e305 WatchSource:0}: Error finding container f98ff11ee48b98272b6af17923da3483c550720c169f45b43c2ec51a2c29e305: Status 404 returned error can't find the container with id f98ff11ee48b98272b6af17923da3483c550720c169f45b43c2ec51a2c29e305
Sep 09 05:50:44.759584 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.759535    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mx47c"]
Sep 09 05:50:44.761918 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:50:44.761877    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04c271b8_a067_4a6e_9508_829869c6319d.slice/crio-43da38234131a15c7b3bd77b5de1abe1a04d207074629c01c62492089501a886 WatchSource:0}: Error finding container 43da38234131a15c7b3bd77b5de1abe1a04d207074629c01c62492089501a886: Status 404 returned error can't find the container with id 43da38234131a15c7b3bd77b5de1abe1a04d207074629c01c62492089501a886
Sep 09 05:50:44.763133 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.763105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vrjtc" event={"ID":"520a7d10-525f-4833-82e4-af34cfb43113","Type":"ContainerStarted","Data":"8ed228ecb89733355df4e86bbf1d04b544ac1d5be35ba9816cc81dcef28d7496"}
Sep 09 05:50:44.764419 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:44.764392    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xk8g9" event={"ID":"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f","Type":"ContainerStarted","Data":"f98ff11ee48b98272b6af17923da3483c550720c169f45b43c2ec51a2c29e305"}
Sep 09 05:50:45.770259 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:45.770187    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mx47c" event={"ID":"04c271b8-a067-4a6e-9508-829869c6319d","Type":"ContainerStarted","Data":"43da38234131a15c7b3bd77b5de1abe1a04d207074629c01c62492089501a886"}
Sep 09 05:50:45.810001 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:45.809971    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:45.905772 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:45.905743    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:46.009596 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.009226    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:46.050402 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.049777    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-qnh8q"]
Sep 09 05:50:46.056438 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.056401    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-qnh8q"
Sep 09 05:50:46.059498 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.059041    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 09 05:50:46.059498 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.059310    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wgnft\""
Sep 09 05:50:46.060510 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.060485    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-qnh8q"]
Sep 09 05:50:46.075044 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.075010    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/460dfc87-2707-4102-8548-8eafe480adf7-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-qnh8q\" (UID: \"460dfc87-2707-4102-8548-8eafe480adf7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-qnh8q"
Sep 09 05:50:46.075806 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.075776    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:46.176240 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.176201    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/460dfc87-2707-4102-8548-8eafe480adf7-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-qnh8q\" (UID: \"460dfc87-2707-4102-8548-8eafe480adf7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-qnh8q"
Sep 09 05:50:46.179854 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.179824    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/460dfc87-2707-4102-8548-8eafe480adf7-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-qnh8q\" (UID: \"460dfc87-2707-4102-8548-8eafe480adf7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-qnh8q"
Sep 09 05:50:46.205394 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.205364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:46.372716 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.372676    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-qnh8q"
Sep 09 05:50:46.669228 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.669155    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-qnh8q"]
Sep 09 05:50:46.675408 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:50:46.674870    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod460dfc87_2707_4102_8548_8eafe480adf7.slice/crio-50b109c8888bfb30ba5aaf83945137870b8a44886ba66d9faaf5733bb5d16df6 WatchSource:0}: Error finding container 50b109c8888bfb30ba5aaf83945137870b8a44886ba66d9faaf5733bb5d16df6: Status 404 returned error can't find the container with id 50b109c8888bfb30ba5aaf83945137870b8a44886ba66d9faaf5733bb5d16df6
Sep 09 05:50:46.777012 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.776962    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-qnh8q" event={"ID":"460dfc87-2707-4102-8548-8eafe480adf7","Type":"ContainerStarted","Data":"50b109c8888bfb30ba5aaf83945137870b8a44886ba66d9faaf5733bb5d16df6"}
Sep 09 05:50:46.781294 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.780481    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xk8g9" event={"ID":"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f","Type":"ContainerStarted","Data":"8436b1354c62c62401ea9a53eca43de08e906450eae965befc2be0a9c1e5bb64"}
Sep 09 05:50:46.781294 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.780534    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xk8g9" event={"ID":"3d5ac5a4-7dcf-404a-a23a-a6700b982b7f","Type":"ContainerStarted","Data":"ca49846791860bc743dd482b6a9f090006a667ce306facaa56fa60edb6fced74"}
Sep 09 05:50:46.798860 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.798437    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xk8g9" podStartSLOduration=66.498946874 podStartE2EDuration="1m7.798417811s" totalImagesPullingTime="1.299470937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:46.796377596 +0000 UTC m=+68.026874147" watchObservedRunningTime="2026-09-09 05:50:46.798417811 +0000 UTC m=+68.028914363"
Sep 09 05:50:46.887734 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.887668    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:46.989334 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:46.989196    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:47.658291 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:47.658250    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:47.759999 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:47.759965    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:48.933094 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:48.933054    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:49.033053 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:49.033018    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:49.461822 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:49.461784    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:49.513369 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:49.513330    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:50.582730 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:50.582684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:50.685016 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:50.684987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:50.781676 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:50.781639    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:51.828617 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:51.828574    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:51.881443 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:51.881406    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:52.668930 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:52.668894    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:52.767438 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:52.767400    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:55.665045 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:55.665007    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:58.019531 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.019500    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:58.118377 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.118321    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:58.829230 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.829192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vrjtc" event={"ID":"520a7d10-525f-4833-82e4-af34cfb43113","Type":"ContainerStarted","Data":"0718a5b7ee04c07f6c4036070fecb91bbb2cf30914e35a1d73a6d1e0b6552ad0"}
Sep 09 05:50:58.831108 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.831075    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mx47c" event={"ID":"04c271b8-a067-4a6e-9508-829869c6319d","Type":"ContainerStarted","Data":"e0a1e11ca5bce91e1e93e25f4ced28fe35be3624ebee0150182e2c0c00e8fde2"}
Sep 09 05:50:58.831256 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.831136    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:50:58.833100 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.833065    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-qnh8q" event={"ID":"460dfc87-2707-4102-8548-8eafe480adf7","Type":"ContainerStarted","Data":"058e78f9e2253ce44c75c8fb9f28e3a71ecd9e65a8b2b507656e47319aba5bb3"}
Sep 09 05:50:58.833249 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.833123    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-qnh8q"
Sep 09 05:50:58.835648 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.835621    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-p2q5w" event={"ID":"6d37742e-f304-4942-b1fd-84b1ca8aac5a","Type":"ContainerStarted","Data":"92784dba4c9403954957c8b29f41068b0c890a2816a8dff50ac0decc1f4cb97c"}
Sep 09 05:50:58.835881 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.835861    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-p2q5w"
Sep 09 05:50:58.838842 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.838822    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-qnh8q"
Sep 09 05:50:58.850064 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.850013    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vrjtc" podStartSLOduration=66.35948013 podStartE2EDuration="1m19.84999532s" totalImagesPullingTime="13.49051519s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 05:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:58.849047377 +0000 UTC m=+80.079543930" watchObservedRunningTime="2026-09-09 05:50:58.84999532 +0000 UTC m=+80.080491866"
Sep 09 05:50:58.855124 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.855095    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-p2q5w"
Sep 09 05:50:58.866241 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.866187    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-p2q5w" podStartSLOduration=1.913867194 podStartE2EDuration="19.866175108s" totalImagesPullingTime="17.952307914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:50:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:58.865365232 +0000 UTC m=+80.095861797" watchObservedRunningTime="2026-09-09 05:50:58.866175108 +0000 UTC m=+80.096671659"
Sep 09 05:50:58.881162 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.881124    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:58.900743 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.900694    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mx47c" podStartSLOduration=66.713026611 podStartE2EDuration="1m19.900675757s" totalImagesPullingTime="13.187649146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:49:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:58.885466272 +0000 UTC m=+80.115962825" watchObservedRunningTime="2026-09-09 05:50:58.900675757 +0000 UTC m=+80.131172310"
Sep 09 05:50:58.901086 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:58.901057    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-qnh8q" podStartSLOduration=1.624236399 podStartE2EDuration="12.901048901s" totalImagesPullingTime="11.276812502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:50:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:50:58.899981611 +0000 UTC m=+80.130478163" watchObservedRunningTime="2026-09-09 05:50:58.901048901 +0000 UTC m=+80.131545455"
Sep 09 05:50:59.069331 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.069293    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:59.108797 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.108704    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"]
Sep 09 05:50:59.125569 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.125525    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"]
Sep 09 05:50:59.125738 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.125674    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:50:59.128471 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.128444    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 09 05:50:59.128622 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.128494    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 09 05:50:59.128622 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.128544    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 09 05:50:59.128764 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.128450    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 09 05:50:59.128764 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.128447    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-wd7bp\""
Sep 09 05:50:59.128968 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.128948    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 09 05:50:59.145245 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.145214    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:59.178435 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.178395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1ac7c29-c4ac-4300-bdf0-20427eb22527-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-wxp9h\" (UID: \"a1ac7c29-c4ac-4300-bdf0-20427eb22527\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:50:59.178625 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.178449    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnrtf\" (UniqueName: \"kubernetes.io/projected/a1ac7c29-c4ac-4300-bdf0-20427eb22527-kube-api-access-qnrtf\") pod \"prometheus-operator-6f4946db56-wxp9h\" (UID: \"a1ac7c29-c4ac-4300-bdf0-20427eb22527\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:50:59.178625 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.178593    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1ac7c29-c4ac-4300-bdf0-20427eb22527-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-wxp9h\" (UID: \"a1ac7c29-c4ac-4300-bdf0-20427eb22527\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:50:59.178625 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.178621    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ac7c29-c4ac-4300-bdf0-20427eb22527-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-wxp9h\" (UID: \"a1ac7c29-c4ac-4300-bdf0-20427eb22527\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:50:59.279983 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.279945    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1ac7c29-c4ac-4300-bdf0-20427eb22527-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-wxp9h\" (UID: \"a1ac7c29-c4ac-4300-bdf0-20427eb22527\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:50:59.279983 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.279992    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ac7c29-c4ac-4300-bdf0-20427eb22527-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-wxp9h\" (UID: \"a1ac7c29-c4ac-4300-bdf0-20427eb22527\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:50:59.280248 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.280035    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1ac7c29-c4ac-4300-bdf0-20427eb22527-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-wxp9h\" (UID: \"a1ac7c29-c4ac-4300-bdf0-20427eb22527\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:50:59.280248 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.280076    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnrtf\" (UniqueName: \"kubernetes.io/projected/a1ac7c29-c4ac-4300-bdf0-20427eb22527-kube-api-access-qnrtf\") pod \"prometheus-operator-6f4946db56-wxp9h\" (UID: \"a1ac7c29-c4ac-4300-bdf0-20427eb22527\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:50:59.280631 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:59.280600    2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 09 05:50:59.280767 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:50:59.280680    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a1ac7c29-c4ac-4300-bdf0-20427eb22527-prometheus-operator-tls podName:a1ac7c29-c4ac-4300-bdf0-20427eb22527 nodeName:}" failed. No retries permitted until 2026-09-09 05:50:59.780660206 +0000 UTC m=+81.011156748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a1ac7c29-c4ac-4300-bdf0-20427eb22527-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-wxp9h" (UID: "a1ac7c29-c4ac-4300-bdf0-20427eb22527") : secret "prometheus-operator-tls" not found
Sep 09 05:50:59.280950 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.280925    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1ac7c29-c4ac-4300-bdf0-20427eb22527-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-wxp9h\" (UID: \"a1ac7c29-c4ac-4300-bdf0-20427eb22527\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:50:59.283154 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.283132    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a1ac7c29-c4ac-4300-bdf0-20427eb22527-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-wxp9h\" (UID: \"a1ac7c29-c4ac-4300-bdf0-20427eb22527\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:50:59.289212 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.289188    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnrtf\" (UniqueName: \"kubernetes.io/projected/a1ac7c29-c4ac-4300-bdf0-20427eb22527-kube-api-access-qnrtf\") pod \"prometheus-operator-6f4946db56-wxp9h\" (UID: \"a1ac7c29-c4ac-4300-bdf0-20427eb22527\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:50:59.601543 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.601492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:50:59.785355 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.785316    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1ac7c29-c4ac-4300-bdf0-20427eb22527-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-wxp9h\" (UID: \"a1ac7c29-c4ac-4300-bdf0-20427eb22527\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:50:59.788240 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:50:59.788212    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a1ac7c29-c4ac-4300-bdf0-20427eb22527-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-wxp9h\" (UID: \"a1ac7c29-c4ac-4300-bdf0-20427eb22527\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:51:00.038124 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:00.038082    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"
Sep 09 05:51:00.345447 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:00.345292    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-wxp9h"]
Sep 09 05:51:00.349199 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:51:00.349164    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1ac7c29_c4ac_4300_bdf0_20427eb22527.slice/crio-705f5ebd87f8f503b94b1fa6982a5947047e2fafffb77930bdbce84e26a7cd1f WatchSource:0}: Error finding container 705f5ebd87f8f503b94b1fa6982a5947047e2fafffb77930bdbce84e26a7cd1f: Status 404 returned error can't find the container with id 705f5ebd87f8f503b94b1fa6982a5947047e2fafffb77930bdbce84e26a7cd1f
Sep 09 05:51:00.839140 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:00.839095    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:00.846462 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:00.846424    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h" event={"ID":"a1ac7c29-c4ac-4300-bdf0-20427eb22527","Type":"ContainerStarted","Data":"705f5ebd87f8f503b94b1fa6982a5947047e2fafffb77930bdbce84e26a7cd1f"}
Sep 09 05:51:00.890405 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:00.890370    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:01.753066 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:01.753038    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7947bd4866-2jlwv"
Sep 09 05:51:01.913209 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:01.913173    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:02.012121 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:02.012035    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:02.627751 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:02.627675    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:02.857008 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:02.856964    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h" event={"ID":"a1ac7c29-c4ac-4300-bdf0-20427eb22527","Type":"ContainerStarted","Data":"06f3e4ee8db9ee79dd548ca244ed58f60991927b5ea1e9da51964ef8ba5fce12"}
Sep 09 05:51:02.857466 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:02.857031    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h" event={"ID":"a1ac7c29-c4ac-4300-bdf0-20427eb22527","Type":"ContainerStarted","Data":"f7074fec6a5c6c3ca8401fbd2907022296527e7f3d006a52a8a1f1fb8e492900"}
Sep 09 05:51:02.876130 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:02.876071    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-wxp9h" podStartSLOduration=1.9290093289999999 podStartE2EDuration="3.876053756s" totalImagesPullingTime="1.947044427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:51:02.874888016 +0000 UTC m=+84.105384570" watchObservedRunningTime="2026-09-09 05:51:02.876053756 +0000 UTC m=+84.106550308"
Sep 09 05:51:03.890788 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:03.890757    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:04.013694 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.013665    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:04.089801 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.089767    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:04.212514 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.212410    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:04.406859 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.406801    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:04.526296 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.526214    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:04.548768 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.548729    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gwx6k"]
Sep 09 05:51:04.579670 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.579627    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"]
Sep 09 05:51:04.579887 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.579746    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.586881 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.586855    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 09 05:51:04.587091 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.587077    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8mwq7\""
Sep 09 05:51:04.587365 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.587351    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 09 05:51:04.587540 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.587528    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 09 05:51:04.600635 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.600596    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"]
Sep 09 05:51:04.600805 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.600713    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.605942 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.604711    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 09 05:51:04.605942 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.604878    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 09 05:51:04.605942 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.605018    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 09 05:51:04.605942 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.605213    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rc2gj\""
Sep 09 05:51:04.629405 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.629373    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54b83360-5bed-4dfb-9f95-8208ef55e0f1-root\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.629549 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.629422    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-wtmp\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.629549 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.629457    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.629549 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.629491    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krzd8\" (UniqueName: \"kubernetes.io/projected/54b83360-5bed-4dfb-9f95-8208ef55e0f1-kube-api-access-krzd8\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.629549 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.629526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-tls\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.629806 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.629588    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54b83360-5bed-4dfb-9f95-8208ef55e0f1-sys\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.629806 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.629611    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54b83360-5bed-4dfb-9f95-8208ef55e0f1-metrics-client-ca\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.629806 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.629641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-textfile\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.629806 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.629667    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.643880 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.643859    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:04.730971 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.730911    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tprfk\" (UniqueName: \"kubernetes.io/projected/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-api-access-tprfk\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.731177 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.730984    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.731177 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.731025    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.731177 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.731061    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krzd8\" (UniqueName: \"kubernetes.io/projected/54b83360-5bed-4dfb-9f95-8208ef55e0f1-kube-api-access-krzd8\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.731177 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.731098    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-tls\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.731177 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.731132    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.731177 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.731164    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b31f3fd3-5b7c-4582-9ad8-a6c440717758-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.731494 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.731201    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54b83360-5bed-4dfb-9f95-8208ef55e0f1-sys\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.731494 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.731226    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54b83360-5bed-4dfb-9f95-8208ef55e0f1-metrics-client-ca\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.731494 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.731251    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-textfile\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.731494 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.731279    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.731494 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.731315    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b31f3fd3-5b7c-4582-9ad8-a6c440717758-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.731494 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.731355    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.731494 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.731389    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54b83360-5bed-4dfb-9f95-8208ef55e0f1-root\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.731494 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.731423    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-wtmp\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.731912 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.731633    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-wtmp\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.732581 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:51:04.732544    2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 09 05:51:04.733335 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:51:04.733320    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-tls podName:54b83360-5bed-4dfb-9f95-8208ef55e0f1 nodeName:}" failed. No retries permitted until 2026-09-09 05:51:05.233298188 +0000 UTC m=+86.463794723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-tls") pod "node-exporter-gwx6k" (UID: "54b83360-5bed-4dfb-9f95-8208ef55e0f1") : secret "node-exporter-tls" not found
Sep 09 05:51:04.733514 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.732858    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54b83360-5bed-4dfb-9f95-8208ef55e0f1-metrics-client-ca\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.733660 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.732886    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54b83360-5bed-4dfb-9f95-8208ef55e0f1-root\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.733767 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.733054    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-textfile\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.733871 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.733216    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-accelerators-collector-config\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.733973 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.732833    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54b83360-5bed-4dfb-9f95-8208ef55e0f1-sys\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.734759 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.734740    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.738681 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.738654    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:04.745690 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.745668    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krzd8\" (UniqueName: \"kubernetes.io/projected/54b83360-5bed-4dfb-9f95-8208ef55e0f1-kube-api-access-krzd8\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:04.832665 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.832575    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.832930 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.832909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tprfk\" (UniqueName: \"kubernetes.io/projected/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-api-access-tprfk\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.833064 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.833047    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.833364 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.833341    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.833501 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.833484    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b31f3fd3-5b7c-4582-9ad8-a6c440717758-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.833665 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:51:04.833247    2583 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 09 05:51:04.833895 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.833678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b31f3fd3-5b7c-4582-9ad8-a6c440717758-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.834348 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:51:04.834287    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-state-metrics-tls podName:b31f3fd3-5b7c-4582-9ad8-a6c440717758 nodeName:}" failed. No retries permitted until 2026-09-09 05:51:05.333845421 +0000 UTC m=+86.564341966 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-2w7rs" (UID: "b31f3fd3-5b7c-4582-9ad8-a6c440717758") : secret "kube-state-metrics-tls" not found
Sep 09 05:51:04.834991 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.834936    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b31f3fd3-5b7c-4582-9ad8-a6c440717758-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.835266 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.835244    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b31f3fd3-5b7c-4582-9ad8-a6c440717758-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.835916 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.835893    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.837400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.837377    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.845784 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.845765    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tprfk\" (UniqueName: \"kubernetes.io/projected/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-api-access-tprfk\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:04.917014 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:04.916979    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:05.018422 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.018384    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:05.119687 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.119645    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:05.238390 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.238351    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-tls\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:05.241338 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.241310    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54b83360-5bed-4dfb-9f95-8208ef55e0f1-node-exporter-tls\") pod \"node-exporter-gwx6k\" (UID: \"54b83360-5bed-4dfb-9f95-8208ef55e0f1\") " pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:05.339092 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.339049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:05.342118 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.342086    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b31f3fd3-5b7c-4582-9ad8-a6c440717758-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-2w7rs\" (UID: \"b31f3fd3-5b7c-4582-9ad8-a6c440717758\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:05.349301 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.349264    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:05.451673 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.451527    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:05.496035 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.496004    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gwx6k"
Sep 09 05:51:05.517205 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.517177    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"
Sep 09 05:51:05.518604 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.518574    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:05.532025 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:51:05.532001    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b83360_5bed_4dfb_9f95_8208ef55e0f1.slice/crio-c0c32769e41c6a81ef42922242bc876728b69dda41dda1116770d99b429a2252 WatchSource:0}: Error finding container c0c32769e41c6a81ef42922242bc876728b69dda41dda1116770d99b429a2252: Status 404 returned error can't find the container with id c0c32769e41c6a81ef42922242bc876728b69dda41dda1116770d99b429a2252
Sep 09 05:51:05.667718 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.667681    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:05.827245 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.827170    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs"]
Sep 09 05:51:05.829870 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.829810    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:05.830904 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:51:05.830869    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb31f3fd3_5b7c_4582_9ad8_a6c440717758.slice/crio-4de3ce767e2266fe353baf4de95975fe4239c16475fa8aa7c0fcaf83b18bbd1f WatchSource:0}: Error finding container 4de3ce767e2266fe353baf4de95975fe4239c16475fa8aa7c0fcaf83b18bbd1f: Status 404 returned error can't find the container with id 4de3ce767e2266fe353baf4de95975fe4239c16475fa8aa7c0fcaf83b18bbd1f
Sep 09 05:51:05.869642 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.869594    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs" event={"ID":"b31f3fd3-5b7c-4582-9ad8-a6c440717758","Type":"ContainerStarted","Data":"4de3ce767e2266fe353baf4de95975fe4239c16475fa8aa7c0fcaf83b18bbd1f"}
Sep 09 05:51:05.871064 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.871040    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gwx6k" event={"ID":"54b83360-5bed-4dfb-9f95-8208ef55e0f1","Type":"ContainerStarted","Data":"c0c32769e41c6a81ef42922242bc876728b69dda41dda1116770d99b429a2252"}
Sep 09 05:51:05.891580 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:05.891531    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:07.392541 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.392487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:07.445430 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.445386    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-576c466d8b-ml26v"]
Sep 09 05:51:07.472215 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.467531    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-576c466d8b-ml26v"]
Sep 09 05:51:07.472215 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.467677    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.472215 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.470852    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 09 05:51:07.472215 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.471071    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 09 05:51:07.472215 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.471234    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 09 05:51:07.472215 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.471533    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 09 05:51:07.472215 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.471731    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-hkj5d\""
Sep 09 05:51:07.473842 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.473067    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5ka706ur1gq5t\""
Sep 09 05:51:07.473842 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.473259    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 09 05:51:07.492936 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.492877    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:07.562886 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.562852    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-grpc-tls\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.563058 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.562903    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.563058 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.562957    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dbnd\" (UniqueName: \"kubernetes.io/projected/444d4bc4-e456-4c44-9e47-aeccaacc7de6-kube-api-access-9dbnd\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.563058 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.562978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.563058 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.563006    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-tls\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.563058 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.563040    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.563318 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.563060    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/444d4bc4-e456-4c44-9e47-aeccaacc7de6-metrics-client-ca\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.563318 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.563085    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.614788 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.614761    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:07.664094 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.664023    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-grpc-tls\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.664094 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.664072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.664299 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.664198    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dbnd\" (UniqueName: \"kubernetes.io/projected/444d4bc4-e456-4c44-9e47-aeccaacc7de6-kube-api-access-9dbnd\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.664299 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.664245    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.664299 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.664282    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-tls\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.664457 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.664328    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.664457 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.664358    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/444d4bc4-e456-4c44-9e47-aeccaacc7de6-metrics-client-ca\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.664457 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.664387    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.665462 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.665405    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/444d4bc4-e456-4c44-9e47-aeccaacc7de6-metrics-client-ca\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.667170 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.667143    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.667648 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.667624    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.667759 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.667736    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.667822 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.667798    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-grpc-tls\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.667892 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.667835    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-tls\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.668100 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.668081    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/444d4bc4-e456-4c44-9e47-aeccaacc7de6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.672677 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.672661    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dbnd\" (UniqueName: \"kubernetes.io/projected/444d4bc4-e456-4c44-9e47-aeccaacc7de6-kube-api-access-9dbnd\") pod \"thanos-querier-576c466d8b-ml26v\" (UID: \"444d4bc4-e456-4c44-9e47-aeccaacc7de6\") " pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:07.754223 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.754186    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:07.786728 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:07.786701    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:08.290569 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:08.290450    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-576c466d8b-ml26v"]
Sep 09 05:51:08.319634 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:51:08.319593    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod444d4bc4_e456_4c44_9e47_aeccaacc7de6.slice/crio-5ee0779867e59ea22fb458e65cde2f1768278fe6297f1320c0f372a08b9875ae WatchSource:0}: Error finding container 5ee0779867e59ea22fb458e65cde2f1768278fe6297f1320c0f372a08b9875ae: Status 404 returned error can't find the container with id 5ee0779867e59ea22fb458e65cde2f1768278fe6297f1320c0f372a08b9875ae
Sep 09 05:51:08.890045 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:08.890006    2583 generic.go:356] "Generic (PLEG): container finished" podID="54b83360-5bed-4dfb-9f95-8208ef55e0f1" containerID="6243ec383c4cd51610466cbf42460ab3198e37be9881e42d189ecac03bdace87" exitCode=0
Sep 09 05:51:08.890480 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:08.890037    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gwx6k" event={"ID":"54b83360-5bed-4dfb-9f95-8208ef55e0f1","Type":"ContainerDied","Data":"6243ec383c4cd51610466cbf42460ab3198e37be9881e42d189ecac03bdace87"}
Sep 09 05:51:08.891657 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:08.891622    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v" event={"ID":"444d4bc4-e456-4c44-9e47-aeccaacc7de6","Type":"ContainerStarted","Data":"5ee0779867e59ea22fb458e65cde2f1768278fe6297f1320c0f372a08b9875ae"}
Sep 09 05:51:08.894153 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:08.894128    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs" event={"ID":"b31f3fd3-5b7c-4582-9ad8-a6c440717758","Type":"ContainerStarted","Data":"1d77b505a8e6a4ddad923fd07b309e9474fbeb70faff5d72ecb961ce570ee587"}
Sep 09 05:51:08.894251 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:08.894180    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs" event={"ID":"b31f3fd3-5b7c-4582-9ad8-a6c440717758","Type":"ContainerStarted","Data":"6abb7b4d2020ddfe2ae3d6b1eb3bfe4521bd6d89f046bba203953653dc94a9ed"}
Sep 09 05:51:08.894251 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:08.894201    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs" event={"ID":"b31f3fd3-5b7c-4582-9ad8-a6c440717758","Type":"ContainerStarted","Data":"7dd2ae1a5fcb307025fc8b34240fe373566af1bc98b1c39e3c0486e79e0b2e39"}
Sep 09 05:51:08.930003 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:08.929959    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-2w7rs" podStartSLOduration=2.74207484 podStartE2EDuration="4.92994229s" totalImagesPullingTime="2.18786745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:51:08.928667773 +0000 UTC m=+90.159164327" watchObservedRunningTime="2026-09-09 05:51:08.92994229 +0000 UTC m=+90.160438842"
Sep 09 05:51:09.254458 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.254365    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:09.260908 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.260877    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6"]
Sep 09 05:51:09.279311 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.279258    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6"
Sep 09 05:51:09.283199 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.283173    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6"]
Sep 09 05:51:09.284203 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.284181    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-btncr\""
Sep 09 05:51:09.284325 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.284231    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 09 05:51:09.330502 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.330464    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:09.377886 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.377851    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a0d8715-c5cb-4a55-b295-72050d5c4695-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-ssps6\" (UID: \"0a0d8715-c5cb-4a55-b295-72050d5c4695\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6"
Sep 09 05:51:09.378037 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.377972    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qpkn\" (UniqueName: \"kubernetes.io/projected/0a0d8715-c5cb-4a55-b295-72050d5c4695-kube-api-access-6qpkn\") pod \"monitoring-plugin-85bbbbbf4-ssps6\" (UID: \"0a0d8715-c5cb-4a55-b295-72050d5c4695\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6"
Sep 09 05:51:09.478625 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.478587    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a0d8715-c5cb-4a55-b295-72050d5c4695-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-ssps6\" (UID: \"0a0d8715-c5cb-4a55-b295-72050d5c4695\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6"
Sep 09 05:51:09.478797 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.478681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qpkn\" (UniqueName: \"kubernetes.io/projected/0a0d8715-c5cb-4a55-b295-72050d5c4695-kube-api-access-6qpkn\") pod \"monitoring-plugin-85bbbbbf4-ssps6\" (UID: \"0a0d8715-c5cb-4a55-b295-72050d5c4695\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6"
Sep 09 05:51:09.478797 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:51:09.478745    2583 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 09 05:51:09.478910 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:51:09.478828    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a0d8715-c5cb-4a55-b295-72050d5c4695-monitoring-plugin-cert podName:0a0d8715-c5cb-4a55-b295-72050d5c4695 nodeName:}" failed. No retries permitted until 2026-09-09 05:51:09.978807326 +0000 UTC m=+91.209303871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0a0d8715-c5cb-4a55-b295-72050d5c4695-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-ssps6" (UID: "0a0d8715-c5cb-4a55-b295-72050d5c4695") : secret "monitoring-plugin-cert" not found
Sep 09 05:51:09.489500 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.489469    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qpkn\" (UniqueName: \"kubernetes.io/projected/0a0d8715-c5cb-4a55-b295-72050d5c4695-kube-api-access-6qpkn\") pod \"monitoring-plugin-85bbbbbf4-ssps6\" (UID: \"0a0d8715-c5cb-4a55-b295-72050d5c4695\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6"
Sep 09 05:51:09.513807 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.513723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:09.621617 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.621569    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:09.902183 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.902139    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gwx6k" event={"ID":"54b83360-5bed-4dfb-9f95-8208ef55e0f1","Type":"ContainerStarted","Data":"1cbc6c28e2b0d388f30c9ac56be3e8c83ac0d54b5d4e978018707353556e76ca"}
Sep 09 05:51:09.902680 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.902211    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gwx6k" event={"ID":"54b83360-5bed-4dfb-9f95-8208ef55e0f1","Type":"ContainerStarted","Data":"9565b06afabaed65f11bfb4b24548499f7bd95b61bcdc169fe768bea206db7fb"}
Sep 09 05:51:09.929061 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.929000    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gwx6k" podStartSLOduration=3.334167964 podStartE2EDuration="5.928979409s" totalImagesPullingTime="2.485311342s" totalInitContainerRuntime="109.500103ms" isStatefulPod=true podCreationTimestamp="2026-09-09 05:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:51:09.928168722 +0000 UTC m=+91.158665287" watchObservedRunningTime="2026-09-09 05:51:09.928979409 +0000 UTC m=+91.159475962"
Sep 09 05:51:09.982775 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.982737    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a0d8715-c5cb-4a55-b295-72050d5c4695-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-ssps6\" (UID: \"0a0d8715-c5cb-4a55-b295-72050d5c4695\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6"
Sep 09 05:51:09.985593 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:09.985547    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a0d8715-c5cb-4a55-b295-72050d5c4695-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-ssps6\" (UID: \"0a0d8715-c5cb-4a55-b295-72050d5c4695\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6"
Sep 09 05:51:10.192757 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.192669    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6"
Sep 09 05:51:10.567131 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.567054    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6"]
Sep 09 05:51:10.666729 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:51:10.666693    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a0d8715_c5cb_4a55_b295_72050d5c4695.slice/crio-7574e55bcc810af99fb871bcf406977ba0cfcf926cd3321bba2a707b4802bffc WatchSource:0}: Error finding container 7574e55bcc810af99fb871bcf406977ba0cfcf926cd3321bba2a707b4802bffc: Status 404 returned error can't find the container with id 7574e55bcc810af99fb871bcf406977ba0cfcf926cd3321bba2a707b4802bffc
Sep 09 05:51:10.694358 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.694334    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 05:51:10.715632 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.715203    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.725548 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.725426    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 05:51:10.725716 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.725693    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 05:51:10.725801 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.725726    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 05:51:10.725801 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.725724    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 05:51:10.725801 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.725774    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 05:51:10.725930 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.725814    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 05:51:10.726014 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.725948    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 05:51:10.726448 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.726432    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 05:51:10.726485 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.726446    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 05:51:10.726796 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.726779    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 05:51:10.726856 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.726798    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 05:51:10.726856 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.726779    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 05:51:10.726856 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.726843    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ccgh7kjlo89jo\""
Sep 09 05:51:10.727061 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.727049    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 05:51:10.727140 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.727125    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wzgnm\""
Sep 09 05:51:10.731748 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.731726    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 05:51:10.733781 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.733761    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 05:51:10.743460 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.743141    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 05:51:10.744022 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.744002    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:10.789761 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.789724    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.789904 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.789771    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.789904 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.789800    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80acb3ad-1857-4936-a350-1c682d82b2e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.789904 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.789824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.789904 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.789872    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80acb3ad-1857-4936-a350-1c682d82b2e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790127 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.789931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790127 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.789973    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790127 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.790002    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790127 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.790047    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k82t\" (UniqueName: \"kubernetes.io/projected/80acb3ad-1857-4936-a350-1c682d82b2e6-kube-api-access-4k82t\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790127 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.790099    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790127 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.790124    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-config\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.790163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.790187    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.790230    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.790265    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.790320    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.790347    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790602 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.790361    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790602 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.790385    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.790602 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.790439    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.891650 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.891621    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k82t\" (UniqueName: \"kubernetes.io/projected/80acb3ad-1857-4936-a350-1c682d82b2e6-kube-api-access-4k82t\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.891786 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.891654    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.891786 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.891673    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-config\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.891896 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.891789    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.891896 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.891822    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.891896 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.891868    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892062 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.891894    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892062 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.891924    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892062 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.891962    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892062 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.891989    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892062 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.892016    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892062 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.892045    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892363 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.892079    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892363 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.892109    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892363 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.892147    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80acb3ad-1857-4936-a350-1c682d82b2e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892363 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.892170    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892363 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.892174    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892363 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.892196    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80acb3ad-1857-4936-a350-1c682d82b2e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892363 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.892222    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892363 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.892266    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892363 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.892296    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892806 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.892522    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.892806 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.892702    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.893080 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.893054    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.894633 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.894114    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.895808 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.895786    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.895906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.895832    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.896075 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.896048    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.896456 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.896427    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80acb3ad-1857-4936-a350-1c682d82b2e6-config-out\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.896720 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.896695    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-web-config\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.897258 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.897232    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.898154 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.898109    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.898643 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.898293    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-config\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.898727 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.898706    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.899444 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.899137    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.899444 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.899407    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80acb3ad-1857-4936-a350-1c682d82b2e6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.899827 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.899792    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.901914 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.901870    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.902015 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.901924    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k82t\" (UniqueName: \"kubernetes.io/projected/80acb3ad-1857-4936-a350-1c682d82b2e6-kube-api-access-4k82t\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.902422 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.902386    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:10.908924 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.908897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v" event={"ID":"444d4bc4-e456-4c44-9e47-aeccaacc7de6","Type":"ContainerStarted","Data":"cb455df70e8ce9eae15b6940854c51962d1ee01227c31a761e369134086dcbc9"}
Sep 09 05:51:10.910206 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:10.910183    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6" event={"ID":"0a0d8715-c5cb-4a55-b295-72050d5c4695","Type":"ContainerStarted","Data":"7574e55bcc810af99fb871bcf406977ba0cfcf926cd3321bba2a707b4802bffc"}
Sep 09 05:51:11.024939 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:11.024919    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:11.192120 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:11.192088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:11.294602 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:11.294566    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:11.345506 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:11.345419    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 05:51:11.349149 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:51:11.349106    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80acb3ad_1857_4936_a350_1c682d82b2e6.slice/crio-601c06e3fce2d872c558f57115fdaacf1493eb2377f97b5c45b1c6539c962371 WatchSource:0}: Error finding container 601c06e3fce2d872c558f57115fdaacf1493eb2377f97b5c45b1c6539c962371: Status 404 returned error can't find the container with id 601c06e3fce2d872c558f57115fdaacf1493eb2377f97b5c45b1c6539c962371
Sep 09 05:51:11.918308 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:11.918270    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v" event={"ID":"444d4bc4-e456-4c44-9e47-aeccaacc7de6","Type":"ContainerStarted","Data":"b4e3d75a9e669601294c7abfe05200caafb2f9d3a8e78762223fba06e957b9c1"}
Sep 09 05:51:11.918719 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:11.918355    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v" event={"ID":"444d4bc4-e456-4c44-9e47-aeccaacc7de6","Type":"ContainerStarted","Data":"1b6ac4c63eb24da78b8a97b092ea38ea863adbe58a1d64772b7413bd8c768070"}
Sep 09 05:51:11.920083 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:11.920051    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerStarted","Data":"601c06e3fce2d872c558f57115fdaacf1493eb2377f97b5c45b1c6539c962371"}
Sep 09 05:51:13.933941 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:13.933895    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v" event={"ID":"444d4bc4-e456-4c44-9e47-aeccaacc7de6","Type":"ContainerStarted","Data":"9db6d228333415de1052c870d1d606966b548364fcaddb7204b6f95396db2a38"}
Sep 09 05:51:13.934406 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:13.933993    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v" event={"ID":"444d4bc4-e456-4c44-9e47-aeccaacc7de6","Type":"ContainerStarted","Data":"0d30d36fa2828d4a7ab7e5a10dfde4cb8e573ba849304830e4832180cef86516"}
Sep 09 05:51:13.934406 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:13.934024    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v" event={"ID":"444d4bc4-e456-4c44-9e47-aeccaacc7de6","Type":"ContainerStarted","Data":"af4b95562400cc2ddb54d327dd278ef6eb04cebe784bf37319e37c876249b3ae"}
Sep 09 05:51:13.934406 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:13.934062    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:13.935595 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:13.935543    2583 generic.go:356] "Generic (PLEG): container finished" podID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerID="fb4150f3bf1dced514a100d5f9a94ec4178591348d4c67cb22835c50b696db0e" exitCode=0
Sep 09 05:51:13.935688 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:13.935628    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerDied","Data":"fb4150f3bf1dced514a100d5f9a94ec4178591348d4c67cb22835c50b696db0e"}
Sep 09 05:51:13.937927 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:13.937898    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6" event={"ID":"0a0d8715-c5cb-4a55-b295-72050d5c4695","Type":"ContainerStarted","Data":"1bd2abb5bc1e79691570e3e9f9444263ee59f3b051900fc0328fdd679d5c2d99"}
Sep 09 05:51:13.938537 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:13.938485    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6"
Sep 09 05:51:13.943878 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:13.943859    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6"
Sep 09 05:51:13.961084 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:13.961036    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v" podStartSLOduration=2.480291003 podStartE2EDuration="6.961021888s" totalImagesPullingTime="4.480730885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:51:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:51:13.959750095 +0000 UTC m=+95.190246647" watchObservedRunningTime="2026-09-09 05:51:13.961021888 +0000 UTC m=+95.191518440"
Sep 09 05:51:13.977344 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:13.977298    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-ssps6" podStartSLOduration=2.467581279 podStartE2EDuration="4.977286098s" totalImagesPullingTime="2.509704819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:51:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:51:13.976126676 +0000 UTC m=+95.206623229" watchObservedRunningTime="2026-09-09 05:51:13.977286098 +0000 UTC m=+95.207783016"
Sep 09 05:51:14.801270 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:14.801230    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:14.900864 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:14.900825    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:15.833070 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:15.833029    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:15.886382 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:15.886314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:15.958335 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:15.958300    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-576c466d8b-ml26v"
Sep 09 05:51:17.960003 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:17.959976    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerStarted","Data":"c9e6fa314694bfcfdc6fcf09eb464d6a2f0fab5f0fe38852504707f5f05da3e6"}
Sep 09 05:51:18.967214 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:18.967177    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerStarted","Data":"43e728ed68b3f45fe37a04037f5db0e8d7c251b145a87f058e6312b92e561935"}
Sep 09 05:51:18.967618 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:18.967245    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerStarted","Data":"e269d6a6717fd173efba8b46fbe3e55fe2ab9924f0da73042f070bf339c34eac"}
Sep 09 05:51:18.967618 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:18.967298    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerStarted","Data":"591534b950fa5dba27a566aceaba42890e417090172945993bada7ae185a5bba"}
Sep 09 05:51:18.967618 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:18.967325    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerStarted","Data":"8a7887456034f966132a6d063b84a564ef18d33384a5063cdce27a1337483964"}
Sep 09 05:51:18.967618 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:18.967358    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerStarted","Data":"be07dd5b1bb8fd8cf304caf514cb9bb09584b18c3b68a3b8e4482e899e350542"}
Sep 09 05:51:18.997948 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:18.996836    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.297050871 podStartE2EDuration="8.996811083s" totalImagesPullingTime="5.66865578s" totalInitContainerRuntime="31.104432ms" isStatefulPod=false podCreationTimestamp="2026-09-09 05:51:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:51:18.99587467 +0000 UTC m=+100.226371223" watchObservedRunningTime="2026-09-09 05:51:18.996811083 +0000 UTC m=+100.227307637"
Sep 09 05:51:21.025076 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:21.025047    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:51:22.965437 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:22.965396    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:23.065297 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:23.065261    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:25.006386 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:25.006351    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:25.107717 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:25.107685    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:25.164471 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:25.164440    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:29.843071 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:29.843037    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mx47c"
Sep 09 05:51:30.839075 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:30.839031    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:51:30.896764 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:51:30.896729    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:52:05.609535 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:05.609499    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:52:05.667512 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:05.667480    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:52:11.025701 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:11.025661    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:11.045478 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:11.045437    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:11.192195 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:11.192159    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:20.553644 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:20.553597    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:52:20.609931 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:20.609882    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:52:28.650178 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:28.650132    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:52:28.702300 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:28.702258    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:52:29.036413 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.036328    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 05:52:29.036680 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.036647    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="prometheus" containerID="cri-o://c9e6fa314694bfcfdc6fcf09eb464d6a2f0fab5f0fe38852504707f5f05da3e6" gracePeriod=600
Sep 09 05:52:29.036770 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.036689    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="kube-rbac-proxy-web" containerID="cri-o://591534b950fa5dba27a566aceaba42890e417090172945993bada7ae185a5bba" gracePeriod=600
Sep 09 05:52:29.036770 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.036695    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://43e728ed68b3f45fe37a04037f5db0e8d7c251b145a87f058e6312b92e561935" gracePeriod=600
Sep 09 05:52:29.036770 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.036711    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="config-reloader" containerID="cri-o://be07dd5b1bb8fd8cf304caf514cb9bb09584b18c3b68a3b8e4482e899e350542" gracePeriod=600
Sep 09 05:52:29.036987 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.036714    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="thanos-sidecar" containerID="cri-o://8a7887456034f966132a6d063b84a564ef18d33384a5063cdce27a1337483964" gracePeriod=600
Sep 09 05:52:29.037079 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.036661    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="kube-rbac-proxy" containerID="cri-o://e269d6a6717fd173efba8b46fbe3e55fe2ab9924f0da73042f070bf339c34eac" gracePeriod=600
Sep 09 05:52:29.254588 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.254523    2583 generic.go:356] "Generic (PLEG): container finished" podID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerID="43e728ed68b3f45fe37a04037f5db0e8d7c251b145a87f058e6312b92e561935" exitCode=0
Sep 09 05:52:29.254588 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.254578    2583 generic.go:356] "Generic (PLEG): container finished" podID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerID="e269d6a6717fd173efba8b46fbe3e55fe2ab9924f0da73042f070bf339c34eac" exitCode=0
Sep 09 05:52:29.254588 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.254588    2583 generic.go:356] "Generic (PLEG): container finished" podID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerID="591534b950fa5dba27a566aceaba42890e417090172945993bada7ae185a5bba" exitCode=0
Sep 09 05:52:29.254884 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.254604    2583 generic.go:356] "Generic (PLEG): container finished" podID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerID="8a7887456034f966132a6d063b84a564ef18d33384a5063cdce27a1337483964" exitCode=0
Sep 09 05:52:29.254884 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.254611    2583 generic.go:356] "Generic (PLEG): container finished" podID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerID="be07dd5b1bb8fd8cf304caf514cb9bb09584b18c3b68a3b8e4482e899e350542" exitCode=0
Sep 09 05:52:29.254884 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.254619    2583 generic.go:356] "Generic (PLEG): container finished" podID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerID="c9e6fa314694bfcfdc6fcf09eb464d6a2f0fab5f0fe38852504707f5f05da3e6" exitCode=0
Sep 09 05:52:29.254884 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.254712    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerDied","Data":"43e728ed68b3f45fe37a04037f5db0e8d7c251b145a87f058e6312b92e561935"}
Sep 09 05:52:29.254884 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.254783    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerDied","Data":"e269d6a6717fd173efba8b46fbe3e55fe2ab9924f0da73042f070bf339c34eac"}
Sep 09 05:52:29.254884 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.254823    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerDied","Data":"591534b950fa5dba27a566aceaba42890e417090172945993bada7ae185a5bba"}
Sep 09 05:52:29.255216 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.254928    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerDied","Data":"8a7887456034f966132a6d063b84a564ef18d33384a5063cdce27a1337483964"}
Sep 09 05:52:29.255216 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.254972    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerDied","Data":"be07dd5b1bb8fd8cf304caf514cb9bb09584b18c3b68a3b8e4482e899e350542"}
Sep 09 05:52:29.255216 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.255009    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerDied","Data":"c9e6fa314694bfcfdc6fcf09eb464d6a2f0fab5f0fe38852504707f5f05da3e6"}
Sep 09 05:52:29.292988 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.292925    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:29.350120 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350085    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-grpc-tls\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350120 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350127    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-0\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350342 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350153    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-thanos-prometheus-http-client-file\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350342 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350181    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-2\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350451 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350343    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-1\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350451 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350404    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80acb3ad-1857-4936-a350-1c682d82b2e6-config-out\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350451 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350445    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-serving-certs-ca-bundle\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350626 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350475    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-db\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350626 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350505    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-kube-rbac-proxy\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350626 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350503    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 05:52:29.350626 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350549    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4k82t\" (UniqueName: \"kubernetes.io/projected/80acb3ad-1857-4936-a350-1c682d82b2e6-kube-api-access-4k82t\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350626 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350605    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-config\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350877 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350635    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-kubelet-serving-ca-bundle\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350877 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350669    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80acb3ad-1857-4936-a350-1c682d82b2e6-tls-assets\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350877 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350704    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-metrics-client-certs\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350877 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350728    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-trusted-ca-bundle\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350877 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350752    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350877 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350769    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 05:52:29.350877 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350785    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-tls\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350877 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350810    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-web-config\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.350877 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350845    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-metrics-client-ca\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.351308 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350877    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"80acb3ad-1857-4936-a350-1c682d82b2e6\" (UID: \"80acb3ad-1857-4936-a350-1c682d82b2e6\") "
Sep 09 05:52:29.351308 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.351296    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.351412 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.351315    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.351412 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.350919    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 05:52:29.351412 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.351095    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 05:52:29.351412 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.351270    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 05:52:29.352386 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.352352    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 05:52:29.352515 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.352414    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 05:52:29.353145 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.353106    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 05:52:29.353696 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.353666    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 05:52:29.354027 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.354002    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/80acb3ad-1857-4936-a350-1c682d82b2e6-config-out" (OuterVolumeSpecName: "config-out") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 05:52:29.354897 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.354863    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 05:52:29.358538 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.358445    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 05:52:29.358538 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.358449    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80acb3ad-1857-4936-a350-1c682d82b2e6-kube-api-access-4k82t" (OuterVolumeSpecName: "kube-api-access-4k82t") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "kube-api-access-4k82t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 05:52:29.358538 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.358494    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 05:52:29.358768 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.358622    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 05:52:29.358768 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.358740    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 05:52:29.358876 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.358800    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-config" (OuterVolumeSpecName: "config") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 05:52:29.358959 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.358939    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 05:52:29.359124 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.359102    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80acb3ad-1857-4936-a350-1c682d82b2e6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 05:52:29.369506 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.369469    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-web-config" (OuterVolumeSpecName: "web-config") pod "80acb3ad-1857-4936-a350-1c682d82b2e6" (UID: "80acb3ad-1857-4936-a350-1c682d82b2e6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 05:52:29.452037 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.451996    2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80acb3ad-1857-4936-a350-1c682d82b2e6-tls-assets\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452037 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452031    2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-metrics-client-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452046    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452061    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452074    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452086    2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-web-config\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452097    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-metrics-client-ca\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452108    2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452119    2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-grpc-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452130    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452141    2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452153    2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80acb3ad-1857-4936-a350-1c682d82b2e6-config-out\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452165    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452176    2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/80acb3ad-1857-4936-a350-1c682d82b2e6-prometheus-k8s-db\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452188    2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-secret-kube-rbac-proxy\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452199    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4k82t\" (UniqueName: \"kubernetes.io/projected/80acb3ad-1857-4936-a350-1c682d82b2e6-kube-api-access-4k82t\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452213    2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/80acb3ad-1857-4936-a350-1c682d82b2e6-config\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:29.452260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:29.452224    2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80acb3ad-1857-4936-a350-1c682d82b2e6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:52:30.264798 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.264760    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"80acb3ad-1857-4936-a350-1c682d82b2e6","Type":"ContainerDied","Data":"601c06e3fce2d872c558f57115fdaacf1493eb2377f97b5c45b1c6539c962371"}
Sep 09 05:52:30.264798 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.264784    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.265307 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.264839    2583 scope.go:117] "RemoveContainer" containerID="43e728ed68b3f45fe37a04037f5db0e8d7c251b145a87f058e6312b92e561935"
Sep 09 05:52:30.273135 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.273100    2583 scope.go:117] "RemoveContainer" containerID="e269d6a6717fd173efba8b46fbe3e55fe2ab9924f0da73042f070bf339c34eac"
Sep 09 05:52:30.280301 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.280284    2583 scope.go:117] "RemoveContainer" containerID="591534b950fa5dba27a566aceaba42890e417090172945993bada7ae185a5bba"
Sep 09 05:52:30.286815 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.286797    2583 scope.go:117] "RemoveContainer" containerID="8a7887456034f966132a6d063b84a564ef18d33384a5063cdce27a1337483964"
Sep 09 05:52:30.289201 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.289179    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 05:52:30.294308 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.294241    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 05:52:30.294370 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.294346    2583 scope.go:117] "RemoveContainer" containerID="be07dd5b1bb8fd8cf304caf514cb9bb09584b18c3b68a3b8e4482e899e350542"
Sep 09 05:52:30.300863 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.300847    2583 scope.go:117] "RemoveContainer" containerID="c9e6fa314694bfcfdc6fcf09eb464d6a2f0fab5f0fe38852504707f5f05da3e6"
Sep 09 05:52:30.307730 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.307714    2583 scope.go:117] "RemoveContainer" containerID="fb4150f3bf1dced514a100d5f9a94ec4178591348d4c67cb22835c50b696db0e"
Sep 09 05:52:30.320516 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320496    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 05:52:30.320789 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320777    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="init-config-reloader"
Sep 09 05:52:30.320830 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320792    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="init-config-reloader"
Sep 09 05:52:30.320830 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320806    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="thanos-sidecar"
Sep 09 05:52:30.320830 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320811    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="thanos-sidecar"
Sep 09 05:52:30.320830 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320821    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="kube-rbac-proxy-thanos"
Sep 09 05:52:30.320830 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320826    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="kube-rbac-proxy-thanos"
Sep 09 05:52:30.320972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320835    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="prometheus"
Sep 09 05:52:30.320972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320841    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="prometheus"
Sep 09 05:52:30.320972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320846    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="kube-rbac-proxy-web"
Sep 09 05:52:30.320972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320850    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="kube-rbac-proxy-web"
Sep 09 05:52:30.320972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320856    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="kube-rbac-proxy"
Sep 09 05:52:30.320972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320861    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="kube-rbac-proxy"
Sep 09 05:52:30.320972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320869    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="config-reloader"
Sep 09 05:52:30.320972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320873    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="config-reloader"
Sep 09 05:52:30.320972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320915    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="kube-rbac-proxy"
Sep 09 05:52:30.320972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320925    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="kube-rbac-proxy-thanos"
Sep 09 05:52:30.320972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320932    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="thanos-sidecar"
Sep 09 05:52:30.320972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320938    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="prometheus"
Sep 09 05:52:30.320972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320943    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="config-reloader"
Sep 09 05:52:30.320972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.320947    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" containerName="kube-rbac-proxy-web"
Sep 09 05:52:30.324434 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.324418    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.326932 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.326895    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 09 05:52:30.327009 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.326979    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 09 05:52:30.327268 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.327246    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 09 05:52:30.327433 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.327280    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 09 05:52:30.327433 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.327406    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ccgh7kjlo89jo\""
Sep 09 05:52:30.327433 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.327419    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 09 05:52:30.327746 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.327542    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 09 05:52:30.327746 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.327547    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 09 05:52:30.327746 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.327649    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 09 05:52:30.327746 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.327660    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 09 05:52:30.328107 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.327783    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 09 05:52:30.328107 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.327800    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wzgnm\""
Sep 09 05:52:30.328107 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.327922    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 09 05:52:30.328317 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.328130    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 09 05:52:30.328317 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.328210    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 09 05:52:30.331362 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.331287    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 09 05:52:30.341351 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.341300    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 09 05:52:30.343597 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.343574    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 05:52:30.360031 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360009    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360135 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360036    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360135 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360059    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmgb6\" (UniqueName: \"kubernetes.io/projected/0cb0e7f7-1756-4556-9f20-902926f20faf-kube-api-access-kmgb6\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360135 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360075    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360135 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360100    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360257 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360181    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360257 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360218    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cb0e7f7-1756-4556-9f20-902926f20faf-config-out\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360257 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360235    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360348 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360288    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360348 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360317    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-config\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360348 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360333    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360434 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360364    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360434 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360380    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360434 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360434 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360429    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360550 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360448    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cb0e7f7-1756-4556-9f20-902926f20faf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360550 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360465    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360550 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360479    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360550 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360499    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.360550 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.360513    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-web-config\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.461489 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461418    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-config\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.461489 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461489    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.461781 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.461781 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461539    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.461781 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.461781 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461601    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.461781 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461619    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cb0e7f7-1756-4556-9f20-902926f20faf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.461781 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461647    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.461781 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461669    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.461781 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461704    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.461781 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-web-config\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.461781 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461754    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.461781 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.462298 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461808    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmgb6\" (UniqueName: \"kubernetes.io/projected/0cb0e7f7-1756-4556-9f20-902926f20faf-kube-api-access-kmgb6\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.462298 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461833    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.462298 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461856    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.462298 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461892    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.462298 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461936    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cb0e7f7-1756-4556-9f20-902926f20faf-config-out\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.462298 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461959    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.462298 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.461991    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.462827 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.462365    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.462827 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.462690    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.464865 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.464783    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.465196 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.465039    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.465196 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.465084    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-config\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.465366 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.465256    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0cb0e7f7-1756-4556-9f20-902926f20faf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.465469 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.465421    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.466348 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.465970    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.466348 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.466067    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.466348 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.466076    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.466583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.466480    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.466583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.466488    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.466758 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.466716    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.467057 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.467032    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.467265 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.467242    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0cb0e7f7-1756-4556-9f20-902926f20faf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.468008 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.467981    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-web-config\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.468132 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.468111    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0cb0e7f7-1756-4556-9f20-902926f20faf-config-out\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.468996 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.468972    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.469194 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.469177    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0cb0e7f7-1756-4556-9f20-902926f20faf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.472729 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.472703    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmgb6\" (UniqueName: \"kubernetes.io/projected/0cb0e7f7-1756-4556-9f20-902926f20faf-kube-api-access-kmgb6\") pod \"prometheus-k8s-0\" (UID: \"0cb0e7f7-1756-4556-9f20-902926f20faf\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.639493 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.639453    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:30.933446 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:30.933422    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 09 05:52:30.935752 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:52:30.935723    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb0e7f7_1756_4556_9f20_902926f20faf.slice/crio-0c8e7c7de0ed33ae0d61017af589246e12999333daea80d3fcbe08306fdd664e WatchSource:0}: Error finding container 0c8e7c7de0ed33ae0d61017af589246e12999333daea80d3fcbe08306fdd664e: Status 404 returned error can't find the container with id 0c8e7c7de0ed33ae0d61017af589246e12999333daea80d3fcbe08306fdd664e
Sep 09 05:52:31.243092 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:31.243000    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80acb3ad-1857-4936-a350-1c682d82b2e6" path="/var/lib/kubelet/pods/80acb3ad-1857-4936-a350-1c682d82b2e6/volumes"
Sep 09 05:52:31.270030 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:31.269997    2583 generic.go:356] "Generic (PLEG): container finished" podID="0cb0e7f7-1756-4556-9f20-902926f20faf" containerID="eba26b9daff476b982b48d48f3d687005722a83e7f663a28259f6b45339d3f30" exitCode=0
Sep 09 05:52:31.270491 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:31.270091    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cb0e7f7-1756-4556-9f20-902926f20faf","Type":"ContainerDied","Data":"eba26b9daff476b982b48d48f3d687005722a83e7f663a28259f6b45339d3f30"}
Sep 09 05:52:31.270491 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:31.270188    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cb0e7f7-1756-4556-9f20-902926f20faf","Type":"ContainerStarted","Data":"0c8e7c7de0ed33ae0d61017af589246e12999333daea80d3fcbe08306fdd664e"}
Sep 09 05:52:32.279938 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:32.279897    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cb0e7f7-1756-4556-9f20-902926f20faf","Type":"ContainerStarted","Data":"5748330114ff24e343b58ecc429d38cff1de7bbf741e0d7b7cc1e79573c4ed94"}
Sep 09 05:52:32.280348 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:32.279976    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cb0e7f7-1756-4556-9f20-902926f20faf","Type":"ContainerStarted","Data":"d7d5680e2b4579c4ae2bcfe92ce830d01112df72053408ea2fe7804667d0848f"}
Sep 09 05:52:32.280348 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:32.280017    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cb0e7f7-1756-4556-9f20-902926f20faf","Type":"ContainerStarted","Data":"d4931a51aa582f94bbacff79edf0ef221c3c127359989908938d00ee56a6abb5"}
Sep 09 05:52:32.280348 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:32.280057    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cb0e7f7-1756-4556-9f20-902926f20faf","Type":"ContainerStarted","Data":"c86175b0d2c6aad658893197a7db5cddb36432bed91a839cce0b072295f63578"}
Sep 09 05:52:32.280348 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:32.280098    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cb0e7f7-1756-4556-9f20-902926f20faf","Type":"ContainerStarted","Data":"5330c996b028ec75baacf99e23765b81a22e57b5536cfb18937c742632a3f6b5"}
Sep 09 05:52:32.280348 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:32.280136    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0cb0e7f7-1756-4556-9f20-902926f20faf","Type":"ContainerStarted","Data":"a43393ac35e1c52c3d293d1d5db3891587e1de3af551c58d5159172b1cb840af"}
Sep 09 05:52:32.305804 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:32.305737    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.287139599 podStartE2EDuration="2.30571542s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.575821ms" isStatefulPod=false podCreationTimestamp="2026-09-09 05:52:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:52:32.304619838 +0000 UTC m=+173.535116392" watchObservedRunningTime="2026-09-09 05:52:32.30571542 +0000 UTC m=+173.536211972"
Sep 09 05:52:32.494410 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:32.494344    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:52:32.596344 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:32.596224    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:52:35.640306 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:35.640266    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:52:36.700888 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:36.700842    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:52:36.799698 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:36.799637    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:52:39.353870 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:52:39.353819    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:53:08.855725 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:53:08.855691    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:53:08.910649 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:53:08.910611    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:53:11.141436 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:53:11.141400    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:53:30.640705 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:53:30.640667    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:53:30.656326 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:53:30.656301    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:53:31.529017 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:53:31.528989    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 09 05:53:36.930081 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:53:36.930045    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:53:37.428304 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:53:37.428264    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:53:37.526341 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:53:37.526309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:53:59.233034 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:53:59.232985    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:00.570663 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:00.570580    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:02.831575 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:02.831534    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:02.889091 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:02.889055    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:04.745788 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:04.745747    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:04.844165 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:04.844130    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:05.003825 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:05.003746    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:05.107651 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:05.107621    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:06.923232 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:06.923196    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:07.335337 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:07.335256    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:09.830752 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:09.830722    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:09.930912 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:09.930880    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:14.744769 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:14.744738    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:17.502374 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:17.502342    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:17.601825 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:17.601731    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:26.396256 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:26.396227    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:26.497613 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:26.497579    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:28.081926 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:28.081891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:39.162725 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:39.162697    2583 kubelet.go:1648] "Image garbage collection succeeded"
Sep 09 05:54:41.272842 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:41.272806    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:42.306200 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.306164    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"]
Sep 09 05:54:42.309422 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.309404    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.311944 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.311922    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 09 05:54:42.312869 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.312846    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 09 05:54:42.312975 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.312885    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xfnz9\""
Sep 09 05:54:42.312975 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.312919    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 09 05:54:42.312975 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.312960    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 09 05:54:42.326850 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.326827    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"]
Sep 09 05:54:42.359968 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.359943    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/908b7ec4-5401-4db5-b267-e310f344741c-tmp\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.360104 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.359974    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/908b7ec4-5401-4db5-b267-e310f344741c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.360104 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.360013    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/908b7ec4-5401-4db5-b267-e310f344741c-webhook-cert\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.360104 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.360057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/908b7ec4-5401-4db5-b267-e310f344741c-manifests\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.360104 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.360079    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqq4w\" (UniqueName: \"kubernetes.io/projected/908b7ec4-5401-4db5-b267-e310f344741c-kube-api-access-lqq4w\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.461123 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.461088    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/908b7ec4-5401-4db5-b267-e310f344741c-tmp\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.461123 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.461132    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/908b7ec4-5401-4db5-b267-e310f344741c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.461374 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.461184    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/908b7ec4-5401-4db5-b267-e310f344741c-webhook-cert\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.461374 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.461229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/908b7ec4-5401-4db5-b267-e310f344741c-manifests\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.461374 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.461265    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqq4w\" (UniqueName: \"kubernetes.io/projected/908b7ec4-5401-4db5-b267-e310f344741c-kube-api-access-lqq4w\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.461647 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.461623    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/908b7ec4-5401-4db5-b267-e310f344741c-manifests\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.463769 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.463748    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/908b7ec4-5401-4db5-b267-e310f344741c-webhook-cert\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.463869 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.463768    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/908b7ec4-5401-4db5-b267-e310f344741c-tmp\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.463931 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.463916    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/908b7ec4-5401-4db5-b267-e310f344741c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.469054 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.469030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqq4w\" (UniqueName: \"kubernetes.io/projected/908b7ec4-5401-4db5-b267-e310f344741c-kube-api-access-lqq4w\") pod \"opendatahub-operator-controller-manager-76b47fccc7-7s9fj\" (UID: \"908b7ec4-5401-4db5-b267-e310f344741c\") " pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.618722 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.618688    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:42.734703 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.734669    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:42.794414 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.794377    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:42.857761 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.857728    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:42.895806 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.895766    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"]
Sep 09 05:54:42.898874 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:54:42.898841    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod908b7ec4_5401_4db5_b267_e310f344741c.slice/crio-883011dcb55a2c71f40d73d72a7376bcd48e7c7bcccfc756a98de0f2c149a82a WatchSource:0}: Error finding container 883011dcb55a2c71f40d73d72a7376bcd48e7c7bcccfc756a98de0f2c149a82a: Status 404 returned error can't find the container with id 883011dcb55a2c71f40d73d72a7376bcd48e7c7bcccfc756a98de0f2c149a82a
Sep 09 05:54:42.901001 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.900979    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 05:54:42.976984 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:42.976948    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:43.082136 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:43.082109    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:43.798018 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:43.797977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj" event={"ID":"908b7ec4-5401-4db5-b267-e310f344741c","Type":"ContainerStarted","Data":"883011dcb55a2c71f40d73d72a7376bcd48e7c7bcccfc756a98de0f2c149a82a"}
Sep 09 05:54:46.813869 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:46.813831    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj" event={"ID":"908b7ec4-5401-4db5-b267-e310f344741c","Type":"ContainerStarted","Data":"2c75f6bc2bc6090d3d25a8dd9ca212df32132bb566af6e612e0e1b26a4e1d7c0"}
Sep 09 05:54:47.819379 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:47.819348    2583 generic.go:356] "Generic (PLEG): container finished" podID="908b7ec4-5401-4db5-b267-e310f344741c" containerID="2c75f6bc2bc6090d3d25a8dd9ca212df32132bb566af6e612e0e1b26a4e1d7c0" exitCode=0
Sep 09 05:54:47.819804 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:47.819417    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj" event={"ID":"908b7ec4-5401-4db5-b267-e310f344741c","Type":"ContainerDied","Data":"2c75f6bc2bc6090d3d25a8dd9ca212df32132bb566af6e612e0e1b26a4e1d7c0"}
Sep 09 05:54:48.825933 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:48.825890    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj" event={"ID":"908b7ec4-5401-4db5-b267-e310f344741c","Type":"ContainerStarted","Data":"a3e97035304635eb549b4f55dee18c8c052569af87da477595c6c7c5b4979e8f"}
Sep 09 05:54:48.826415 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:48.826027    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:54:48.847994 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:48.847947    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj" podStartSLOduration=2.624417292 podStartE2EDuration="6.847930795s" totalImagesPullingTime="3.221656052s" totalInitContainerRuntime="1.001857451s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:54:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:54:48.847320804 +0000 UTC m=+310.077817356" watchObservedRunningTime="2026-09-09 05:54:48.847930795 +0000 UTC m=+310.078427347"
Sep 09 05:54:54.465451 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:54.465414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:54.573178 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:54.573143    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:54.817754 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:54.817672    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:54.913660 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:54.913629    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:59.008460 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:59.008422    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:59.107754 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:59.107720    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:54:59.833620 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:54:59.833590    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-76b47fccc7-7s9fj"
Sep 09 05:55:01.398370 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:01.398330    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:01.550721 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:01.550684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:01.756391 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:01.756309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:01.972583 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:01.972527    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:03.149841 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:03.149806    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:03.248448 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:03.248418    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:04.079726 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:04.079689    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:04.942733 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:04.942702    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:05.018657 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:05.018623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:08.409629 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:08.409598    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:08.513197 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:08.513166    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:09.104400 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:09.104355    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:09.204276 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:09.204247    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:09.303397 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:09.303362    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:12.426778 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.426740    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:12.510704 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.510672    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:12.641854 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.641815    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:12.740317 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.740219    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:12.771992 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.771958    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-74vf8"]
Sep 09 05:55:12.775311 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.775291    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-74vf8"
Sep 09 05:55:12.777725 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.777703    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-9f6pv\""
Sep 09 05:55:12.777859 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.777730    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 09 05:55:12.784750 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.784730    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-74vf8"]
Sep 09 05:55:12.820912 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.820884    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnnm9\" (UniqueName: \"kubernetes.io/projected/6376d560-5033-40ae-83f4-ac49af8b44a1-kube-api-access-vnnm9\") pod \"model-serving-api-54d89bd5fc-74vf8\" (UID: \"6376d560-5033-40ae-83f4-ac49af8b44a1\") " pod="opendatahub/model-serving-api-54d89bd5fc-74vf8"
Sep 09 05:55:12.821035 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.820932    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6376d560-5033-40ae-83f4-ac49af8b44a1-tls-certs\") pod \"model-serving-api-54d89bd5fc-74vf8\" (UID: \"6376d560-5033-40ae-83f4-ac49af8b44a1\") " pod="opendatahub/model-serving-api-54d89bd5fc-74vf8"
Sep 09 05:55:12.893691 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.893652    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:12.921790 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.921761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnnm9\" (UniqueName: \"kubernetes.io/projected/6376d560-5033-40ae-83f4-ac49af8b44a1-kube-api-access-vnnm9\") pod \"model-serving-api-54d89bd5fc-74vf8\" (UID: \"6376d560-5033-40ae-83f4-ac49af8b44a1\") " pod="opendatahub/model-serving-api-54d89bd5fc-74vf8"
Sep 09 05:55:12.921906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.921815    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6376d560-5033-40ae-83f4-ac49af8b44a1-tls-certs\") pod \"model-serving-api-54d89bd5fc-74vf8\" (UID: \"6376d560-5033-40ae-83f4-ac49af8b44a1\") " pod="opendatahub/model-serving-api-54d89bd5fc-74vf8"
Sep 09 05:55:12.924416 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.924386    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6376d560-5033-40ae-83f4-ac49af8b44a1-tls-certs\") pod \"model-serving-api-54d89bd5fc-74vf8\" (UID: \"6376d560-5033-40ae-83f4-ac49af8b44a1\") " pod="opendatahub/model-serving-api-54d89bd5fc-74vf8"
Sep 09 05:55:12.929616 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:12.929586    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnnm9\" (UniqueName: \"kubernetes.io/projected/6376d560-5033-40ae-83f4-ac49af8b44a1-kube-api-access-vnnm9\") pod \"model-serving-api-54d89bd5fc-74vf8\" (UID: \"6376d560-5033-40ae-83f4-ac49af8b44a1\") " pod="opendatahub/model-serving-api-54d89bd5fc-74vf8"
Sep 09 05:55:13.085979 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:13.085893    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-74vf8"
Sep 09 05:55:13.356014 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:13.355992    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-74vf8"]
Sep 09 05:55:13.357944 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:55:13.357909    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6376d560_5033_40ae_83f4_ac49af8b44a1.slice/crio-87c0b138e3cf61fcf8bfec4bee1d00d3f363b7108561e6d2e244c14c51fe711e WatchSource:0}: Error finding container 87c0b138e3cf61fcf8bfec4bee1d00d3f363b7108561e6d2e244c14c51fe711e: Status 404 returned error can't find the container with id 87c0b138e3cf61fcf8bfec4bee1d00d3f363b7108561e6d2e244c14c51fe711e
Sep 09 05:55:13.934506 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:13.934470    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-74vf8" event={"ID":"6376d560-5033-40ae-83f4-ac49af8b44a1","Type":"ContainerStarted","Data":"87c0b138e3cf61fcf8bfec4bee1d00d3f363b7108561e6d2e244c14c51fe711e"}
Sep 09 05:55:15.944427 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:15.944392    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-74vf8" event={"ID":"6376d560-5033-40ae-83f4-ac49af8b44a1","Type":"ContainerStarted","Data":"ebccc4790eaacfdf8018234d4b6a326c082708ca2f1af17d7a44a0f292cc9814"}
Sep 09 05:55:15.944849 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:15.944533    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-74vf8"
Sep 09 05:55:15.961048 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:15.961000    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-74vf8" podStartSLOduration=1.5659169720000001 podStartE2EDuration="3.960985984s" totalImagesPullingTime="2.395069012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:55:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:55:15.959357337 +0000 UTC m=+337.189853889" watchObservedRunningTime="2026-09-09 05:55:15.960985984 +0000 UTC m=+337.191482532"
Sep 09 05:55:19.889311 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:19.889277    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"]
Sep 09 05:55:19.892772 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:19.892753    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:19.896192 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:19.896164    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 09 05:55:19.896192 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:19.896180    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 09 05:55:19.896381 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:19.896230    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 09 05:55:19.896381 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:19.896230    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 09 05:55:19.896381 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:19.896287    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 09 05:55:19.896543 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:19.896534    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zn2ts\""
Sep 09 05:55:19.901760 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:19.901737    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"]
Sep 09 05:55:19.983570 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:19.983522    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4-manager-config\") pod \"lws-controller-manager-58b7d76c47-scszn\" (UID: \"fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4\") " pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:19.983726 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:19.983577    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4-cert\") pod \"lws-controller-manager-58b7d76c47-scszn\" (UID: \"fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4\") " pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:19.983726 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:19.983652    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zntzn\" (UniqueName: \"kubernetes.io/projected/fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4-kube-api-access-zntzn\") pod \"lws-controller-manager-58b7d76c47-scszn\" (UID: \"fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4\") " pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:19.983726 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:19.983700    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4-metrics-cert\") pod \"lws-controller-manager-58b7d76c47-scszn\" (UID: \"fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4\") " pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:20.084167 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:20.084130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4-manager-config\") pod \"lws-controller-manager-58b7d76c47-scszn\" (UID: \"fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4\") " pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:20.084339 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:20.084174    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4-cert\") pod \"lws-controller-manager-58b7d76c47-scszn\" (UID: \"fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4\") " pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:20.084339 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:20.084222    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zntzn\" (UniqueName: \"kubernetes.io/projected/fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4-kube-api-access-zntzn\") pod \"lws-controller-manager-58b7d76c47-scszn\" (UID: \"fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4\") " pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:20.084339 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:20.084274    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4-metrics-cert\") pod \"lws-controller-manager-58b7d76c47-scszn\" (UID: \"fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4\") " pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:20.084870 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:20.084846    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4-manager-config\") pod \"lws-controller-manager-58b7d76c47-scszn\" (UID: \"fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4\") " pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:20.086744 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:20.086723    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4-cert\") pod \"lws-controller-manager-58b7d76c47-scszn\" (UID: \"fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4\") " pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:20.086832 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:20.086817    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4-metrics-cert\") pod \"lws-controller-manager-58b7d76c47-scszn\" (UID: \"fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4\") " pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:20.096928 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:20.096901    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zntzn\" (UniqueName: \"kubernetes.io/projected/fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4-kube-api-access-zntzn\") pod \"lws-controller-manager-58b7d76c47-scszn\" (UID: \"fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4\") " pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:20.202781 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:20.202691    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:20.502097 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:20.502059    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"]
Sep 09 05:55:20.504353 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:55:20.504328    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc072d9e_a9cc_4d31_90a2_ac6d923ea8c4.slice/crio-70ebf83a776ab7fc60a335c8ebb4bb15c01b0a14d2a0a26fb133e0cd35373ec2 WatchSource:0}: Error finding container 70ebf83a776ab7fc60a335c8ebb4bb15c01b0a14d2a0a26fb133e0cd35373ec2: Status 404 returned error can't find the container with id 70ebf83a776ab7fc60a335c8ebb4bb15c01b0a14d2a0a26fb133e0cd35373ec2
Sep 09 05:55:20.965996 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:20.965955    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn" event={"ID":"fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4","Type":"ContainerStarted","Data":"70ebf83a776ab7fc60a335c8ebb4bb15c01b0a14d2a0a26fb133e0cd35373ec2"}
Sep 09 05:55:21.480500 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.480467    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:21.550404 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.550367    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg"]
Sep 09 05:55:21.555158 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.555134    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg"
Sep 09 05:55:21.557817 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.557797    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 09 05:55:21.558029 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.557948    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-77g9j\""
Sep 09 05:55:21.572204 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.572181    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg"]
Sep 09 05:55:21.574278 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.574255    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb"]
Sep 09 05:55:21.577731 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.577708    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb"
Sep 09 05:55:21.578822 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.578798    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:21.581719 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.581697    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8lcwb\""
Sep 09 05:55:21.581816 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.581727    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 09 05:55:21.591210 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.591145    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb"]
Sep 09 05:55:21.595787 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.595763    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwckw\" (UniqueName: \"kubernetes.io/projected/1402266c-f0cf-46a2-97a3-57397f8c6571-kube-api-access-zwckw\") pod \"llmisvc-controller-manager-777c6bd7d5-kt2fb\" (UID: \"1402266c-f0cf-46a2-97a3-57397f8c6571\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb"
Sep 09 05:55:21.595905 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.595816    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1402266c-f0cf-46a2-97a3-57397f8c6571-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kt2fb\" (UID: \"1402266c-f0cf-46a2-97a3-57397f8c6571\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb"
Sep 09 05:55:21.595905 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.595843    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bb4a39c-2202-44d4-891a-7f9fa327147b-cert\") pod \"kserve-controller-manager-d6f4b65b8-d6ctg\" (UID: \"8bb4a39c-2202-44d4-891a-7f9fa327147b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg"
Sep 09 05:55:21.595905 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.595891    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6d7k\" (UniqueName: \"kubernetes.io/projected/8bb4a39c-2202-44d4-891a-7f9fa327147b-kube-api-access-x6d7k\") pod \"kserve-controller-manager-d6f4b65b8-d6ctg\" (UID: \"8bb4a39c-2202-44d4-891a-7f9fa327147b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg"
Sep 09 05:55:21.653039 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.653008    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:21.697033 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.696998    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwckw\" (UniqueName: \"kubernetes.io/projected/1402266c-f0cf-46a2-97a3-57397f8c6571-kube-api-access-zwckw\") pod \"llmisvc-controller-manager-777c6bd7d5-kt2fb\" (UID: \"1402266c-f0cf-46a2-97a3-57397f8c6571\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb"
Sep 09 05:55:21.697221 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.697085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1402266c-f0cf-46a2-97a3-57397f8c6571-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kt2fb\" (UID: \"1402266c-f0cf-46a2-97a3-57397f8c6571\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb"
Sep 09 05:55:21.697221 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.697114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bb4a39c-2202-44d4-891a-7f9fa327147b-cert\") pod \"kserve-controller-manager-d6f4b65b8-d6ctg\" (UID: \"8bb4a39c-2202-44d4-891a-7f9fa327147b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg"
Sep 09 05:55:21.697221 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.697176    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6d7k\" (UniqueName: \"kubernetes.io/projected/8bb4a39c-2202-44d4-891a-7f9fa327147b-kube-api-access-x6d7k\") pod \"kserve-controller-manager-d6f4b65b8-d6ctg\" (UID: \"8bb4a39c-2202-44d4-891a-7f9fa327147b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg"
Sep 09 05:55:21.697376 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:55:21.697258    2583 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 09 05:55:21.697427 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:55:21.697397    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bb4a39c-2202-44d4-891a-7f9fa327147b-cert podName:8bb4a39c-2202-44d4-891a-7f9fa327147b nodeName:}" failed. No retries permitted until 2026-09-09 05:55:22.197318866 +0000 UTC m=+343.427815396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8bb4a39c-2202-44d4-891a-7f9fa327147b-cert") pod "kserve-controller-manager-d6f4b65b8-d6ctg" (UID: "8bb4a39c-2202-44d4-891a-7f9fa327147b") : secret "kserve-webhook-server-cert" not found
Sep 09 05:55:21.700107 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.700075    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1402266c-f0cf-46a2-97a3-57397f8c6571-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kt2fb\" (UID: \"1402266c-f0cf-46a2-97a3-57397f8c6571\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb"
Sep 09 05:55:21.709965 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.709794    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwckw\" (UniqueName: \"kubernetes.io/projected/1402266c-f0cf-46a2-97a3-57397f8c6571-kube-api-access-zwckw\") pod \"llmisvc-controller-manager-777c6bd7d5-kt2fb\" (UID: \"1402266c-f0cf-46a2-97a3-57397f8c6571\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb"
Sep 09 05:55:21.719247 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.719173    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6d7k\" (UniqueName: \"kubernetes.io/projected/8bb4a39c-2202-44d4-891a-7f9fa327147b-kube-api-access-x6d7k\") pod \"kserve-controller-manager-d6f4b65b8-d6ctg\" (UID: \"8bb4a39c-2202-44d4-891a-7f9fa327147b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg"
Sep 09 05:55:21.737295 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.737222    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:21.888135 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:21.888091    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb"
Sep 09 05:55:22.132230 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:22.132199    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:22.157721 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:22.157699    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb"]
Sep 09 05:55:22.159629 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:55:22.159605    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1402266c_f0cf_46a2_97a3_57397f8c6571.slice/crio-1fd1029c1951ee7cf958842fd0adaa7522d6027a019f2aa4b158a805ff666e81 WatchSource:0}: Error finding container 1fd1029c1951ee7cf958842fd0adaa7522d6027a019f2aa4b158a805ff666e81: Status 404 returned error can't find the container with id 1fd1029c1951ee7cf958842fd0adaa7522d6027a019f2aa4b158a805ff666e81
Sep 09 05:55:22.202548 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:22.202520    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bb4a39c-2202-44d4-891a-7f9fa327147b-cert\") pod \"kserve-controller-manager-d6f4b65b8-d6ctg\" (UID: \"8bb4a39c-2202-44d4-891a-7f9fa327147b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg"
Sep 09 05:55:22.204936 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:22.204918    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bb4a39c-2202-44d4-891a-7f9fa327147b-cert\") pod \"kserve-controller-manager-d6f4b65b8-d6ctg\" (UID: \"8bb4a39c-2202-44d4-891a-7f9fa327147b\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg"
Sep 09 05:55:22.465776 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:22.465678    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg"
Sep 09 05:55:22.742056 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:22.741984    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg"]
Sep 09 05:55:22.744797 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:55:22.744756    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb4a39c_2202_44d4_891a_7f9fa327147b.slice/crio-90a3b8ab7020c900f341f49ccc6952f3c91225297ee1fed3f5a7785efad479e3 WatchSource:0}: Error finding container 90a3b8ab7020c900f341f49ccc6952f3c91225297ee1fed3f5a7785efad479e3: Status 404 returned error can't find the container with id 90a3b8ab7020c900f341f49ccc6952f3c91225297ee1fed3f5a7785efad479e3
Sep 09 05:55:22.763257 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:22.763231    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:22.861780 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:22.861709    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:22.964912 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:22.964878    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:22.975918 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:22.975885    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb" event={"ID":"1402266c-f0cf-46a2-97a3-57397f8c6571","Type":"ContainerStarted","Data":"1fd1029c1951ee7cf958842fd0adaa7522d6027a019f2aa4b158a805ff666e81"}
Sep 09 05:55:22.977139 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:22.977117    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg" event={"ID":"8bb4a39c-2202-44d4-891a-7f9fa327147b","Type":"ContainerStarted","Data":"90a3b8ab7020c900f341f49ccc6952f3c91225297ee1fed3f5a7785efad479e3"}
Sep 09 05:55:26.953745 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:26.953703    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-74vf8"
Sep 09 05:55:27.000237 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:27.000203    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn" event={"ID":"fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4","Type":"ContainerStarted","Data":"30bea8962ad25ed08df7bfd20fdefbd6a86ebf9982961339c3f249ca4e1ce1e0"}
Sep 09 05:55:27.000426 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:27.000311    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:27.002082 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:27.002055    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb" event={"ID":"1402266c-f0cf-46a2-97a3-57397f8c6571","Type":"ContainerStarted","Data":"b347af0420de0120a8fb5d99fc552fc4723aa23180f6b2f7bc00e26be204ce7f"}
Sep 09 05:55:27.002199 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:27.002108    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb"
Sep 09 05:55:27.003923 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:27.003898    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg" event={"ID":"8bb4a39c-2202-44d4-891a-7f9fa327147b","Type":"ContainerStarted","Data":"c8051d1371695bf9941922908833eaba2a3a56029d5114bb16c2aa1d2ff3a4a0"}
Sep 09 05:55:27.004059 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:27.004044    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg"
Sep 09 05:55:27.033345 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:27.033176    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn" podStartSLOduration=1.889376425 podStartE2EDuration="8.033156268s" totalImagesPullingTime="6.143779843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:55:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:55:27.032327225 +0000 UTC m=+348.262823791" watchObservedRunningTime="2026-09-09 05:55:27.033156268 +0000 UTC m=+348.263652822"
Sep 09 05:55:27.088759 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:27.088699    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb" podStartSLOduration=1.608941258 podStartE2EDuration="6.088679759s" totalImagesPullingTime="4.479738501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:55:27.087482349 +0000 UTC m=+348.317978901" watchObservedRunningTime="2026-09-09 05:55:27.088679759 +0000 UTC m=+348.319176312"
Sep 09 05:55:27.089568 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:27.089516    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg" podStartSLOduration=2.191547787 podStartE2EDuration="6.08950628s" totalImagesPullingTime="3.897958493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:55:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:55:27.065685463 +0000 UTC m=+348.296182014" watchObservedRunningTime="2026-09-09 05:55:27.08950628 +0000 UTC m=+348.320002826"
Sep 09 05:55:38.010707 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:38.010625    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58b7d76c47-scszn"
Sep 09 05:55:47.882489 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:47.882451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:47.941101 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:47.941066    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:58.010429 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:58.010390    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kt2fb"
Sep 09 05:55:58.013452 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:58.013427    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d6ctg"
Sep 09 05:55:58.354801 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:58.354715    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:58.454997 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:58.454964    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:55:58.567579 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:55:58.567535    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:13.548972 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:13.548936    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:13.608906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:13.608871    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:26.256959 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:26.256927    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:27.055983 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:27.055953    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:30.114341 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:30.114302    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:30.264503 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:30.264451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:31.741900 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:31.741864    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"]
Sep 09 05:56:31.745152 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:31.745135    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"
Sep 09 05:56:31.747517 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:31.747489    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 09 05:56:31.748347 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:31.748325    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pk8xs\""
Sep 09 05:56:31.748455 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:31.748325    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 09 05:56:31.755943 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:31.755916    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"]
Sep 09 05:56:31.806950 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:31.806914    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnqj5\" (UniqueName: \"kubernetes.io/projected/e934e72d-650e-483d-b0db-f5ee50a06f4b-kube-api-access-rnqj5\") pod \"limitador-operator-controller-manager-74495c69f8-vdl7c\" (UID: \"e934e72d-650e-483d-b0db-f5ee50a06f4b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"
Sep 09 05:56:31.907919 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:31.907880    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnqj5\" (UniqueName: \"kubernetes.io/projected/e934e72d-650e-483d-b0db-f5ee50a06f4b-kube-api-access-rnqj5\") pod \"limitador-operator-controller-manager-74495c69f8-vdl7c\" (UID: \"e934e72d-650e-483d-b0db-f5ee50a06f4b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"
Sep 09 05:56:31.924350 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:31.924320    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnqj5\" (UniqueName: \"kubernetes.io/projected/e934e72d-650e-483d-b0db-f5ee50a06f4b-kube-api-access-rnqj5\") pod \"limitador-operator-controller-manager-74495c69f8-vdl7c\" (UID: \"e934e72d-650e-483d-b0db-f5ee50a06f4b\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"
Sep 09 05:56:32.056670 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:32.056587    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"
Sep 09 05:56:32.311599 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:32.311489    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:32.328447 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:32.328416    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"]
Sep 09 05:56:32.330987 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:56:32.330954    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode934e72d_650e_483d_b0db_f5ee50a06f4b.slice/crio-85a180052612fe431156928a2164ca956adf4772532c8b847ee9e32cd4e8675d WatchSource:0}: Error finding container 85a180052612fe431156928a2164ca956adf4772532c8b847ee9e32cd4e8675d: Status 404 returned error can't find the container with id 85a180052612fe431156928a2164ca956adf4772532c8b847ee9e32cd4e8675d
Sep 09 05:56:32.476354 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:32.476274    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:33.291097 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:33.291012    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c" event={"ID":"e934e72d-650e-483d-b0db-f5ee50a06f4b","Type":"ContainerStarted","Data":"85a180052612fe431156928a2164ca956adf4772532c8b847ee9e32cd4e8675d"}
Sep 09 05:56:34.461028 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:34.460950    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:34.726427 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:34.726350    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:34.851303 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:34.851266    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:35.302872 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:35.302826    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c" event={"ID":"e934e72d-650e-483d-b0db-f5ee50a06f4b","Type":"ContainerStarted","Data":"d408f52e6bbc99cfb27cc194d81b99f604a26ad650facd528a8e12232f48248f"}
Sep 09 05:56:35.303074 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:35.303019    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"
Sep 09 05:56:35.323941 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:35.323889    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c" podStartSLOduration=1.923343115 podStartE2EDuration="4.323871307s" totalImagesPullingTime="2.400528192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:56:35.323626525 +0000 UTC m=+416.554123078" watchObservedRunningTime="2026-09-09 05:56:35.323871307 +0000 UTC m=+416.554367860"
Sep 09 05:56:35.534716 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:35.534684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:36.009271 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:36.009237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:36.108150 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:36.108110    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:40.074004 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:40.073970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:40.173911 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:40.173875    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:40.667610 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:40.667573    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:40.770725 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:40.770687    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:44.070817 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:44.070781    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:44.172268 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:44.172232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:45.669218 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:45.669181    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:45.773323 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:45.773294    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:46.309770 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:46.309743    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"
Sep 09 05:56:47.762961 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:47.762924    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:48.081606 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:48.081495    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:52.112137 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:52.112098    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:52.193298 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:52.193264    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:52.293262 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:52.293228    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:57.592395 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.592356    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"]
Sep 09 05:56:57.595824 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.595806    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"
Sep 09 05:56:57.599200 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.599180    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pm7rx\""
Sep 09 05:56:57.608765 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.608742    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"]
Sep 09 05:56:57.627625 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.627601    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrdln\" (UniqueName: \"kubernetes.io/projected/6329253f-c8cc-43d3-90e8-621c828765eb-kube-api-access-rrdln\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-ph62k\" (UID: \"6329253f-c8cc-43d3-90e8-621c828765eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"
Sep 09 05:56:57.627717 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.627641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6329253f-c8cc-43d3-90e8-621c828765eb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-ph62k\" (UID: \"6329253f-c8cc-43d3-90e8-621c828765eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"
Sep 09 05:56:57.699686 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.699646    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"]
Sep 09 05:56:57.699966 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:56:57.699942    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-rrdln], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k" podUID="6329253f-c8cc-43d3-90e8-621c828765eb"
Sep 09 05:56:57.728469 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.728440    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6329253f-c8cc-43d3-90e8-621c828765eb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-ph62k\" (UID: \"6329253f-c8cc-43d3-90e8-621c828765eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"
Sep 09 05:56:57.728636 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.728500    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrdln\" (UniqueName: \"kubernetes.io/projected/6329253f-c8cc-43d3-90e8-621c828765eb-kube-api-access-rrdln\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-ph62k\" (UID: \"6329253f-c8cc-43d3-90e8-621c828765eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"
Sep 09 05:56:57.728865 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.728843    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6329253f-c8cc-43d3-90e8-621c828765eb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-ph62k\" (UID: \"6329253f-c8cc-43d3-90e8-621c828765eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"
Sep 09 05:56:57.740927 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.740901    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrdln\" (UniqueName: \"kubernetes.io/projected/6329253f-c8cc-43d3-90e8-621c828765eb-kube-api-access-rrdln\") pod \"kuadrant-operator-controller-manager-67c5dcb48c-ph62k\" (UID: \"6329253f-c8cc-43d3-90e8-621c828765eb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"
Sep 09 05:56:57.743179 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.743153    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"]
Sep 09 05:56:57.746619 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.746601    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"
Sep 09 05:56:57.759832 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.759808    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"]
Sep 09 05:56:57.829007 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.828963    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6641fa5a-4b98-463a-96c8-86863d7595e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-tcmj2\" (UID: \"6641fa5a-4b98-463a-96c8-86863d7595e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"
Sep 09 05:56:57.829007 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.829005    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8nn8\" (UniqueName: \"kubernetes.io/projected/6641fa5a-4b98-463a-96c8-86863d7595e1-kube-api-access-s8nn8\") pod \"kuadrant-operator-controller-manager-5f685c496f-tcmj2\" (UID: \"6641fa5a-4b98-463a-96c8-86863d7595e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"
Sep 09 05:56:57.929853 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.929822    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6641fa5a-4b98-463a-96c8-86863d7595e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-tcmj2\" (UID: \"6641fa5a-4b98-463a-96c8-86863d7595e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"
Sep 09 05:56:57.929983 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.929857    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8nn8\" (UniqueName: \"kubernetes.io/projected/6641fa5a-4b98-463a-96c8-86863d7595e1-kube-api-access-s8nn8\") pod \"kuadrant-operator-controller-manager-5f685c496f-tcmj2\" (UID: \"6641fa5a-4b98-463a-96c8-86863d7595e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"
Sep 09 05:56:57.930202 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.930177    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6641fa5a-4b98-463a-96c8-86863d7595e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-tcmj2\" (UID: \"6641fa5a-4b98-463a-96c8-86863d7595e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"
Sep 09 05:56:57.939432 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:57.939408    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8nn8\" (UniqueName: \"kubernetes.io/projected/6641fa5a-4b98-463a-96c8-86863d7595e1-kube-api-access-s8nn8\") pod \"kuadrant-operator-controller-manager-5f685c496f-tcmj2\" (UID: \"6641fa5a-4b98-463a-96c8-86863d7595e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"
Sep 09 05:56:58.057274 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.057240    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"
Sep 09 05:56:58.333781 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.333756    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"]
Sep 09 05:56:58.336350 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:56:58.336321    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6641fa5a_4b98_463a_96c8_86863d7595e1.slice/crio-bac4729d24952b070a1191e7ca0ae35b7e81f15decc27ac84c68626970e8cbf5 WatchSource:0}: Error finding container bac4729d24952b070a1191e7ca0ae35b7e81f15decc27ac84c68626970e8cbf5: Status 404 returned error can't find the container with id bac4729d24952b070a1191e7ca0ae35b7e81f15decc27ac84c68626970e8cbf5
Sep 09 05:56:58.403449 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.403411    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2" event={"ID":"6641fa5a-4b98-463a-96c8-86863d7595e1","Type":"ContainerStarted","Data":"bac4729d24952b070a1191e7ca0ae35b7e81f15decc27ac84c68626970e8cbf5"}
Sep 09 05:56:58.403672 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.403425    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"
Sep 09 05:56:58.411482 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.411458    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"
Sep 09 05:56:58.432970 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.432946    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6329253f-c8cc-43d3-90e8-621c828765eb-extensions-socket-volume\") pod \"6329253f-c8cc-43d3-90e8-621c828765eb\" (UID: \"6329253f-c8cc-43d3-90e8-621c828765eb\") "
Sep 09 05:56:58.433071 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.433001    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrdln\" (UniqueName: \"kubernetes.io/projected/6329253f-c8cc-43d3-90e8-621c828765eb-kube-api-access-rrdln\") pod \"6329253f-c8cc-43d3-90e8-621c828765eb\" (UID: \"6329253f-c8cc-43d3-90e8-621c828765eb\") "
Sep 09 05:56:58.433250 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.433223    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6329253f-c8cc-43d3-90e8-621c828765eb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6329253f-c8cc-43d3-90e8-621c828765eb" (UID: "6329253f-c8cc-43d3-90e8-621c828765eb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 05:56:58.435160 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.435140    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6329253f-c8cc-43d3-90e8-621c828765eb-kube-api-access-rrdln" (OuterVolumeSpecName: "kube-api-access-rrdln") pod "6329253f-c8cc-43d3-90e8-621c828765eb" (UID: "6329253f-c8cc-43d3-90e8-621c828765eb"). InnerVolumeSpecName "kube-api-access-rrdln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 05:56:58.534254 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.534222    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrdln\" (UniqueName: \"kubernetes.io/projected/6329253f-c8cc-43d3-90e8-621c828765eb-kube-api-access-rrdln\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:56:58.534254 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.534249    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6329253f-c8cc-43d3-90e8-621c828765eb-extensions-socket-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:56:58.567720 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.567691    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"]
Sep 09 05:56:58.574381 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.574352    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"]
Sep 09 05:56:58.585058 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.585001    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"]
Sep 09 05:56:58.594836 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.594814    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"]
Sep 09 05:56:58.640384 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.640353    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"]
Sep 09 05:56:58.640633 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.640608    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c" podUID="e934e72d-650e-483d-b0db-f5ee50a06f4b" containerName="manager" containerID="cri-o://d408f52e6bbc99cfb27cc194d81b99f604a26ad650facd528a8e12232f48248f" gracePeriod=2
Sep 09 05:56:58.651261 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.651232    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"]
Sep 09 05:56:58.660395 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:56:58.660335    2583 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"e934e72d-650e-483d-b0db-f5ee50a06f4b\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-vdl7c\": pods \"limitador-operator-controller-manager-74495c69f8-vdl7c\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"
Sep 09 05:56:58.667674 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.667647    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jh7fx"]
Sep 09 05:56:58.668064 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.668046    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e934e72d-650e-483d-b0db-f5ee50a06f4b" containerName="manager"
Sep 09 05:56:58.668064 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.668064    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e934e72d-650e-483d-b0db-f5ee50a06f4b" containerName="manager"
Sep 09 05:56:58.668280 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.668134    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e934e72d-650e-483d-b0db-f5ee50a06f4b" containerName="manager"
Sep 09 05:56:58.671212 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.671193    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jh7fx"
Sep 09 05:56:58.685086 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.685061    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jh7fx"]
Sep 09 05:56:58.735418 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.735379    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbvhm\" (UniqueName: \"kubernetes.io/projected/00e26224-80c2-4c2c-a6b4-560a1f144aab-kube-api-access-zbvhm\") pod \"limitador-operator-controller-manager-74495c69f8-jh7fx\" (UID: \"00e26224-80c2-4c2c-a6b4-560a1f144aab\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jh7fx"
Sep 09 05:56:58.740630 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:56:58.740597    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vdl7c\" is forbidden: User \"system:node:ip-10-0-138-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-92.ec2.internal' and this object" podUID="e934e72d-650e-483d-b0db-f5ee50a06f4b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"
Sep 09 05:56:58.836882 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.836792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbvhm\" (UniqueName: \"kubernetes.io/projected/00e26224-80c2-4c2c-a6b4-560a1f144aab-kube-api-access-zbvhm\") pod \"limitador-operator-controller-manager-74495c69f8-jh7fx\" (UID: \"00e26224-80c2-4c2c-a6b4-560a1f144aab\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jh7fx"
Sep 09 05:56:58.845952 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.845923    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbvhm\" (UniqueName: \"kubernetes.io/projected/00e26224-80c2-4c2c-a6b4-560a1f144aab-kube-api-access-zbvhm\") pod \"limitador-operator-controller-manager-74495c69f8-jh7fx\" (UID: \"00e26224-80c2-4c2c-a6b4-560a1f144aab\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jh7fx"
Sep 09 05:56:58.885406 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.885382    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"
Sep 09 05:56:58.887804 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:56:58.887779    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vdl7c\" is forbidden: User \"system:node:ip-10-0-138-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-92.ec2.internal' and this object" podUID="e934e72d-650e-483d-b0db-f5ee50a06f4b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"
Sep 09 05:56:58.937377 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.937349    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnqj5\" (UniqueName: \"kubernetes.io/projected/e934e72d-650e-483d-b0db-f5ee50a06f4b-kube-api-access-rnqj5\") pod \"e934e72d-650e-483d-b0db-f5ee50a06f4b\" (UID: \"e934e72d-650e-483d-b0db-f5ee50a06f4b\") "
Sep 09 05:56:58.939785 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:58.939761    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e934e72d-650e-483d-b0db-f5ee50a06f4b-kube-api-access-rnqj5" (OuterVolumeSpecName: "kube-api-access-rnqj5") pod "e934e72d-650e-483d-b0db-f5ee50a06f4b" (UID: "e934e72d-650e-483d-b0db-f5ee50a06f4b"). InnerVolumeSpecName "kube-api-access-rnqj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 05:56:59.007207 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.007175    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jh7fx"
Sep 09 05:56:59.038049 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.038018    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnqj5\" (UniqueName: \"kubernetes.io/projected/e934e72d-650e-483d-b0db-f5ee50a06f4b-kube-api-access-rnqj5\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:56:59.042759 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.042714    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:59.146241 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.146210    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:56:59.242772 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:56:59.242735    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-vdl7c\" is forbidden: User \"system:node:ip-10-0-138-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-92.ec2.internal' and this object" podUID="e934e72d-650e-483d-b0db-f5ee50a06f4b" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"
Sep 09 05:56:59.246018 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.245984    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6329253f-c8cc-43d3-90e8-621c828765eb" path="/var/lib/kubelet/pods/6329253f-c8cc-43d3-90e8-621c828765eb/volumes"
Sep 09 05:56:59.246343 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.246324    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e934e72d-650e-483d-b0db-f5ee50a06f4b" path="/var/lib/kubelet/pods/e934e72d-650e-483d-b0db-f5ee50a06f4b/volumes"
Sep 09 05:56:59.295961 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.295934    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-jh7fx"]
Sep 09 05:56:59.298000 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:56:59.297961    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e26224_80c2_4c2c_a6b4_560a1f144aab.slice/crio-5230d6ef6c5dde8a0978f395f95de9bdfbc57767a248b24ec9ea918674ce078c WatchSource:0}: Error finding container 5230d6ef6c5dde8a0978f395f95de9bdfbc57767a248b24ec9ea918674ce078c: Status 404 returned error can't find the container with id 5230d6ef6c5dde8a0978f395f95de9bdfbc57767a248b24ec9ea918674ce078c
Sep 09 05:56:59.411573 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.411456    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jh7fx" event={"ID":"00e26224-80c2-4c2c-a6b4-560a1f144aab","Type":"ContainerStarted","Data":"7272c24e2b4f22fbe306343cc59fd74260051f341b7e792e4ea638fbf2bd848a"}
Sep 09 05:56:59.411734 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.411578    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jh7fx" event={"ID":"00e26224-80c2-4c2c-a6b4-560a1f144aab","Type":"ContainerStarted","Data":"5230d6ef6c5dde8a0978f395f95de9bdfbc57767a248b24ec9ea918674ce078c"}
Sep 09 05:56:59.411804 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.411749    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jh7fx"
Sep 09 05:56:59.413222 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.413192    2583 generic.go:356] "Generic (PLEG): container finished" podID="e934e72d-650e-483d-b0db-f5ee50a06f4b" containerID="d408f52e6bbc99cfb27cc194d81b99f604a26ad650facd528a8e12232f48248f" exitCode=0
Sep 09 05:56:59.413340 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.413248    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-vdl7c"
Sep 09 05:56:59.413340 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.413293    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-67c5dcb48c-ph62k"
Sep 09 05:56:59.413445 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.413310    2583 scope.go:117] "RemoveContainer" containerID="d408f52e6bbc99cfb27cc194d81b99f604a26ad650facd528a8e12232f48248f"
Sep 09 05:56:59.423486 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.423463    2583 scope.go:117] "RemoveContainer" containerID="d408f52e6bbc99cfb27cc194d81b99f604a26ad650facd528a8e12232f48248f"
Sep 09 05:56:59.423954 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:56:59.423926    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d408f52e6bbc99cfb27cc194d81b99f604a26ad650facd528a8e12232f48248f\": container with ID starting with d408f52e6bbc99cfb27cc194d81b99f604a26ad650facd528a8e12232f48248f not found: ID does not exist" containerID="d408f52e6bbc99cfb27cc194d81b99f604a26ad650facd528a8e12232f48248f"
Sep 09 05:56:59.424048 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.423965    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d408f52e6bbc99cfb27cc194d81b99f604a26ad650facd528a8e12232f48248f"} err="failed to get container status \"d408f52e6bbc99cfb27cc194d81b99f604a26ad650facd528a8e12232f48248f\": rpc error: code = NotFound desc = could not find container \"d408f52e6bbc99cfb27cc194d81b99f604a26ad650facd528a8e12232f48248f\": container with ID starting with d408f52e6bbc99cfb27cc194d81b99f604a26ad650facd528a8e12232f48248f not found: ID does not exist"
Sep 09 05:56:59.434546 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:56:59.434486    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jh7fx" podStartSLOduration=1.434468331 podStartE2EDuration="1.434468331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:56:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:56:59.432047095 +0000 UTC m=+440.662543648" watchObservedRunningTime="2026-09-09 05:56:59.434468331 +0000 UTC m=+440.664964883"
Sep 09 05:57:02.432538 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:02.432496    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2" podUID="6641fa5a-4b98-463a-96c8-86863d7595e1" containerName="manager" containerID="cri-o://e2d8b2a076bb48f3b5ac8e1125b7d36403da23653854be85b86930b7ba819da1" gracePeriod=2
Sep 09 05:57:02.466137 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:02.466035    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:02.565818 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:02.565788    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:02.677668 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:02.677638    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"
Sep 09 05:57:02.679733 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:57:02.679707    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-tcmj2\" is forbidden: User \"system:node:ip-10-0-138-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-92.ec2.internal' and this object" podUID="6641fa5a-4b98-463a-96c8-86863d7595e1" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"
Sep 09 05:57:02.774752 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:02.774657    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8nn8\" (UniqueName: \"kubernetes.io/projected/6641fa5a-4b98-463a-96c8-86863d7595e1-kube-api-access-s8nn8\") pod \"6641fa5a-4b98-463a-96c8-86863d7595e1\" (UID: \"6641fa5a-4b98-463a-96c8-86863d7595e1\") "
Sep 09 05:57:02.774904 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:02.774766    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6641fa5a-4b98-463a-96c8-86863d7595e1-extensions-socket-volume\") pod \"6641fa5a-4b98-463a-96c8-86863d7595e1\" (UID: \"6641fa5a-4b98-463a-96c8-86863d7595e1\") "
Sep 09 05:57:02.774989 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:02.774964    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6641fa5a-4b98-463a-96c8-86863d7595e1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6641fa5a-4b98-463a-96c8-86863d7595e1" (UID: "6641fa5a-4b98-463a-96c8-86863d7595e1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 05:57:02.776853 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:02.776825    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6641fa5a-4b98-463a-96c8-86863d7595e1-kube-api-access-s8nn8" (OuterVolumeSpecName: "kube-api-access-s8nn8") pod "6641fa5a-4b98-463a-96c8-86863d7595e1" (UID: "6641fa5a-4b98-463a-96c8-86863d7595e1"). InnerVolumeSpecName "kube-api-access-s8nn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 05:57:02.875430 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:02.875396    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8nn8\" (UniqueName: \"kubernetes.io/projected/6641fa5a-4b98-463a-96c8-86863d7595e1-kube-api-access-s8nn8\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:57:02.875430 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:02.875423    2583 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6641fa5a-4b98-463a-96c8-86863d7595e1-extensions-socket-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:57:03.244125 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:03.244089    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6641fa5a-4b98-463a-96c8-86863d7595e1" path="/var/lib/kubelet/pods/6641fa5a-4b98-463a-96c8-86863d7595e1/volumes"
Sep 09 05:57:03.438035 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:03.437999    2583 generic.go:356] "Generic (PLEG): container finished" podID="6641fa5a-4b98-463a-96c8-86863d7595e1" containerID="e2d8b2a076bb48f3b5ac8e1125b7d36403da23653854be85b86930b7ba819da1" exitCode=2
Sep 09 05:57:03.438482 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:03.438050    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"
Sep 09 05:57:03.438482 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:03.438062    2583 scope.go:117] "RemoveContainer" containerID="e2d8b2a076bb48f3b5ac8e1125b7d36403da23653854be85b86930b7ba819da1"
Sep 09 05:57:03.442337 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:57:03.442307    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-tcmj2\" is forbidden: User \"system:node:ip-10-0-138-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-92.ec2.internal' and this object" podUID="6641fa5a-4b98-463a-96c8-86863d7595e1" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-tcmj2"
Sep 09 05:57:03.446587 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:03.446537    2583 scope.go:117] "RemoveContainer" containerID="e2d8b2a076bb48f3b5ac8e1125b7d36403da23653854be85b86930b7ba819da1"
Sep 09 05:57:03.446834 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:57:03.446814    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2d8b2a076bb48f3b5ac8e1125b7d36403da23653854be85b86930b7ba819da1\": container with ID starting with e2d8b2a076bb48f3b5ac8e1125b7d36403da23653854be85b86930b7ba819da1 not found: ID does not exist" containerID="e2d8b2a076bb48f3b5ac8e1125b7d36403da23653854be85b86930b7ba819da1"
Sep 09 05:57:03.446898 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:03.446846    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2d8b2a076bb48f3b5ac8e1125b7d36403da23653854be85b86930b7ba819da1"} err="failed to get container status \"e2d8b2a076bb48f3b5ac8e1125b7d36403da23653854be85b86930b7ba819da1\": rpc error: code = NotFound desc = could not find container \"e2d8b2a076bb48f3b5ac8e1125b7d36403da23653854be85b86930b7ba819da1\": container with ID starting with e2d8b2a076bb48f3b5ac8e1125b7d36403da23653854be85b86930b7ba819da1 not found: ID does not exist"
Sep 09 05:57:05.253264 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:05.253232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:05.353711 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:05.353677    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:10.423288 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:10.423255    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-jh7fx"
Sep 09 05:57:11.046720 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:11.046690    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:11.185877 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:11.185840    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:11.284034 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:11.283991    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:22.546040 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:22.546003    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:22.609160 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:22.609126    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:29.161292 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:29.161253    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:29.261833 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:29.261796    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:31.156188 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.156145    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"]
Sep 09 05:57:31.156778 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.156757    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6641fa5a-4b98-463a-96c8-86863d7595e1" containerName="manager"
Sep 09 05:57:31.156778 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.156777    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6641fa5a-4b98-463a-96c8-86863d7595e1" containerName="manager"
Sep 09 05:57:31.156982 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.156868    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6641fa5a-4b98-463a-96c8-86863d7595e1" containerName="manager"
Sep 09 05:57:31.163969 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.163949    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.166515 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.166490    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 09 05:57:31.166670 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.166490    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 09 05:57:31.166670 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.166490    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 09 05:57:31.166670 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.166536    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-68wzq\""
Sep 09 05:57:31.170122 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.170098    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"]
Sep 09 05:57:31.178044 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.178019    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:31.310267 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.310221    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:31.320133 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.320106    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4ntd\" (UniqueName: \"kubernetes.io/projected/c7f5c484-5318-4221-837e-e88218a305cf-kube-api-access-p4ntd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.320239 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.320150    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.320239 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.320172    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7f5c484-5318-4221-837e-e88218a305cf-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.320320 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.320252    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.320320 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.320279    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.320393 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.320328    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.320393 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.320348    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7f5c484-5318-4221-837e-e88218a305cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.320393 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.320372    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.320393 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.320393    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7f5c484-5318-4221-837e-e88218a305cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.422835 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.421636    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4ntd\" (UniqueName: \"kubernetes.io/projected/c7f5c484-5318-4221-837e-e88218a305cf-kube-api-access-p4ntd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.422835 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.421718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.422835 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.421750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7f5c484-5318-4221-837e-e88218a305cf-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.422835 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.421793    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.422835 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.421819    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.422835 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.421870    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.422835 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.421902    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7f5c484-5318-4221-837e-e88218a305cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.422835 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.421929    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.422835 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.421962    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7f5c484-5318-4221-837e-e88218a305cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.422835 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.422740    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7f5c484-5318-4221-837e-e88218a305cf-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.423392 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.423067    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.423392 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.423085    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.423392 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.423145    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.423392 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.423278    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.425237 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.425207    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7f5c484-5318-4221-837e-e88218a305cf-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.425418 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.425401    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7f5c484-5318-4221-837e-e88218a305cf-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.430571 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.430534    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7f5c484-5318-4221-837e-e88218a305cf-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.430756 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.430738    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4ntd\" (UniqueName: \"kubernetes.io/projected/c7f5c484-5318-4221-837e-e88218a305cf-kube-api-access-p4ntd\") pod \"maas-default-gateway-openshift-default-78bb78ff78-frjnr\" (UID: \"c7f5c484-5318-4221-837e-e88218a305cf\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.476205 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.476164    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:31.751342 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:31.751315    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"]
Sep 09 05:57:31.754203 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:57:31.754177    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f5c484_5318_4221_837e_e88218a305cf.slice/crio-c70ba90cc6b68e394de5148b050932c34aaa6cd6f1625e9afeb7e712437e88e1 WatchSource:0}: Error finding container c70ba90cc6b68e394de5148b050932c34aaa6cd6f1625e9afeb7e712437e88e1: Status 404 returned error can't find the container with id c70ba90cc6b68e394de5148b050932c34aaa6cd6f1625e9afeb7e712437e88e1
Sep 09 05:57:32.575993 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:32.575955    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr" event={"ID":"c7f5c484-5318-4221-837e-e88218a305cf","Type":"ContainerStarted","Data":"c70ba90cc6b68e394de5148b050932c34aaa6cd6f1625e9afeb7e712437e88e1"}
Sep 09 05:57:35.176899 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:35.176861    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 05:57:35.177266 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:35.176949    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 05:57:35.177266 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:35.176998    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 05:57:35.594110 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:35.594019    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr" event={"ID":"c7f5c484-5318-4221-837e-e88218a305cf","Type":"ContainerStarted","Data":"868ce75286da0f12c14ace5932b8a8ccb6e62d4b87c095a931539554b3f0e2bb"}
Sep 09 05:57:35.616012 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:35.615954    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr" podStartSLOduration=1.195641134 podStartE2EDuration="4.615934012s" totalImagesPullingTime="3.420292878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:57:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:57:35.613269799 +0000 UTC m=+476.843766352" watchObservedRunningTime="2026-09-09 05:57:35.615934012 +0000 UTC m=+476.846430565"
Sep 09 05:57:36.477308 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:36.477266    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:36.481610 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:36.481586    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:36.599526 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:36.599490    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:36.600603 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:36.600548    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:57:46.290237 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.290204    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:46.290643 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.290624    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-hssjd"]
Sep 09 05:57:46.293893 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.293874    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-hssjd"
Sep 09 05:57:46.296044 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.296025    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 09 05:57:46.296213 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.296187    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-58nxl\""
Sep 09 05:57:46.302609 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.302586    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-hssjd"]
Sep 09 05:57:46.351172 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.351132    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7bqp\" (UniqueName: \"kubernetes.io/projected/500abe9f-afc0-4786-ac38-d5dcef798098-kube-api-access-n7bqp\") pod \"limitador-limitador-8588749977-hssjd\" (UID: \"500abe9f-afc0-4786-ac38-d5dcef798098\") " pod="kuadrant-system/limitador-limitador-8588749977-hssjd"
Sep 09 05:57:46.351383 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.351206    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/500abe9f-afc0-4786-ac38-d5dcef798098-config-file\") pod \"limitador-limitador-8588749977-hssjd\" (UID: \"500abe9f-afc0-4786-ac38-d5dcef798098\") " pod="kuadrant-system/limitador-limitador-8588749977-hssjd"
Sep 09 05:57:46.385240 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.385210    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-hssjd"]
Sep 09 05:57:46.389936 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.389906    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:46.445073 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.445037    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:46.452213 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.452187    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7bqp\" (UniqueName: \"kubernetes.io/projected/500abe9f-afc0-4786-ac38-d5dcef798098-kube-api-access-n7bqp\") pod \"limitador-limitador-8588749977-hssjd\" (UID: \"500abe9f-afc0-4786-ac38-d5dcef798098\") " pod="kuadrant-system/limitador-limitador-8588749977-hssjd"
Sep 09 05:57:46.452323 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.452225    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/500abe9f-afc0-4786-ac38-d5dcef798098-config-file\") pod \"limitador-limitador-8588749977-hssjd\" (UID: \"500abe9f-afc0-4786-ac38-d5dcef798098\") " pod="kuadrant-system/limitador-limitador-8588749977-hssjd"
Sep 09 05:57:46.452861 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.452844    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/500abe9f-afc0-4786-ac38-d5dcef798098-config-file\") pod \"limitador-limitador-8588749977-hssjd\" (UID: \"500abe9f-afc0-4786-ac38-d5dcef798098\") " pod="kuadrant-system/limitador-limitador-8588749977-hssjd"
Sep 09 05:57:46.461098 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.461079    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7bqp\" (UniqueName: \"kubernetes.io/projected/500abe9f-afc0-4786-ac38-d5dcef798098-kube-api-access-n7bqp\") pod \"limitador-limitador-8588749977-hssjd\" (UID: \"500abe9f-afc0-4786-ac38-d5dcef798098\") " pod="kuadrant-system/limitador-limitador-8588749977-hssjd"
Sep 09 05:57:46.604840 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.604757    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-hssjd"
Sep 09 05:57:46.872429 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:46.872402    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-hssjd"]
Sep 09 05:57:46.874987 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:57:46.874955    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500abe9f_afc0_4786_ac38_d5dcef798098.slice/crio-3ff04bd782b49db60ab204afcd6a9169d09b19ac7d04daa8ff3609c824fc087e WatchSource:0}: Error finding container 3ff04bd782b49db60ab204afcd6a9169d09b19ac7d04daa8ff3609c824fc087e: Status 404 returned error can't find the container with id 3ff04bd782b49db60ab204afcd6a9169d09b19ac7d04daa8ff3609c824fc087e
Sep 09 05:57:47.131900 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:47.131814    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:47.232696 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:47.232659    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:57:47.649336 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:47.649304    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-hssjd" event={"ID":"500abe9f-afc0-4786-ac38-d5dcef798098","Type":"ContainerStarted","Data":"3ff04bd782b49db60ab204afcd6a9169d09b19ac7d04daa8ff3609c824fc087e"}
Sep 09 05:57:48.655621 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:48.655584    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-hssjd" event={"ID":"500abe9f-afc0-4786-ac38-d5dcef798098","Type":"ContainerStarted","Data":"92a452a1946aa78256173a7b039900bc879ba2fad7740bd1df82c6a9553fb7fe"}
Sep 09 05:57:48.655996 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:48.655713    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-hssjd"
Sep 09 05:57:48.671286 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:48.671239    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-hssjd" podStartSLOduration=1.326752334 podStartE2EDuration="2.671224156s" totalImagesPullingTime="1.344471822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:57:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:57:48.670370801 +0000 UTC m=+489.900867353" watchObservedRunningTime="2026-09-09 05:57:48.671224156 +0000 UTC m=+489.901720702"
Sep 09 05:57:59.661470 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:59.661430    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-hssjd"
Sep 09 05:57:59.999720 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:59.999632    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-hssjd"]
Sep 09 05:57:59.999865 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:57:59.999803    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-hssjd" podUID="500abe9f-afc0-4786-ac38-d5dcef798098" containerName="limitador" containerID="cri-o://92a452a1946aa78256173a7b039900bc879ba2fad7740bd1df82c6a9553fb7fe" gracePeriod=30
Sep 09 05:58:00.540199 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.540173    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-hssjd"
Sep 09 05:58:00.678361 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.678331    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7bqp\" (UniqueName: \"kubernetes.io/projected/500abe9f-afc0-4786-ac38-d5dcef798098-kube-api-access-n7bqp\") pod \"500abe9f-afc0-4786-ac38-d5dcef798098\" (UID: \"500abe9f-afc0-4786-ac38-d5dcef798098\") "
Sep 09 05:58:00.678775 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.678385    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/500abe9f-afc0-4786-ac38-d5dcef798098-config-file\") pod \"500abe9f-afc0-4786-ac38-d5dcef798098\" (UID: \"500abe9f-afc0-4786-ac38-d5dcef798098\") "
Sep 09 05:58:00.678775 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.678758    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/500abe9f-afc0-4786-ac38-d5dcef798098-config-file" (OuterVolumeSpecName: "config-file") pod "500abe9f-afc0-4786-ac38-d5dcef798098" (UID: "500abe9f-afc0-4786-ac38-d5dcef798098"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 05:58:00.680546 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.680526    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/500abe9f-afc0-4786-ac38-d5dcef798098-kube-api-access-n7bqp" (OuterVolumeSpecName: "kube-api-access-n7bqp") pod "500abe9f-afc0-4786-ac38-d5dcef798098" (UID: "500abe9f-afc0-4786-ac38-d5dcef798098"). InnerVolumeSpecName "kube-api-access-n7bqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 05:58:00.710706 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.710677    2583 generic.go:356] "Generic (PLEG): container finished" podID="500abe9f-afc0-4786-ac38-d5dcef798098" containerID="92a452a1946aa78256173a7b039900bc879ba2fad7740bd1df82c6a9553fb7fe" exitCode=0
Sep 09 05:58:00.710831 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.710722    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-hssjd"
Sep 09 05:58:00.710831 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.710752    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-hssjd" event={"ID":"500abe9f-afc0-4786-ac38-d5dcef798098","Type":"ContainerDied","Data":"92a452a1946aa78256173a7b039900bc879ba2fad7740bd1df82c6a9553fb7fe"}
Sep 09 05:58:00.710831 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.710802    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-hssjd" event={"ID":"500abe9f-afc0-4786-ac38-d5dcef798098","Type":"ContainerDied","Data":"3ff04bd782b49db60ab204afcd6a9169d09b19ac7d04daa8ff3609c824fc087e"}
Sep 09 05:58:00.710954 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.710833    2583 scope.go:117] "RemoveContainer" containerID="92a452a1946aa78256173a7b039900bc879ba2fad7740bd1df82c6a9553fb7fe"
Sep 09 05:58:00.719877 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.719862    2583 scope.go:117] "RemoveContainer" containerID="92a452a1946aa78256173a7b039900bc879ba2fad7740bd1df82c6a9553fb7fe"
Sep 09 05:58:00.720155 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:58:00.720137    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92a452a1946aa78256173a7b039900bc879ba2fad7740bd1df82c6a9553fb7fe\": container with ID starting with 92a452a1946aa78256173a7b039900bc879ba2fad7740bd1df82c6a9553fb7fe not found: ID does not exist" containerID="92a452a1946aa78256173a7b039900bc879ba2fad7740bd1df82c6a9553fb7fe"
Sep 09 05:58:00.720201 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.720164    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92a452a1946aa78256173a7b039900bc879ba2fad7740bd1df82c6a9553fb7fe"} err="failed to get container status \"92a452a1946aa78256173a7b039900bc879ba2fad7740bd1df82c6a9553fb7fe\": rpc error: code = NotFound desc = could not find container \"92a452a1946aa78256173a7b039900bc879ba2fad7740bd1df82c6a9553fb7fe\": container with ID starting with 92a452a1946aa78256173a7b039900bc879ba2fad7740bd1df82c6a9553fb7fe not found: ID does not exist"
Sep 09 05:58:00.732116 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.732094    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-hssjd"]
Sep 09 05:58:00.733526 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.733506    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-hssjd"]
Sep 09 05:58:00.779594 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.779568    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7bqp\" (UniqueName: \"kubernetes.io/projected/500abe9f-afc0-4786-ac38-d5dcef798098-kube-api-access-n7bqp\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:58:00.779594 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:00.779593    2583 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/500abe9f-afc0-4786-ac38-d5dcef798098-config-file\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 05:58:01.248455 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:01.248416    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="500abe9f-afc0-4786-ac38-d5dcef798098" path="/var/lib/kubelet/pods/500abe9f-afc0-4786-ac38-d5dcef798098/volumes"
Sep 09 05:58:02.935838 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:02.935791    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:03.038728 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.038697    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:03.362696 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.362540    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4"]
Sep 09 05:58:03.362976 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.362963    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="500abe9f-afc0-4786-ac38-d5dcef798098" containerName="limitador"
Sep 09 05:58:03.363016 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.362978    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="500abe9f-afc0-4786-ac38-d5dcef798098" containerName="limitador"
Sep 09 05:58:03.363053 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.363037    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="500abe9f-afc0-4786-ac38-d5dcef798098" containerName="limitador"
Sep 09 05:58:03.366012 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.365991    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4"
Sep 09 05:58:03.368518 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.368497    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 09 05:58:03.368680 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.368496    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 09 05:58:03.368747 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.368537    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 09 05:58:03.369349 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.369333    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-m6hvw\""
Sep 09 05:58:03.374548 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.374525    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4"]
Sep 09 05:58:03.393612 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.393579    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:03.501178 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.501147    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpq2v\" (UniqueName: \"kubernetes.io/projected/97bde255-64ed-4dd3-8e7f-535335d353a0-kube-api-access-wpq2v\") pod \"postgres-69fb4594cf-hvkz4\" (UID: \"97bde255-64ed-4dd3-8e7f-535335d353a0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4"
Sep 09 05:58:03.501356 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.501205    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/97bde255-64ed-4dd3-8e7f-535335d353a0-data\") pod \"postgres-69fb4594cf-hvkz4\" (UID: \"97bde255-64ed-4dd3-8e7f-535335d353a0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4"
Sep 09 05:58:03.602637 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.602597    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/97bde255-64ed-4dd3-8e7f-535335d353a0-data\") pod \"postgres-69fb4594cf-hvkz4\" (UID: \"97bde255-64ed-4dd3-8e7f-535335d353a0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4"
Sep 09 05:58:03.602821 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.602702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpq2v\" (UniqueName: \"kubernetes.io/projected/97bde255-64ed-4dd3-8e7f-535335d353a0-kube-api-access-wpq2v\") pod \"postgres-69fb4594cf-hvkz4\" (UID: \"97bde255-64ed-4dd3-8e7f-535335d353a0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4"
Sep 09 05:58:03.602982 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.602960    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/97bde255-64ed-4dd3-8e7f-535335d353a0-data\") pod \"postgres-69fb4594cf-hvkz4\" (UID: \"97bde255-64ed-4dd3-8e7f-535335d353a0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4"
Sep 09 05:58:03.611173 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.611148    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpq2v\" (UniqueName: \"kubernetes.io/projected/97bde255-64ed-4dd3-8e7f-535335d353a0-kube-api-access-wpq2v\") pod \"postgres-69fb4594cf-hvkz4\" (UID: \"97bde255-64ed-4dd3-8e7f-535335d353a0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4"
Sep 09 05:58:03.678878 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.678837    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4"
Sep 09 05:58:03.949310 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:03.949280    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4"]
Sep 09 05:58:03.951848 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:58:03.951822    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97bde255_64ed_4dd3_8e7f_535335d353a0.slice/crio-473a11621dc667c27dc99fb31a005bf413b49b7fb56eeeca0e68c9c466b71216 WatchSource:0}: Error finding container 473a11621dc667c27dc99fb31a005bf413b49b7fb56eeeca0e68c9c466b71216: Status 404 returned error can't find the container with id 473a11621dc667c27dc99fb31a005bf413b49b7fb56eeeca0e68c9c466b71216
Sep 09 05:58:04.732634 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:04.732602    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4" event={"ID":"97bde255-64ed-4dd3-8e7f-535335d353a0","Type":"ContainerStarted","Data":"473a11621dc667c27dc99fb31a005bf413b49b7fb56eeeca0e68c9c466b71216"}
Sep 09 05:58:08.770333 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:08.770294    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:09.761785 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:09.761755    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4" event={"ID":"97bde255-64ed-4dd3-8e7f-535335d353a0","Type":"ContainerStarted","Data":"dff7aa05e4836e06a510eb18922ed0fb73df1487cca15ba13809ed0d78b9ebce"}
Sep 09 05:58:09.761947 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:09.761886    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4"
Sep 09 05:58:09.777458 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:09.777395    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4" podStartSLOduration=1.7793758450000001 podStartE2EDuration="6.777374637s" totalImagesPullingTime="4.997998792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:58:09.776373636 +0000 UTC m=+511.006870193" watchObservedRunningTime="2026-09-09 05:58:09.777374637 +0000 UTC m=+511.007871190"
Sep 09 05:58:15.796550 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:15.796519    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hvkz4"
Sep 09 05:58:16.110501 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:16.110393    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:16.448692 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:16.448661    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:22.875661 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:22.875628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:22.947817 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:22.947772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:23.003681 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:23.003636    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:23.253125 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:23.253053    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:23.453329 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:23.453301    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:27.008110 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:27.008077    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:27.107428 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:27.107400    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:51.440163 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:51.440124    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:58.348714 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:58.348679    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:58.451130 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:58.451099    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:59.808942 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:59.808903    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:58:59.909605 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:58:59.909577    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:00.039685 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.039654    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"]
Sep 09 05:59:00.059361 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.059273    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"]
Sep 09 05:59:00.059529 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.059380    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:00.062324 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.062301    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 09 05:59:00.062497 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.062424    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 09 05:59:00.063061 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.063042    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-927tl\""
Sep 09 05:59:00.110617 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.110540    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:00.178897 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.178856    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-maas-api-tls\") pod \"maas-api-75c5f7dfb6-7kvst\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") " pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:00.179073 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.178905    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daef917a-bae4-4185-9f82-c0d9572714ab-openshift-service-ca\") pod \"maas-api-75c5f7dfb6-7kvst\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") " pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:00.179073 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.178955    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsk7g\" (UniqueName: \"kubernetes.io/projected/daef917a-bae4-4185-9f82-c0d9572714ab-kube-api-access-qsk7g\") pod \"maas-api-75c5f7dfb6-7kvst\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") " pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:00.179073 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.178995    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-metrics-certs\") pod \"maas-api-75c5f7dfb6-7kvst\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") " pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:00.280213 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.280172    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-maas-api-tls\") pod \"maas-api-75c5f7dfb6-7kvst\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") " pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:00.280405 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.280224    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daef917a-bae4-4185-9f82-c0d9572714ab-openshift-service-ca\") pod \"maas-api-75c5f7dfb6-7kvst\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") " pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:00.280405 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.280240    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsk7g\" (UniqueName: \"kubernetes.io/projected/daef917a-bae4-4185-9f82-c0d9572714ab-kube-api-access-qsk7g\") pod \"maas-api-75c5f7dfb6-7kvst\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") " pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:00.280405 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.280258    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-metrics-certs\") pod \"maas-api-75c5f7dfb6-7kvst\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") " pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:00.280405 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:59:00.280404    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-metrics-tls: secret "maas-api-metrics-tls" not found
Sep 09 05:59:00.280641 ip-10-0-138-92 kubenswrapper[2583]: E0909 05:59:00.280515    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-metrics-certs podName:daef917a-bae4-4185-9f82-c0d9572714ab nodeName:}" failed. No retries permitted until 2026-09-09 05:59:00.780441306 +0000 UTC m=+562.010937838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-metrics-certs") pod "maas-api-75c5f7dfb6-7kvst" (UID: "daef917a-bae4-4185-9f82-c0d9572714ab") : secret "maas-api-metrics-tls" not found
Sep 09 05:59:00.281113 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.281016    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daef917a-bae4-4185-9f82-c0d9572714ab-openshift-service-ca\") pod \"maas-api-75c5f7dfb6-7kvst\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") " pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:00.282952 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.282928    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-maas-api-tls\") pod \"maas-api-75c5f7dfb6-7kvst\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") " pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:00.288260 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.288238    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsk7g\" (UniqueName: \"kubernetes.io/projected/daef917a-bae4-4185-9f82-c0d9572714ab-kube-api-access-qsk7g\") pod \"maas-api-75c5f7dfb6-7kvst\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") " pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:00.301985 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.301942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:00.403162 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.403131    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:00.436887 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.436856    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-db5d6"]
Sep 09 05:59:00.440546 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.440529    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-db5d6"
Sep 09 05:59:00.442879 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.442859    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 09 05:59:00.442981 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.442887    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4pp9f\""
Sep 09 05:59:00.451258 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.451236    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-db5d6"]
Sep 09 05:59:00.480422 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.480397    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:00.583526 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.583487    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv87f\" (UniqueName: \"kubernetes.io/projected/6a7d70d1-9372-4b20-a1c2-d1042e2d0053-kube-api-access-fv87f\") pod \"payload-processing-5b54b7fbb7-db5d6\" (UID: \"6a7d70d1-9372-4b20-a1c2-d1042e2d0053\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-db5d6"
Sep 09 05:59:00.583526 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.583526    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a7d70d1-9372-4b20-a1c2-d1042e2d0053-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-db5d6\" (UID: \"6a7d70d1-9372-4b20-a1c2-d1042e2d0053\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-db5d6"
Sep 09 05:59:00.684889 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.684798    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv87f\" (UniqueName: \"kubernetes.io/projected/6a7d70d1-9372-4b20-a1c2-d1042e2d0053-kube-api-access-fv87f\") pod \"payload-processing-5b54b7fbb7-db5d6\" (UID: \"6a7d70d1-9372-4b20-a1c2-d1042e2d0053\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-db5d6"
Sep 09 05:59:00.684889 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.684852    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a7d70d1-9372-4b20-a1c2-d1042e2d0053-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-db5d6\" (UID: \"6a7d70d1-9372-4b20-a1c2-d1042e2d0053\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-db5d6"
Sep 09 05:59:00.685642 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.685618    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6a7d70d1-9372-4b20-a1c2-d1042e2d0053-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-db5d6\" (UID: \"6a7d70d1-9372-4b20-a1c2-d1042e2d0053\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-db5d6"
Sep 09 05:59:00.692503 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.692477    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv87f\" (UniqueName: \"kubernetes.io/projected/6a7d70d1-9372-4b20-a1c2-d1042e2d0053-kube-api-access-fv87f\") pod \"payload-processing-5b54b7fbb7-db5d6\" (UID: \"6a7d70d1-9372-4b20-a1c2-d1042e2d0053\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-db5d6"
Sep 09 05:59:00.751392 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.751363    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-db5d6"
Sep 09 05:59:00.785668 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.785636    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-metrics-certs\") pod \"maas-api-75c5f7dfb6-7kvst\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") " pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:00.788299 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.788266    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-metrics-certs\") pod \"maas-api-75c5f7dfb6-7kvst\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") " pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:00.803498 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.803281    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:00.969842 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:00.969748    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:01.024641 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:01.024431    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-db5d6"]
Sep 09 05:59:01.026376 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:59:01.026329    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7d70d1_9372_4b20_a1c2_d1042e2d0053.slice/crio-0a4dabde1896359baee3087be670c4aa482b99f0f149c33ca5d6ce74988b6d82 WatchSource:0}: Error finding container 0a4dabde1896359baee3087be670c4aa482b99f0f149c33ca5d6ce74988b6d82: Status 404 returned error can't find the container with id 0a4dabde1896359baee3087be670c4aa482b99f0f149c33ca5d6ce74988b6d82
Sep 09 05:59:01.246403 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:01.246376    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"]
Sep 09 05:59:01.247302 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:59:01.247264    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaef917a_bae4_4185_9f82_c0d9572714ab.slice/crio-599fa279374888c0ed7f29c3aa8b25a9e9a015238cdf9c31e88408df14ff544d WatchSource:0}: Error finding container 599fa279374888c0ed7f29c3aa8b25a9e9a015238cdf9c31e88408df14ff544d: Status 404 returned error can't find the container with id 599fa279374888c0ed7f29c3aa8b25a9e9a015238cdf9c31e88408df14ff544d
Sep 09 05:59:01.429093 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:01.429035    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:02.011668 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:02.011629    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst" event={"ID":"daef917a-bae4-4185-9f82-c0d9572714ab","Type":"ContainerStarted","Data":"599fa279374888c0ed7f29c3aa8b25a9e9a015238cdf9c31e88408df14ff544d"}
Sep 09 05:59:02.013257 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:02.013230    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-db5d6" event={"ID":"6a7d70d1-9372-4b20-a1c2-d1042e2d0053","Type":"ContainerStarted","Data":"0a4dabde1896359baee3087be670c4aa482b99f0f149c33ca5d6ce74988b6d82"}
Sep 09 05:59:06.035508 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:06.035466    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst" event={"ID":"daef917a-bae4-4185-9f82-c0d9572714ab","Type":"ContainerStarted","Data":"76952c49b0c6535dee255f1281d5ddeb3454fc66e106a4f2cab03901e8825555"}
Sep 09 05:59:06.035983 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:06.035619    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:06.037254 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:06.037235    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-db5d6" event={"ID":"6a7d70d1-9372-4b20-a1c2-d1042e2d0053","Type":"ContainerStarted","Data":"236c3e8437253a9fe4451b2dd444e36d213704ecc0222516f4698c24ce278d99"}
Sep 09 05:59:06.037358 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:06.037281    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-db5d6"
Sep 09 05:59:06.051821 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:06.051770    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst" podStartSLOduration=1.734270994 podStartE2EDuration="6.05175506s" totalImagesPullingTime="4.317484066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:59:06.051303334 +0000 UTC m=+567.281799892" watchObservedRunningTime="2026-09-09 05:59:06.05175506 +0000 UTC m=+567.282251611"
Sep 09 05:59:06.066591 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:06.066505    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-db5d6" podStartSLOduration=1.5757537579999998 podStartE2EDuration="6.066469986s" totalImagesPullingTime="4.490716228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:59:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:59:06.066013938 +0000 UTC m=+567.296510493" watchObservedRunningTime="2026-09-09 05:59:06.066469986 +0000 UTC m=+567.296966538"
Sep 09 05:59:10.066444 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:10.066362    2583 generic.go:356] "Generic (PLEG): container finished" podID="c7f5c484-5318-4221-837e-e88218a305cf" containerID="868ce75286da0f12c14ace5932b8a8ccb6e62d4b87c095a931539554b3f0e2bb" exitCode=0
Sep 09 05:59:10.066847 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:10.066434    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr" event={"ID":"c7f5c484-5318-4221-837e-e88218a305cf","Type":"ContainerDied","Data":"868ce75286da0f12c14ace5932b8a8ccb6e62d4b87c095a931539554b3f0e2bb"}
Sep 09 05:59:10.066847 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:10.066811    2583 scope.go:117] "RemoveContainer" containerID="868ce75286da0f12c14ace5932b8a8ccb6e62d4b87c095a931539554b3f0e2bb"
Sep 09 05:59:10.067842 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:10.067817    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 05:59:10.067906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:10.067885    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 05:59:10.067945 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:10.067916    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 05:59:11.073475 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:11.073433    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr" event={"ID":"c7f5c484-5318-4221-837e-e88218a305cf","Type":"ContainerStarted","Data":"262ce30403c6fc72cd950c4c923e1575afa8e084e4b15450b910961c5021107a"}
Sep 09 05:59:11.477397 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:11.476790    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:59:11.477397 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:11.477070    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-frjnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 09 05:59:11.477397 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:11.477122    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr" podUID="c7f5c484-5318-4221-837e-e88218a305cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 09 05:59:12.049294 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:12.049267    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 05:59:12.476944 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:12.476908    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-frjnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 09 05:59:12.477529 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:12.477497    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr" podUID="c7f5c484-5318-4221-837e-e88218a305cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 09 05:59:13.080924 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:13.080807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:13.213506 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:13.213474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:13.476850 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:13.476805    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-frjnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 09 05:59:13.477049 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:13.476874    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr" podUID="c7f5c484-5318-4221-837e-e88218a305cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 09 05:59:14.477084 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:14.477044    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-frjnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 09 05:59:14.477600 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:14.477115    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr" podUID="c7f5c484-5318-4221-837e-e88218a305cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 09 05:59:15.476793 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:15.476755    2583 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-frjnr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 09 05:59:15.477104 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:15.477073    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr" podUID="c7f5c484-5318-4221-837e-e88218a305cf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 09 05:59:16.480425 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:16.480393    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:59:16.480912 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:16.480788    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:59:16.481508 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:16.481484    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-frjnr"
Sep 09 05:59:17.045564 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:17.045533    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-db5d6"
Sep 09 05:59:21.360468 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:21.360434    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:32.962341 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:32.962287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:43.627114 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.627080    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"]
Sep 09 05:59:43.630587 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.630570    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.632906 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.632883    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 09 05:59:43.633779 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.633760    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 09 05:59:43.633882 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.633782    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-w84m4\""
Sep 09 05:59:43.633882 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.633812    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 09 05:59:43.637575 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.637531    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"]
Sep 09 05:59:43.681125 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.681102    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.681249 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.681132    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.681249 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.681154    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8sqv\" (UniqueName: \"kubernetes.io/projected/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-kube-api-access-k8sqv\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.681328 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.681258    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.681328 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.681283    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.681328 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.681321    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.749035 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.749001    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:43.782311 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.782281    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.782311 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.782313    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.782469 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.782347    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.782550 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.782526    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.782627 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.782583    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.782627 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.782613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8sqv\" (UniqueName: \"kubernetes.io/projected/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-kube-api-access-k8sqv\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.782755 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.782736    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.782917 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.782895    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.783009 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.782962    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.785292 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.785274    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.785549 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.785535    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.806084 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.806061    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8sqv\" (UniqueName: \"kubernetes.io/projected/d66c8ef6-dfad-4ff9-a0c4-328c94c1027e-kube-api-access-k8sqv\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7\" (UID: \"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:43.942258 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:43.942162    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:44.216078 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:44.216053    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"]
Sep 09 05:59:44.217928 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:59:44.217898    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66c8ef6_dfad_4ff9_a0c4_328c94c1027e.slice/crio-6a2f696d1eb77fb7ecab7bd8d7c709f61cbef622fe1b0f699b8438f1923bbff6 WatchSource:0}: Error finding container 6a2f696d1eb77fb7ecab7bd8d7c709f61cbef622fe1b0f699b8438f1923bbff6: Status 404 returned error can't find the container with id 6a2f696d1eb77fb7ecab7bd8d7c709f61cbef622fe1b0f699b8438f1923bbff6
Sep 09 05:59:44.219349 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:44.219334    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 05:59:44.250950 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:44.250915    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7" event={"ID":"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e","Type":"ContainerStarted","Data":"6a2f696d1eb77fb7ecab7bd8d7c709f61cbef622fe1b0f699b8438f1923bbff6"}
Sep 09 05:59:46.262531 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:46.262495    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7" event={"ID":"d66c8ef6-dfad-4ff9-a0c4-328c94c1027e","Type":"ContainerStarted","Data":"1c4a8734b3806e3f7f2e4ffe3b5f8436b23473b8d4fd41f02cf0efe2227c76bf"}
Sep 09 05:59:46.278015 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:46.277962    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7" podStartSLOduration=2.286752097 podStartE2EDuration="3.277945474s" totalImagesPullingTime="991.193377ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:59:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:59:46.276765434 +0000 UTC m=+607.507261986" watchObservedRunningTime="2026-09-09 05:59:46.277945474 +0000 UTC m=+607.508442060"
Sep 09 05:59:52.969477 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:52.969437    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:53.942387 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:53.942351    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:53.942599 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:53.942417    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:53.955001 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:53.954976    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:54.313102 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:54.313018    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7"
Sep 09 05:59:54.929710 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:54.929682    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:55.029942 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:55.029898    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:58.331059 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.331026    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"]
Sep 09 05:59:58.334909 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.334885    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.337390 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.337364    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 09 05:59:58.344028 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.344004    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"]
Sep 09 05:59:58.358045 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.358011    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 05:59:58.406097 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.406053    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28562a41-ce6e-4056-8534-1c2f91edaa4a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.406378 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.406114    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28562a41-ce6e-4056-8534-1c2f91edaa4a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.406378 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.406152    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28562a41-ce6e-4056-8534-1c2f91edaa4a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.406378 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.406219    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28562a41-ce6e-4056-8534-1c2f91edaa4a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.406378 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.406285    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qqvs\" (UniqueName: \"kubernetes.io/projected/28562a41-ce6e-4056-8534-1c2f91edaa4a-kube-api-access-5qqvs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.406378 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.406354    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28562a41-ce6e-4056-8534-1c2f91edaa4a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.507114 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.507076    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28562a41-ce6e-4056-8534-1c2f91edaa4a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.507302 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.507135    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28562a41-ce6e-4056-8534-1c2f91edaa4a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.507302 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.507161    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qqvs\" (UniqueName: \"kubernetes.io/projected/28562a41-ce6e-4056-8534-1c2f91edaa4a-kube-api-access-5qqvs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.507302 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.507208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28562a41-ce6e-4056-8534-1c2f91edaa4a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.507302 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.507274    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28562a41-ce6e-4056-8534-1c2f91edaa4a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.507547 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.507308    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28562a41-ce6e-4056-8534-1c2f91edaa4a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.507796 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.507734    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28562a41-ce6e-4056-8534-1c2f91edaa4a-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.507796 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.507769    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28562a41-ce6e-4056-8534-1c2f91edaa4a-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.507796 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.507788    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28562a41-ce6e-4056-8534-1c2f91edaa4a-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.509686 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.509661    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28562a41-ce6e-4056-8534-1c2f91edaa4a-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.509805 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.509792    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28562a41-ce6e-4056-8534-1c2f91edaa4a-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.515175 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.515155    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qqvs\" (UniqueName: \"kubernetes.io/projected/28562a41-ce6e-4056-8534-1c2f91edaa4a-kube-api-access-5qqvs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw\" (UID: \"28562a41-ce6e-4056-8534-1c2f91edaa4a\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.646522 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.646484    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 05:59:58.915544 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:58.915519    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"]
Sep 09 05:59:58.917210 ip-10-0-138-92 kubenswrapper[2583]: W0909 05:59:58.917179    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28562a41_ce6e_4056_8534_1c2f91edaa4a.slice/crio-5f176ce1781ec3c5095e61346fcb7d493142b47c152ad599ad68369ef2fa02f2 WatchSource:0}: Error finding container 5f176ce1781ec3c5095e61346fcb7d493142b47c152ad599ad68369ef2fa02f2: Status 404 returned error can't find the container with id 5f176ce1781ec3c5095e61346fcb7d493142b47c152ad599ad68369ef2fa02f2
Sep 09 05:59:59.328467 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:59.328386    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw" event={"ID":"28562a41-ce6e-4056-8534-1c2f91edaa4a","Type":"ContainerStarted","Data":"bfbf89b8afce69c81a111ac94fdd86c33594bc992769582948553f128f972987"}
Sep 09 05:59:59.328467 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:59.328437    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw" event={"ID":"28562a41-ce6e-4056-8534-1c2f91edaa4a","Type":"ContainerStarted","Data":"5f176ce1781ec3c5095e61346fcb7d493142b47c152ad599ad68369ef2fa02f2"}
Sep 09 05:59:59.345910 ip-10-0-138-92 kubenswrapper[2583]: I0909 05:59:59.345860    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw" podStartSLOduration=1.175535526 podStartE2EDuration="1.345841414s" totalImagesPullingTime="170.305888ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 05:59:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 05:59:59.344286492 +0000 UTC m=+620.574783044" watchObservedRunningTime="2026-09-09 05:59:59.345841414 +0000 UTC m=+620.576337965"
Sep 09 06:00:08.647407 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:00:08.647313    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 06:00:08.647801 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:00:08.647415    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 06:00:08.660217 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:00:08.660193    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 06:00:09.387272 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:00:09.387244    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw"
Sep 09 06:00:09.449667 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:00:09.449636    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:00:21.153114 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:00:21.153078    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:00:37.463235 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:00:37.463193    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:00:37.621761 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:00:37.621727    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:00:41.014750 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:00:41.014712    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:29.434198 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:29.434162    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:29.533115 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:29.533084    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:30.699045 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:30.698962    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:30.803876 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:30.803842    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:47.859143 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:47.859105    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:48.071513 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.071479    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:48.162306 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.162271    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:48.168499 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.168468    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"]
Sep 09 06:01:48.172853 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.172824    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.175789 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.175769    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-43eb2d-openshift-default-dockercfg-qdwrc\""
Sep 09 06:01:48.184949 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.184926    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"]
Sep 09 06:01:48.236514 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.236485    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"]
Sep 09 06:01:48.240172 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.240150    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.243228 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.243206    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ecd13e-openshift-default-dockercfg-d86gq\""
Sep 09 06:01:48.247419 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.247395    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:48.255781 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.255755    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"]
Sep 09 06:01:48.314421 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.314388    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-data\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.314622 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.314441    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-credential-socket\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.314622 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.314462    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-envoy\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.314622 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.314529    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-workload-socket\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.314622 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.314576    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-workload-certs\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.314622 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.314598    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istiod-ca-cert\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.314820 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.314680    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-podinfo\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.314820 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.314725    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-token\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.314820 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.314755    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8686\" (UniqueName: \"kubernetes.io/projected/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-kube-api-access-s8686\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.347008 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.346972    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:48.416517 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.416432    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-credential-socket\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.416517 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.416487    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-envoy\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.416854 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.416528    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-workload-socket\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.416854 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.416574    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-workload-certs\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.416854 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.416603    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-workload-certs\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.416854 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.416635    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istiod-ca-cert\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.416854 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.416660    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-workload-socket\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.416854 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.416709    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-podinfo\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.416854 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.416755    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istiod-ca-cert\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.417206 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.416857    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-token\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.417206 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.416899    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8686\" (UniqueName: \"kubernetes.io/projected/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-kube-api-access-s8686\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.417206 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.416931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-token\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.417206 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.416970    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-envoy\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.417206 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.417036    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-workload-certs\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.417206 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.417039    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vb4d9\" (UniqueName: \"kubernetes.io/projected/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-kube-api-access-vb4d9\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.417206 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.417112    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-data\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.417206 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.417157    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-podinfo\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.417206 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.417188    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-credential-socket\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.417645 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.417241    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-data\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.417645 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.417453    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-credential-socket\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.417645 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.417486    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-workload-socket\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.417774 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.417753    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-data\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.417837 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.417813    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istiod-ca-cert\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.419363 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.419341    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-envoy\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.419853 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.419833    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-podinfo\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.426641 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.426619    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-token\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.427199 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.427176    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8686\" (UniqueName: \"kubernetes.io/projected/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-kube-api-access-s8686\") pod \"e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") " pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.486983 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.486942    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:48.518163 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.518133    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-workload-certs\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.518339 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.518182    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-workload-socket\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.518339 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.518227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istiod-ca-cert\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.518339 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.518254    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-token\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.518339 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.518286    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-envoy\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.518339 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.518334    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vb4d9\" (UniqueName: \"kubernetes.io/projected/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-kube-api-access-vb4d9\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.518630 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.518384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-podinfo\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.518630 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.518415    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-credential-socket\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.518630 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.518440    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-data\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.518844 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.518817    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-data\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.519282 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.519235    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-credential-socket\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.519393 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.519356    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-workload-certs\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.519663 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.519637    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-workload-socket\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.520314 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.520286    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istiod-ca-cert\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.521867 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.521814    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-podinfo\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.521999 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.521873    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-envoy\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.529159 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.529125    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-token\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.532308 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.532252    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vb4d9\" (UniqueName: \"kubernetes.io/projected/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-kube-api-access-vb4d9\") pod \"e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") " pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.552917 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.552842    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:48.554719 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.554693    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:48.774679 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.774652    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"]
Sep 09 06:01:48.777003 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:01:48.776973    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod431656ac_7a14_4ff8_b26b_7f4f8fcc192b.slice/crio-dcbc115270dd6e93bca091205fe9d623d36991b24f984f90edfde44dbfc5a7a5 WatchSource:0}: Error finding container dcbc115270dd6e93bca091205fe9d623d36991b24f984f90edfde44dbfc5a7a5: Status 404 returned error can't find the container with id dcbc115270dd6e93bca091205fe9d623d36991b24f984f90edfde44dbfc5a7a5
Sep 09 06:01:48.779138 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.779109    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:01:48.779220 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.779172    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:01:48.779220 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.779202    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:01:48.856995 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.856954    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" event={"ID":"431656ac-7a14-4ff8-b26b-7f4f8fcc192b","Type":"ContainerStarted","Data":"79e5771a5cf8cebbf203fb6136543e28487d0813ed8b1d839b9aaffa94fce084"}
Sep 09 06:01:48.857129 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.857039    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" event={"ID":"431656ac-7a14-4ff8-b26b-7f4f8fcc192b","Type":"ContainerStarted","Data":"dcbc115270dd6e93bca091205fe9d623d36991b24f984f90edfde44dbfc5a7a5"}
Sep 09 06:01:48.866759 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.866731    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"]
Sep 09 06:01:48.868399 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:01:48.868372    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbb7cb0_e64b_4be1_9032_b747865ed6ab.slice/crio-17ad64a19a46c7f1b92232f21e1a03e41d4863f2aa269f7e685e0cbcf2252fb2 WatchSource:0}: Error finding container 17ad64a19a46c7f1b92232f21e1a03e41d4863f2aa269f7e685e0cbcf2252fb2: Status 404 returned error can't find the container with id 17ad64a19a46c7f1b92232f21e1a03e41d4863f2aa269f7e685e0cbcf2252fb2
Sep 09 06:01:48.870822 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.870792    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:01:48.870908 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.870848    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:01:48.870908 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.870878    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:01:48.874879 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.874819    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:48.880058 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:48.880008    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" podStartSLOduration=0.879989339 podStartE2EDuration="879.989339ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:01:48.879046547 +0000 UTC m=+730.109543091" watchObservedRunningTime="2026-09-09 06:01:48.879989339 +0000 UTC m=+730.110485889"
Sep 09 06:01:49.289878 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:49.289825    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:49.399027 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:49.398997    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:49.487951 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:49.487913    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:49.493211 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:49.493189    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:49.742578 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:49.742527    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:49.863913 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:49.863874    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" event={"ID":"fbbb7cb0-e64b-4be1-9032-b747865ed6ab","Type":"ContainerStarted","Data":"40f2bc06b1c4fde6b961e211b8f1d5496c1c3a2ed41361de32363d36754459ba"}
Sep 09 06:01:49.864103 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:49.863966    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" event={"ID":"fbbb7cb0-e64b-4be1-9032-b747865ed6ab","Type":"ContainerStarted","Data":"17ad64a19a46c7f1b92232f21e1a03e41d4863f2aa269f7e685e0cbcf2252fb2"}
Sep 09 06:01:49.864171 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:49.864124    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:49.865041 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:49.865020    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:01:49.884137 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:49.884089    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" podStartSLOduration=1.884075859 podStartE2EDuration="1.884075859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:01:49.882349545 +0000 UTC m=+731.112846100" watchObservedRunningTime="2026-09-09 06:01:49.884075859 +0000 UTC m=+731.114572410"
Sep 09 06:01:50.555215 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:50.555179    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:50.560297 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:50.560267    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:50.869519 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:50.869488    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:50.870258 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:50.870238    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:01:50.964700 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:50.964666    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:51.072775 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:51.072733    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:51.792580 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:51.792515    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:51.886882 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:51.886835    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:52.038334 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.038298    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"]
Sep 09 06:01:52.043198 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.043130    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:52.046857 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.046830    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-43eb2d-serving-cert\""
Sep 09 06:01:52.058965 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.058756    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"]
Sep 09 06:01:52.100748 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.100718    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:52.155040 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.155010    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:52.155200 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.155045    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-metrics-certs\") pod \"maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:52.155200 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.155090    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkw95\" (UniqueName: \"kubernetes.io/projected/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-kube-api-access-mkw95\") pod \"maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:52.155200 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.155118    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:52.203285 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.203233    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:52.256238 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.256206    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:52.256238 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.256242    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-metrics-certs\") pod \"maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:52.256473 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.256291    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkw95\" (UniqueName: \"kubernetes.io/projected/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-kube-api-access-mkw95\") pod \"maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:52.256473 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.256319    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:52.256473 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:01:52.256350    2583 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-serving-cert: secret "maas-api-e2e-worker-w4-43eb2d-serving-cert" not found
Sep 09 06:01:52.256473 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:01:52.256416    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-maas-api-tls podName:efad91d5-7d39-4f6e-8ca1-09a57b2efd7d nodeName:}" failed. No retries permitted until 2026-09-09 06:01:52.756400303 +0000 UTC m=+733.986896833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-maas-api-tls") pod "maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d" (UID: "efad91d5-7d39-4f6e-8ca1-09a57b2efd7d") : secret "maas-api-e2e-worker-w4-43eb2d-serving-cert" not found
Sep 09 06:01:52.257081 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.257059    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:52.258930 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.258910    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-metrics-certs\") pod \"maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:52.272318 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.272289    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkw95\" (UniqueName: \"kubernetes.io/projected/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-kube-api-access-mkw95\") pod \"maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:52.509206 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.509138    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:52.755421 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.755379    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:52.760899 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.760810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:52.763404 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.763367    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-maas-api-tls\") pod \"maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:52.835784 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.835745    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:52.956956 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:52.956918    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:53.246279 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:53.246253    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"]
Sep 09 06:01:53.247902 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:01:53.247878    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefad91d5_7d39_4f6e_8ca1_09a57b2efd7d.slice/crio-d00be9e8121454165bb9a943ca7fffb6cd4f3e49c4dfc2dc6b973f96ec42fe77 WatchSource:0}: Error finding container d00be9e8121454165bb9a943ca7fffb6cd4f3e49c4dfc2dc6b973f96ec42fe77: Status 404 returned error can't find the container with id d00be9e8121454165bb9a943ca7fffb6cd4f3e49c4dfc2dc6b973f96ec42fe77
Sep 09 06:01:53.248889 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:53.248851    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:53.353832 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:53.353750    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:53.437116 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:53.437088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:53.821777 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:53.821751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:53.886946 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:53.886908    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d" event={"ID":"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d","Type":"ContainerStarted","Data":"a77676cc7f48833cade04ff86a014e8a62f9ab35c6fadb0ab78caf74038af364"}
Sep 09 06:01:53.887096 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:53.886962    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d" event={"ID":"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d","Type":"ContainerStarted","Data":"d00be9e8121454165bb9a943ca7fffb6cd4f3e49c4dfc2dc6b973f96ec42fe77"}
Sep 09 06:01:53.887096 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:53.887025    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:01:53.927366 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:53.923912    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d" podStartSLOduration=1.368710903 podStartE2EDuration="1.923889638s" totalImagesPullingTime="555.178735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:01:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:01:53.919984745 +0000 UTC m=+735.150481289" watchObservedRunningTime="2026-09-09 06:01:53.923889638 +0000 UTC m=+735.154386191"
Sep 09 06:01:53.928951 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:53.928925    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:54.039785 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.039748    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"]
Sep 09 06:01:54.043415 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.043394    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"
Sep 09 06:01:54.046233 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.046200    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-ecd13e-dockercfg-rvtmv\""
Sep 09 06:01:54.046233 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.046226    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-ecd13e\""
Sep 09 06:01:54.055052 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.054994    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"]
Sep 09 06:01:54.174063 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.174027    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23d25539-04dd-4363-ac3c-bd882f1ee7f3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5\" (UID: \"23d25539-04dd-4363-ac3c-bd882f1ee7f3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"
Sep 09 06:01:54.174234 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.174078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grt9n\" (UniqueName: \"kubernetes.io/projected/23d25539-04dd-4363-ac3c-bd882f1ee7f3-kube-api-access-grt9n\") pod \"payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5\" (UID: \"23d25539-04dd-4363-ac3c-bd882f1ee7f3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"
Sep 09 06:01:54.275224 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.275187    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grt9n\" (UniqueName: \"kubernetes.io/projected/23d25539-04dd-4363-ac3c-bd882f1ee7f3-kube-api-access-grt9n\") pod \"payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5\" (UID: \"23d25539-04dd-4363-ac3c-bd882f1ee7f3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"
Sep 09 06:01:54.275608 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.275305    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23d25539-04dd-4363-ac3c-bd882f1ee7f3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5\" (UID: \"23d25539-04dd-4363-ac3c-bd882f1ee7f3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"
Sep 09 06:01:54.275948 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.275930    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23d25539-04dd-4363-ac3c-bd882f1ee7f3-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5\" (UID: \"23d25539-04dd-4363-ac3c-bd882f1ee7f3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"
Sep 09 06:01:54.283300 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.283265    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grt9n\" (UniqueName: \"kubernetes.io/projected/23d25539-04dd-4363-ac3c-bd882f1ee7f3-kube-api-access-grt9n\") pod \"payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5\" (UID: \"23d25539-04dd-4363-ac3c-bd882f1ee7f3\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"
Sep 09 06:01:54.343965 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.343887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:54.354898 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.354870    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"
Sep 09 06:01:54.628450 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.628424    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"]
Sep 09 06:01:54.631428 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:01:54.631401    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d25539_04dd_4363_ac3c_bd882f1ee7f3.slice/crio-aea8f7b79b0eb3fb23963b08e25b3f1542cb5b30cc59e381296960ad616294d4 WatchSource:0}: Error finding container aea8f7b79b0eb3fb23963b08e25b3f1542cb5b30cc59e381296960ad616294d4: Status 404 returned error can't find the container with id aea8f7b79b0eb3fb23963b08e25b3f1542cb5b30cc59e381296960ad616294d4
Sep 09 06:01:54.893845 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.893758    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5" event={"ID":"23d25539-04dd-4363-ac3c-bd882f1ee7f3","Type":"ContainerStarted","Data":"5238ee74233c57b0db87de2de6dd3a4c1835f09c449b6ceb4c5d470b2ef5f021"}
Sep 09 06:01:54.894054 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.894041    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"
Sep 09 06:01:54.894109 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.894069    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5" event={"ID":"23d25539-04dd-4363-ac3c-bd882f1ee7f3","Type":"ContainerStarted","Data":"aea8f7b79b0eb3fb23963b08e25b3f1542cb5b30cc59e381296960ad616294d4"}
Sep 09 06:01:54.910083 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:54.910037    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5" podStartSLOduration=0.910021834 podStartE2EDuration="910.021834ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:01:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:01:54.908705634 +0000 UTC m=+736.139202189" watchObservedRunningTime="2026-09-09 06:01:54.910021834 +0000 UTC m=+736.140518386"
Sep 09 06:01:55.136685 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:55.136652    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:55.726710 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:55.726671    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:55.825517 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:55.825486    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:55.956919 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:55.956878    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:56.253507 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.253473    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"]
Sep 09 06:01:56.257734 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.257706    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.259961 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.259934    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c53eb05a-openshift-default-dockercfg-5bzsh\""
Sep 09 06:01:56.267652 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.267624    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"]
Sep 09 06:01:56.282035 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.281963    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:56.297332 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.297301    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96443af3-585f-41c9-9699-0afffa239f48-istio-token\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.297332 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.297337    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-istio-data\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.297601 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.297374    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-credential-socket\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.297601 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.297395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96443af3-585f-41c9-9699-0afffa239f48-istio-podinfo\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.297601 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.297410    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96443af3-585f-41c9-9699-0afffa239f48-istiod-ca-cert\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.297601 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.297518    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-istio-envoy\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.297601 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.297589    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k75vc\" (UniqueName: \"kubernetes.io/projected/96443af3-585f-41c9-9699-0afffa239f48-kube-api-access-k75vc\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.297872 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.297620    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-workload-socket\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.297872 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.297653    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-workload-certs\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.398633 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.398593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k75vc\" (UniqueName: \"kubernetes.io/projected/96443af3-585f-41c9-9699-0afffa239f48-kube-api-access-k75vc\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.398829 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.398642    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-workload-socket\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.398829 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.398678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-workload-certs\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.398829 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.398712    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96443af3-585f-41c9-9699-0afffa239f48-istio-token\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.398829 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.398739    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-istio-data\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.398829 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.398781    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-credential-socket\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.398829 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.398809    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96443af3-585f-41c9-9699-0afffa239f48-istio-podinfo\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.399131 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.398831    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96443af3-585f-41c9-9699-0afffa239f48-istiod-ca-cert\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.399131 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.398916    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-istio-envoy\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.399131 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.399115    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-workload-certs\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.399303 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.399174    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-credential-socket\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.399453 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.399430    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-istio-data\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.399544 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.399519    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-workload-socket\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.399904 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.399817    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96443af3-585f-41c9-9699-0afffa239f48-istiod-ca-cert\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.401482 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.401460    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-istio-envoy\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.401740 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.401721    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96443af3-585f-41c9-9699-0afffa239f48-istio-podinfo\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.406637 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.406617    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96443af3-585f-41c9-9699-0afffa239f48-istio-token\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.406906 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.406887    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k75vc\" (UniqueName: \"kubernetes.io/projected/96443af3-585f-41c9-9699-0afffa239f48-kube-api-access-k75vc\") pod \"e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") " pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.570619 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.570513    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:56.597658 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.597623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:56.859346 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.859317    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"]
Sep 09 06:01:56.861461 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:01:56.861421    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96443af3_585f_41c9_9699_0afffa239f48.slice/crio-52c0f9f1c373aade884435911a5611b94a92f3cafb14584e91506ff4236c96cb WatchSource:0}: Error finding container 52c0f9f1c373aade884435911a5611b94a92f3cafb14584e91506ff4236c96cb: Status 404 returned error can't find the container with id 52c0f9f1c373aade884435911a5611b94a92f3cafb14584e91506ff4236c96cb
Sep 09 06:01:56.863894 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.863857    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:01:56.863986 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.863950    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:01:56.864021 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.863998    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:01:56.907042 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:56.907011    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" event={"ID":"96443af3-585f-41c9-9699-0afffa239f48","Type":"ContainerStarted","Data":"52c0f9f1c373aade884435911a5611b94a92f3cafb14584e91506ff4236c96cb"}
Sep 09 06:01:57.913742 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:57.913702    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" event={"ID":"96443af3-585f-41c9-9699-0afffa239f48","Type":"ContainerStarted","Data":"fb569153e71e1d0eaa5084618578d5245b1bf176fa5242a2f6ef3a3c642d64b6"}
Sep 09 06:01:57.955149 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:57.955096    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" podStartSLOduration=1.955079909 podStartE2EDuration="1.955079909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:01:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:01:57.953454345 +0000 UTC m=+739.183950897" watchObservedRunningTime="2026-09-09 06:01:57.955079909 +0000 UTC m=+739.185576522"
Sep 09 06:01:58.571066 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:58.571026    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:58.600290 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:58.600245    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:58.922933 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:58.922896    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:58.928648 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:58.928337    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:01:59.294931 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:59.294834    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:59.392788 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:59.392726    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:01:59.907919 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:01:59.907888    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:02:00.439182 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:00.439149    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:00.530231 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:00.530194    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:00.717231 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:00.717086    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:00.814956 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:00.814865    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:00.916056 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:00.915979    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:00.987372 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:00.987259    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"]
Sep 09 06:02:00.996521 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:00.996495    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.014576 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.014497    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"]
Sep 09 06:02:01.015646 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.014880    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-7a357a-openshift-default-dockercfg-hmvk8\""
Sep 09 06:02:01.016004 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.015975    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:01.071444 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.071413    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-workload-certs\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.071648 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.071489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-credential-socket\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.071648 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.071534    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-workload-socket\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.071648 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.071644    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-podinfo\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.071828 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.071674    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-envoy\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.071828 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.071731    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istiod-ca-cert\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.071828 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.071759    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-data\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.071975 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.071829    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmvbb\" (UniqueName: \"kubernetes.io/projected/9d8a8835-6a94-402b-b561-751e5ce0a8a2-kube-api-access-zmvbb\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.071975 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.071876    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-token\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.098582 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.088005    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:01.187641 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.187600    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-workload-socket\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.188366 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.188343    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-podinfo\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.189012 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.188993    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-envoy\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.189498 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.189479    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istiod-ca-cert\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.189668 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.189649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-data\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.189800 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.189783    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvbb\" (UniqueName: \"kubernetes.io/projected/9d8a8835-6a94-402b-b561-751e5ce0a8a2-kube-api-access-zmvbb\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.189915 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.189900    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-token\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.190052 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.190039    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-workload-certs\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.190199 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.190186    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-credential-socket\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.194576 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.190887    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-data\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.194576 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.188243    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-workload-socket\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.194576 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.191536    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istiod-ca-cert\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.194576 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.192245    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-workload-certs\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.195540 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.195518    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-podinfo\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.195755 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.195737    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-credential-socket\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.199577 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.196775    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-envoy\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.206380 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.206314    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmvbb\" (UniqueName: \"kubernetes.io/projected/9d8a8835-6a94-402b-b561-751e5ce0a8a2-kube-api-access-zmvbb\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.234755 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.234715    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-token\") pod \"e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") " pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.353827 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.353743    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:01.579199 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.579043    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:01.708808 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.691769    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"]
Sep 09 06:02:01.733390 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.733345    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:01.733616 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.733441    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:01.733616 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.733480    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:01.957934 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.957845    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx" event={"ID":"9d8a8835-6a94-402b-b561-751e5ce0a8a2","Type":"ContainerStarted","Data":"3242677a6f9088b6a1bc7726957311e392066cc51285448da32121b566df727b"}
Sep 09 06:02:01.957934 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.957921    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx" event={"ID":"9d8a8835-6a94-402b-b561-751e5ce0a8a2","Type":"ContainerStarted","Data":"5cd26ca5321c4128015d652464ee6eeece49e7d2a7e5a25a2b03d083ea1fd6bf"}
Sep 09 06:02:01.980026 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:01.979951    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx" podStartSLOduration=1.979931973 podStartE2EDuration="1.979931973s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:02:01.976329112 +0000 UTC m=+743.206825665" watchObservedRunningTime="2026-09-09 06:02:01.979931973 +0000 UTC m=+743.210428526"
Sep 09 06:02:02.354606 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:02.354501    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:02.359502 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:02.359475    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:02.964067 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:02.964030    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:02.965055 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:02.965034    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:03.873862 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:03.873808    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:03.974839 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:03.974813    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:05.036462 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.036386    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:05.137812 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.137775    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:05.238089 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.237963    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:05.603091 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.602979    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:05.707334 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.707295    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:05.743988 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.743857    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"]
Sep 09 06:02:05.749240 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.749216    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"
Sep 09 06:02:05.751877 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.751730    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-7a357a\""
Sep 09 06:02:05.751877 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.751765    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-7a357a-dockercfg-jxtkf\""
Sep 09 06:02:05.758292 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.758261    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"]
Sep 09 06:02:05.858116 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.858024    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cce65706-6de0-4715-8088-eb46e67228c9-plugins-config-volume\") pod \"payload-processing-e2e-autores-7a357a-6b64797769-b8h8h\" (UID: \"cce65706-6de0-4715-8088-eb46e67228c9\") " pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"
Sep 09 06:02:05.858116 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.858078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2skh6\" (UniqueName: \"kubernetes.io/projected/cce65706-6de0-4715-8088-eb46e67228c9-kube-api-access-2skh6\") pod \"payload-processing-e2e-autores-7a357a-6b64797769-b8h8h\" (UID: \"cce65706-6de0-4715-8088-eb46e67228c9\") " pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"
Sep 09 06:02:05.905770 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.905727    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 06:02:05.905943 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.905791    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 06:02:05.958830 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.958792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cce65706-6de0-4715-8088-eb46e67228c9-plugins-config-volume\") pod \"payload-processing-e2e-autores-7a357a-6b64797769-b8h8h\" (UID: \"cce65706-6de0-4715-8088-eb46e67228c9\") " pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"
Sep 09 06:02:05.959023 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.958846    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2skh6\" (UniqueName: \"kubernetes.io/projected/cce65706-6de0-4715-8088-eb46e67228c9-kube-api-access-2skh6\") pod \"payload-processing-e2e-autores-7a357a-6b64797769-b8h8h\" (UID: \"cce65706-6de0-4715-8088-eb46e67228c9\") " pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"
Sep 09 06:02:05.959523 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.959501    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cce65706-6de0-4715-8088-eb46e67228c9-plugins-config-volume\") pod \"payload-processing-e2e-autores-7a357a-6b64797769-b8h8h\" (UID: \"cce65706-6de0-4715-8088-eb46e67228c9\") " pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"
Sep 09 06:02:05.970381 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:05.970347    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2skh6\" (UniqueName: \"kubernetes.io/projected/cce65706-6de0-4715-8088-eb46e67228c9-kube-api-access-2skh6\") pod \"payload-processing-e2e-autores-7a357a-6b64797769-b8h8h\" (UID: \"cce65706-6de0-4715-8088-eb46e67228c9\") " pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"
Sep 09 06:02:06.063815 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:06.063776    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"
Sep 09 06:02:06.362533 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:06.362510    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"]
Sep 09 06:02:06.366150 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:02:06.366101    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce65706_6de0_4715_8088_eb46e67228c9.slice/crio-5bf7b9a958008407190b376800f8fd4e858d6cd02955b2b3fbf883073c791ab2 WatchSource:0}: Error finding container 5bf7b9a958008407190b376800f8fd4e858d6cd02955b2b3fbf883073c791ab2: Status 404 returned error can't find the container with id 5bf7b9a958008407190b376800f8fd4e858d6cd02955b2b3fbf883073c791ab2
Sep 09 06:02:06.651099 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:06.651010    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:06.793824 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:06.793699    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:06.909183 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:06.909078    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:06.909732 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:06.909709    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"
Sep 09 06:02:06.911720 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:06.911684    2583 patch_prober.go:28] interesting pod/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 06:02:06.911844 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:06.911735    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 06:02:07.014583 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:07.012549    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h" event={"ID":"cce65706-6de0-4715-8088-eb46e67228c9","Type":"ContainerStarted","Data":"a269031aea6efea970c223bfc82f512a246a973fb1d6e7052aff71194f9472cf"}
Sep 09 06:02:07.014583 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:07.012619    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h" event={"ID":"cce65706-6de0-4715-8088-eb46e67228c9","Type":"ContainerStarted","Data":"5bf7b9a958008407190b376800f8fd4e858d6cd02955b2b3fbf883073c791ab2"}
Sep 09 06:02:07.014583 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:07.012641    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"
Sep 09 06:02:07.030499 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:07.030417    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h" podStartSLOduration=2.030397455 podStartE2EDuration="2.030397455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:02:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:02:07.028329651 +0000 UTC m=+748.258826206" watchObservedRunningTime="2026-09-09 06:02:07.030397455 +0000 UTC m=+748.260894007"
Sep 09 06:02:07.111309 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:07.111211    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:08.022452 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:08.022366    2583 generic.go:356] "Generic (PLEG): container finished" podID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerID="79e5771a5cf8cebbf203fb6136543e28487d0813ed8b1d839b9aaffa94fce084" exitCode=0
Sep 09 06:02:08.022692 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:08.022445    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" event={"ID":"431656ac-7a14-4ff8-b26b-7f4f8fcc192b","Type":"ContainerDied","Data":"79e5771a5cf8cebbf203fb6136543e28487d0813ed8b1d839b9aaffa94fce084"}
Sep 09 06:02:08.023049 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:08.023030    2583 scope.go:117] "RemoveContainer" containerID="79e5771a5cf8cebbf203fb6136543e28487d0813ed8b1d839b9aaffa94fce084"
Sep 09 06:02:08.024467 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:08.024429    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:08.024545 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:08.024516    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:08.024655 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:08.024637    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:09.030769 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:09.030736    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" event={"ID":"431656ac-7a14-4ff8-b26b-7f4f8fcc192b","Type":"ContainerStarted","Data":"5c77c7bcd20c3353485ff4419e10b1ffa80c662031aac949666b1e8217ba738e"}
Sep 09 06:02:09.032631 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:09.032607    2583 generic.go:356] "Generic (PLEG): container finished" podID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerID="40f2bc06b1c4fde6b961e211b8f1d5496c1c3a2ed41361de32363d36754459ba" exitCode=0
Sep 09 06:02:09.032692 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:09.032658    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" event={"ID":"fbbb7cb0-e64b-4be1-9032-b747865ed6ab","Type":"ContainerDied","Data":"40f2bc06b1c4fde6b961e211b8f1d5496c1c3a2ed41361de32363d36754459ba"}
Sep 09 06:02:09.033036 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:09.033020    2583 scope.go:117] "RemoveContainer" containerID="40f2bc06b1c4fde6b961e211b8f1d5496c1c3a2ed41361de32363d36754459ba"
Sep 09 06:02:09.034032 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:09.034007    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:09.034086 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:09.034071    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:09.034124 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:09.034102    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:09.488004 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:09.487973    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:02:09.488370 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:09.488278    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 09 06:02:09.488532 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:09.488510    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 09 06:02:09.680087 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:09.680045    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:10.040316 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:10.040281    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" event={"ID":"fbbb7cb0-e64b-4be1-9032-b747865ed6ab","Type":"ContainerStarted","Data":"2b637ae367bba4bfe166f4dacfa8faeef49d6afc6f32b0f29319dc51706f0d87"}
Sep 09 06:02:10.487490 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:10.487444    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 09 06:02:10.487716 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:10.487517    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 09 06:02:10.555094 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:10.555062    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:02:10.555317 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:10.555294    2583 patch_prober.go:28] interesting pod/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 09 06:02:10.555367 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:10.555347    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 09 06:02:11.309666 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:11.309625    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:11.487691 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:11.487656    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 09 06:02:11.487880 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:11.487714    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 09 06:02:11.555449 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:11.555119    2583 patch_prober.go:28] interesting pod/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 09 06:02:11.555449 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:11.555169    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 09 06:02:12.488640 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:12.488165    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 09 06:02:12.488640 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:12.488230    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 09 06:02:12.556027 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:12.555990    2583 patch_prober.go:28] interesting pod/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 09 06:02:12.556194 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:12.556047    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 09 06:02:12.951405 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:12.951367    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:13.052202 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:13.052141    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:13.360306 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:13.360211    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:13.458710 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:13.458670    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:13.491582 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:13.487936    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 09 06:02:13.491582 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:13.488002    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 09 06:02:13.555885 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:13.555855    2583 patch_prober.go:28] interesting pod/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 09 06:02:13.556058 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:13.555912    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 09 06:02:14.556188 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:14.556121    2583 patch_prober.go:28] interesting pod/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 09 06:02:14.556666 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:14.556195    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 09 06:02:14.721203 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:14.721164    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:14.903353 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:14.903307    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:02:14.904078 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:14.904018    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:02:14.938270 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:14.938240    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:02:14.963705 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:14.963665    2583 patch_prober.go:28] interesting pod/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 06:02:14.964943 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:14.963727    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" podUID="96443af3-585f-41c9-9699-0afffa239f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 06:02:15.548118 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:15.548035    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:15.556074 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:15.556050    2583 patch_prober.go:28] interesting pod/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 09 06:02:15.556189 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:15.556101    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 09 06:02:15.761666 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:15.761631    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:16.078237 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:16.078199    2583 generic.go:356] "Generic (PLEG): container finished" podID="96443af3-585f-41c9-9699-0afffa239f48" containerID="fb569153e71e1d0eaa5084618578d5245b1bf176fa5242a2f6ef3a3c642d64b6" exitCode=0
Sep 09 06:02:16.078532 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:16.078278    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" event={"ID":"96443af3-585f-41c9-9699-0afffa239f48","Type":"ContainerDied","Data":"fb569153e71e1d0eaa5084618578d5245b1bf176fa5242a2f6ef3a3c642d64b6"}
Sep 09 06:02:16.079146 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:16.079122    2583 scope.go:117] "RemoveContainer" containerID="fb569153e71e1d0eaa5084618578d5245b1bf176fa5242a2f6ef3a3c642d64b6"
Sep 09 06:02:16.080574 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:16.080523    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:16.080679 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:16.080631    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:16.080746 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:16.080679    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:16.219135 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:16.219101    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:16.320725 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:16.320681    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:16.525859 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:16.525825    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:16.558903 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:16.558875    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:02:16.559179 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:16.559163    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:02:16.559886 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:16.559864    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:02:16.867162 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:16.867136    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:17.089749 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.089712    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" event={"ID":"96443af3-585f-41c9-9699-0afffa239f48","Type":"ContainerStarted","Data":"0130058cbe5751c079c8698c7fc5505863df56f589928211c5957791dca657fe"}
Sep 09 06:02:17.120356 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.120281    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:17.381636 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.381523    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"]
Sep 09 06:02:17.386141 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.385089    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.398579 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.390845    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-fe8eaa-openshift-default-dockercfg-6pcgr\""
Sep 09 06:02:17.404875 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.403767    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"]
Sep 09 06:02:17.430616 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.430185    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-workload-socket\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.430616 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.430225    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqghz\" (UniqueName: \"kubernetes.io/projected/b8662601-8cfb-4491-aae3-f52f4eededad-kube-api-access-kqghz\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.430616 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.430259    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-istio-envoy\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.430616 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.430277    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-istio-data\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.430616 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.430305    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-workload-certs\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.430616 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.430327    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8662601-8cfb-4491-aae3-f52f4eededad-istio-podinfo\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.430616 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.430344    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8662601-8cfb-4491-aae3-f52f4eededad-istio-token\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.430616 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.430363    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8662601-8cfb-4491-aae3-f52f4eededad-istiod-ca-cert\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.430616 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.430381    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-credential-socket\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.436113 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.436076    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:17.531770 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.531732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-workload-socket\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.531974 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.531791    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqghz\" (UniqueName: \"kubernetes.io/projected/b8662601-8cfb-4491-aae3-f52f4eededad-kube-api-access-kqghz\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.531974 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.531865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-istio-envoy\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.531974 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.531898    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-istio-data\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.531974 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.531941    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-workload-certs\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.531974 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.531968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8662601-8cfb-4491-aae3-f52f4eededad-istio-podinfo\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.532241 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.531987    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8662601-8cfb-4491-aae3-f52f4eededad-istio-token\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.532241 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.532005    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8662601-8cfb-4491-aae3-f52f4eededad-istiod-ca-cert\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.532241 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.532030    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-credential-socket\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.532789 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.532424    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-istio-data\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.532789 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.532550    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-credential-socket\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.532789 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.532671    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-workload-certs\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.532789 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.532739    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-workload-socket\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.533137 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.533118    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8662601-8cfb-4491-aae3-f52f4eededad-istiod-ca-cert\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.534920 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.534896    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8662601-8cfb-4491-aae3-f52f4eededad-istio-podinfo\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.535098 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.535078    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-istio-envoy\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.543002 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.542966    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8662601-8cfb-4491-aae3-f52f4eededad-istio-token\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.543471 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.543447    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqghz\" (UniqueName: \"kubernetes.io/projected/b8662601-8cfb-4491-aae3-f52f4eededad-kube-api-access-kqghz\") pod \"e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") " pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.572582 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.570897    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:02:17.572582 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.571011    2583 patch_prober.go:28] interesting pod/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 09 06:02:17.572582 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.571050    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" podUID="96443af3-585f-41c9-9699-0afffa239f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 09 06:02:17.728914 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.728643    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:17.846406 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:17.846169    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:18.029984 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:18.029159    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"
Sep 09 06:02:18.063858 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:18.063745    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"]
Sep 09 06:02:18.067008 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:02:18.066973    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8662601_8cfb_4491_aae3_f52f4eededad.slice/crio-047ebbc975c057f16d1f7a97afa806993f684039c67d4de6a978db5bc9daa5f5 WatchSource:0}: Error finding container 047ebbc975c057f16d1f7a97afa806993f684039c67d4de6a978db5bc9daa5f5: Status 404 returned error can't find the container with id 047ebbc975c057f16d1f7a97afa806993f684039c67d4de6a978db5bc9daa5f5
Sep 09 06:02:18.070178 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:18.070140    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:18.070292 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:18.070226    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:18.070292 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:18.070265    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:18.131813 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:18.131780    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj" event={"ID":"b8662601-8cfb-4491-aae3-f52f4eededad","Type":"ContainerStarted","Data":"047ebbc975c057f16d1f7a97afa806993f684039c67d4de6a978db5bc9daa5f5"}
Sep 09 06:02:18.571225 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:18.571188    2583 patch_prober.go:28] interesting pod/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 09 06:02:18.571394 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:18.571255    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" podUID="96443af3-585f-41c9-9699-0afffa239f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 09 06:02:19.139933 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:19.139894    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj" event={"ID":"b8662601-8cfb-4491-aae3-f52f4eededad","Type":"ContainerStarted","Data":"df9994ccc2989ff09fba8ef2fa96143c6b84d97f81743e9e3eaf682423f6a871"}
Sep 09 06:02:19.163188 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:19.163136    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj" podStartSLOduration=2.163120147 podStartE2EDuration="2.163120147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:02:19.160393189 +0000 UTC m=+760.390889764" watchObservedRunningTime="2026-09-09 06:02:19.163120147 +0000 UTC m=+760.393616699"
Sep 09 06:02:19.571004 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:19.570915    2583 patch_prober.go:28] interesting pod/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 09 06:02:19.571004 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:19.570977    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" podUID="96443af3-585f-41c9-9699-0afffa239f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 09 06:02:19.729183 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:19.729143    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:19.735066 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:19.735036    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:19.751370 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:19.751309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:19.853535 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:19.853469    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:19.952044 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:19.952002    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:20.129828 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:20.129795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:20.152219 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:20.152188    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:20.153609 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:20.153589    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:20.571440 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:20.571353    2583 patch_prober.go:28] interesting pod/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 09 06:02:20.571440 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:20.571422    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" podUID="96443af3-585f-41c9-9699-0afffa239f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 09 06:02:21.062684 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:21.062641    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:21.156303 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:21.156273    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:21.570825 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:21.570790    2583 patch_prober.go:28] interesting pod/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 09 06:02:21.571020 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:21.570852    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" podUID="96443af3-585f-41c9-9699-0afffa239f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 09 06:02:21.735286 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:21.735252    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:22.571511 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:22.571475    2583 patch_prober.go:28] interesting pod/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 09 06:02:22.572022 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:22.571545    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" podUID="96443af3-585f-41c9-9699-0afffa239f48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 09 06:02:22.608262 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:22.608215    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:22.701859 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:22.701826    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:22.854981 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:22.854893    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:23.099742 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:23.099706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:23.261192 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:23.261156    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:23.655291 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:23.655247    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:23.704033 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:23.704001    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:02:23.704412 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:23.704387    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:02:23.705208 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:23.705177    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:02:24.185045 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:24.185011    2583 generic.go:356] "Generic (PLEG): container finished" podID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" containerID="3242677a6f9088b6a1bc7726957311e392066cc51285448da32121b566df727b" exitCode=0
Sep 09 06:02:24.185209 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:24.185083    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx" event={"ID":"9d8a8835-6a94-402b-b561-751e5ce0a8a2","Type":"ContainerDied","Data":"3242677a6f9088b6a1bc7726957311e392066cc51285448da32121b566df727b"}
Sep 09 06:02:24.185604 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:24.185586    2583 scope.go:117] "RemoveContainer" containerID="3242677a6f9088b6a1bc7726957311e392066cc51285448da32121b566df727b"
Sep 09 06:02:24.186607 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:24.186582    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:24.186671 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:24.186649    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:24.186708 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:24.186681    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:24.511247 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:24.511131    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:25.201021 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:25.200983    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx" event={"ID":"9d8a8835-6a94-402b-b561-751e5ce0a8a2","Type":"ContainerStarted","Data":"e2f5e35696d443fe07812442cfd5afd941dc2747bd6765833e376953be1668c1"}
Sep 09 06:02:25.354244 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:25.354214    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:25.354535 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:25.354510    2583 patch_prober.go:28] interesting pod/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 06:02:25.354712 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:25.354606    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx" podUID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 06:02:25.360321 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:25.360295    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:26.095023 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:26.094987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:26.187242 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:26.187131    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:26.354800 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:26.354716    2583 patch_prober.go:28] interesting pod/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 06:02:26.354800 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:26.354777    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx" podUID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 06:02:27.355031 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:27.354997    2583 patch_prober.go:28] interesting pod/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 06:02:27.355418 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:27.355051    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx" podUID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 06:02:28.354360 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:28.354328    2583 patch_prober.go:28] interesting pod/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 06:02:28.354527 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:28.354382    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx" podUID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 06:02:28.833802 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:28.833766    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:29.354488 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:29.354455    2583 patch_prober.go:28] interesting pod/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 09 06:02:29.354678 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:29.354506    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx" podUID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 09 06:02:30.569239 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:30.569199    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:30.569702 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:30.569644    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:30.570505 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:30.570483    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:02:36.923172 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:36.923134    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:39.279502 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:39.279429    2583 generic.go:356] "Generic (PLEG): container finished" podID="b8662601-8cfb-4491-aae3-f52f4eededad" containerID="df9994ccc2989ff09fba8ef2fa96143c6b84d97f81743e9e3eaf682423f6a871" exitCode=0
Sep 09 06:02:39.279906 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:39.279499    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj" event={"ID":"b8662601-8cfb-4491-aae3-f52f4eededad","Type":"ContainerDied","Data":"df9994ccc2989ff09fba8ef2fa96143c6b84d97f81743e9e3eaf682423f6a871"}
Sep 09 06:02:39.279954 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:39.279934    2583 scope.go:117] "RemoveContainer" containerID="df9994ccc2989ff09fba8ef2fa96143c6b84d97f81743e9e3eaf682423f6a871"
Sep 09 06:02:39.280996 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:39.280972    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:39.281059 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:39.281050    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:39.281094 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:39.281081    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:02:40.294747 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:40.294701    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj" event={"ID":"b8662601-8cfb-4491-aae3-f52f4eededad","Type":"ContainerStarted","Data":"2c1dc7f849bbf4ac2304469ff1f6946c74b6926cead36efa3710e3c064ab9b5c"}
Sep 09 06:02:40.729163 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:40.729126    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:40.729438 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:40.729420    2583 patch_prober.go:28] interesting pod/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 06:02:40.729485 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:40.729466    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj" podUID="b8662601-8cfb-4491-aae3-f52f4eededad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 06:02:41.497147 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:41.497075    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:41.507190 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:41.507157    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"]
Sep 09 06:02:41.507456 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:41.507422    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" podUID="96443af3-585f-41c9-9699-0afffa239f48" containerName="istio-proxy" containerID="cri-o://0130058cbe5751c079c8698c7fc5505863df56f589928211c5957791dca657fe" gracePeriod=30
Sep 09 06:02:41.563805 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:41.563768    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:41.729313 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:41.729279    2583 patch_prober.go:28] interesting pod/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 06:02:41.729502 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:41.729373    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj" podUID="b8662601-8cfb-4491-aae3-f52f4eededad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 06:02:42.006457 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:42.006416    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:42.073012 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:42.072918    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:42.729507 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:42.729477    2583 patch_prober.go:28] interesting pod/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 06:02:42.729909 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:42.729531    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj" podUID="b8662601-8cfb-4491-aae3-f52f4eededad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 06:02:43.142711 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:43.142678    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:43.200819 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:43.200783    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:43.730000 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:43.729950    2583 patch_prober.go:28] interesting pod/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 06:02:43.730504 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:43.730021    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj" podUID="b8662601-8cfb-4491-aae3-f52f4eededad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 06:02:43.769609 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:43.769546    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:44.729910 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:44.729874    2583 patch_prober.go:28] interesting pod/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 09 06:02:44.730078 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:44.729942    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj" podUID="b8662601-8cfb-4491-aae3-f52f4eededad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 09 06:02:45.217910 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:45.217850    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:45.321717 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:45.321681    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:45.537361 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:45.537260    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:45.596703 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:45.596663    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:45.733396 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:45.733366    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:45.733834 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:45.733760    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:45.734437 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:45.734416    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:02:45.909294 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:45.909262    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:46.088460 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.088427    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:46.197144 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.197062    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:46.279913 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.279878    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:02:46.767026 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.767003    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:02:46.871016 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.870994    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-credential-socket\") pod \"96443af3-585f-41c9-9699-0afffa239f48\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") "
Sep 09 06:02:46.871200 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.871037    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96443af3-585f-41c9-9699-0afffa239f48-istio-podinfo\") pod \"96443af3-585f-41c9-9699-0afffa239f48\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") "
Sep 09 06:02:46.871200 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.871077    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-workload-socket\") pod \"96443af3-585f-41c9-9699-0afffa239f48\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") "
Sep 09 06:02:46.871200 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.871094    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-istio-envoy\") pod \"96443af3-585f-41c9-9699-0afffa239f48\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") "
Sep 09 06:02:46.871200 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.871120    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-workload-certs\") pod \"96443af3-585f-41c9-9699-0afffa239f48\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") "
Sep 09 06:02:46.871200 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.871180    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-istio-data\") pod \"96443af3-585f-41c9-9699-0afffa239f48\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") "
Sep 09 06:02:46.871469 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.871206    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96443af3-585f-41c9-9699-0afffa239f48-istio-token\") pod \"96443af3-585f-41c9-9699-0afffa239f48\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") "
Sep 09 06:02:46.871469 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.871245    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96443af3-585f-41c9-9699-0afffa239f48-istiod-ca-cert\") pod \"96443af3-585f-41c9-9699-0afffa239f48\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") "
Sep 09 06:02:46.871469 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.871286    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k75vc\" (UniqueName: \"kubernetes.io/projected/96443af3-585f-41c9-9699-0afffa239f48-kube-api-access-k75vc\") pod \"96443af3-585f-41c9-9699-0afffa239f48\" (UID: \"96443af3-585f-41c9-9699-0afffa239f48\") "
Sep 09 06:02:46.871469 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.871377    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "96443af3-585f-41c9-9699-0afffa239f48" (UID: "96443af3-585f-41c9-9699-0afffa239f48"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:02:46.871702 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.871662    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "96443af3-585f-41c9-9699-0afffa239f48" (UID: "96443af3-585f-41c9-9699-0afffa239f48"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:02:46.871702 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.871686    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96443af3-585f-41c9-9699-0afffa239f48-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "96443af3-585f-41c9-9699-0afffa239f48" (UID: "96443af3-585f-41c9-9699-0afffa239f48"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:02:46.871807 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.871724    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-workload-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:02:46.871807 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.871721    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-istio-data" (OuterVolumeSpecName: "istio-data") pod "96443af3-585f-41c9-9699-0afffa239f48" (UID: "96443af3-585f-41c9-9699-0afffa239f48"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:02:46.872022 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.871992    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "96443af3-585f-41c9-9699-0afffa239f48" (UID: "96443af3-585f-41c9-9699-0afffa239f48"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:02:46.873758 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.873732    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/96443af3-585f-41c9-9699-0afffa239f48-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "96443af3-585f-41c9-9699-0afffa239f48" (UID: "96443af3-585f-41c9-9699-0afffa239f48"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 06:02:46.874148 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.874113    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "96443af3-585f-41c9-9699-0afffa239f48" (UID: "96443af3-585f-41c9-9699-0afffa239f48"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:02:46.874248 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.874181    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96443af3-585f-41c9-9699-0afffa239f48-kube-api-access-k75vc" (OuterVolumeSpecName: "kube-api-access-k75vc") pod "96443af3-585f-41c9-9699-0afffa239f48" (UID: "96443af3-585f-41c9-9699-0afffa239f48"). InnerVolumeSpecName "kube-api-access-k75vc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:02:46.874306 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.874266    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96443af3-585f-41c9-9699-0afffa239f48-istio-token" (OuterVolumeSpecName: "istio-token") pod "96443af3-585f-41c9-9699-0afffa239f48" (UID: "96443af3-585f-41c9-9699-0afffa239f48"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:02:46.972830 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.972801    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-credential-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:02:46.972830 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.972825    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/96443af3-585f-41c9-9699-0afffa239f48-istio-podinfo\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:02:46.972830 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.972835    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-istio-envoy\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:02:46.972830 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.972842    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-workload-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:02:46.973184 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.972850    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/96443af3-585f-41c9-9699-0afffa239f48-istio-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:02:46.973184 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.972857    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/96443af3-585f-41c9-9699-0afffa239f48-istio-token\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:02:46.973184 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.972864    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/96443af3-585f-41c9-9699-0afffa239f48-istiod-ca-cert\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:02:46.973184 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:46.972871    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k75vc\" (UniqueName: \"kubernetes.io/projected/96443af3-585f-41c9-9699-0afffa239f48-kube-api-access-k75vc\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:02:47.340380 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:47.340343    2583 generic.go:356] "Generic (PLEG): container finished" podID="96443af3-585f-41c9-9699-0afffa239f48" containerID="0130058cbe5751c079c8698c7fc5505863df56f589928211c5957791dca657fe" exitCode=0
Sep 09 06:02:47.340578 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:47.340400    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"
Sep 09 06:02:47.340578 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:47.340428    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" event={"ID":"96443af3-585f-41c9-9699-0afffa239f48","Type":"ContainerDied","Data":"0130058cbe5751c079c8698c7fc5505863df56f589928211c5957791dca657fe"}
Sep 09 06:02:47.340578 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:47.340481    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc" event={"ID":"96443af3-585f-41c9-9699-0afffa239f48","Type":"ContainerDied","Data":"52c0f9f1c373aade884435911a5611b94a92f3cafb14584e91506ff4236c96cb"}
Sep 09 06:02:47.340578 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:47.340507    2583 scope.go:117] "RemoveContainer" containerID="0130058cbe5751c079c8698c7fc5505863df56f589928211c5957791dca657fe"
Sep 09 06:02:47.350474 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:47.350443    2583 scope.go:117] "RemoveContainer" containerID="fb569153e71e1d0eaa5084618578d5245b1bf176fa5242a2f6ef3a3c642d64b6"
Sep 09 06:02:47.357753 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:47.357726    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"]
Sep 09 06:02:47.360734 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:47.360711    2583 scope.go:117] "RemoveContainer" containerID="0130058cbe5751c079c8698c7fc5505863df56f589928211c5957791dca657fe"
Sep 09 06:02:47.361058 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:02:47.361034    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0130058cbe5751c079c8698c7fc5505863df56f589928211c5957791dca657fe\": container with ID starting with 0130058cbe5751c079c8698c7fc5505863df56f589928211c5957791dca657fe not found: ID does not exist" containerID="0130058cbe5751c079c8698c7fc5505863df56f589928211c5957791dca657fe"
Sep 09 06:02:47.361130 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:47.361070    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0130058cbe5751c079c8698c7fc5505863df56f589928211c5957791dca657fe"} err="failed to get container status \"0130058cbe5751c079c8698c7fc5505863df56f589928211c5957791dca657fe\": rpc error: code = NotFound desc = could not find container \"0130058cbe5751c079c8698c7fc5505863df56f589928211c5957791dca657fe\": container with ID starting with 0130058cbe5751c079c8698c7fc5505863df56f589928211c5957791dca657fe not found: ID does not exist"
Sep 09 06:02:47.361130 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:47.361092    2583 scope.go:117] "RemoveContainer" containerID="fb569153e71e1d0eaa5084618578d5245b1bf176fa5242a2f6ef3a3c642d64b6"
Sep 09 06:02:47.361388 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:02:47.361369    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb569153e71e1d0eaa5084618578d5245b1bf176fa5242a2f6ef3a3c642d64b6\": container with ID starting with fb569153e71e1d0eaa5084618578d5245b1bf176fa5242a2f6ef3a3c642d64b6 not found: ID does not exist" containerID="fb569153e71e1d0eaa5084618578d5245b1bf176fa5242a2f6ef3a3c642d64b6"
Sep 09 06:02:47.361456 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:47.361393    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb569153e71e1d0eaa5084618578d5245b1bf176fa5242a2f6ef3a3c642d64b6"} err="failed to get container status \"fb569153e71e1d0eaa5084618578d5245b1bf176fa5242a2f6ef3a3c642d64b6\": rpc error: code = NotFound desc = could not find container \"fb569153e71e1d0eaa5084618578d5245b1bf176fa5242a2f6ef3a3c642d64b6\": container with ID starting with fb569153e71e1d0eaa5084618578d5245b1bf176fa5242a2f6ef3a3c642d64b6 not found: ID does not exist"
Sep 09 06:02:47.361734 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:47.361714    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c53eb05a-openshift-default-7f5b9f77d4-g92zc"]
Sep 09 06:02:49.245548 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:02:49.245514    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96443af3-585f-41c9-9699-0afffa239f48" path="/var/lib/kubelet/pods/96443af3-585f-41c9-9699-0afffa239f48/volumes"
Sep 09 06:03:13.623937 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:13.623905    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:15.961430 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:15.961387    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:16.037461 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:16.037430    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:16.132792 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:16.132751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:16.227060 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:16.226965    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:16.336712 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:16.336678    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:16.776881 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:16.776851    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:17.061047 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.060952    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"]
Sep 09 06:03:17.061490 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.061431    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96443af3-585f-41c9-9699-0afffa239f48" containerName="istio-proxy"
Sep 09 06:03:17.061490 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.061446    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="96443af3-585f-41c9-9699-0afffa239f48" containerName="istio-proxy"
Sep 09 06:03:17.061624 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.061517    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="96443af3-585f-41c9-9699-0afffa239f48" containerName="istio-proxy"
Sep 09 06:03:17.061624 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.061526    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="96443af3-585f-41c9-9699-0afffa239f48" containerName="istio-proxy"
Sep 09 06:03:17.063978 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.063957    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.066382 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.066359    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8b70f171-openshift-default-dockercfg-jwkgx\""
Sep 09 06:03:17.074698 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.074671    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-workload-certs\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.074796 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.074718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-podinfo\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.074903 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.074802    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-token\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.074903 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.074825    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94be6c7a-4ec7-413c-a13f-49bd419c510c-istiod-ca-cert\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.074903 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.074883    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6lf8\" (UniqueName: \"kubernetes.io/projected/94be6c7a-4ec7-413c-a13f-49bd419c510c-kube-api-access-s6lf8\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.075067 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.074919    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-credential-socket\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.075067 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.074963    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-envoy\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.075212 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.075102    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-workload-socket\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.075212 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.075139    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-data\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.079843 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.079769    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"]
Sep 09 06:03:17.087418 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.087396    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:17.176008 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.175957    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-token\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.178213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.176329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94be6c7a-4ec7-413c-a13f-49bd419c510c-istiod-ca-cert\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.178213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.176368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6lf8\" (UniqueName: \"kubernetes.io/projected/94be6c7a-4ec7-413c-a13f-49bd419c510c-kube-api-access-s6lf8\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.178213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.176398    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-credential-socket\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.178213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.176443    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-envoy\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.178213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.176505    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-workload-socket\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.178213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.176532    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-data\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.178213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.176668    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-workload-certs\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.178213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.176706    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-podinfo\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.178213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.177833    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-data\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.178213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.177895    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-workload-certs\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.178213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.178081    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-workload-socket\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.178213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.178154    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-credential-socket\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.178213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.178175    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94be6c7a-4ec7-413c-a13f-49bd419c510c-istiod-ca-cert\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.181980 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.180441    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-envoy\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.184654 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.184158    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-podinfo\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.187153 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.187116    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-token\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.188531 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.188509    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6lf8\" (UniqueName: \"kubernetes.io/projected/94be6c7a-4ec7-413c-a13f-49bd419c510c-kube-api-access-s6lf8\") pod \"e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") " pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.374847 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.374813    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:17.400843 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.400807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:17.663277 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.663244    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"]
Sep 09 06:03:17.665096 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:03:17.665071    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94be6c7a_4ec7_413c_a13f_49bd419c510c.slice/crio-13a02d0451a0dc726f233b01a8306707d2c9cc8efa8e224c86d041e73435ee8a WatchSource:0}: Error finding container 13a02d0451a0dc726f233b01a8306707d2c9cc8efa8e224c86d041e73435ee8a: Status 404 returned error can't find the container with id 13a02d0451a0dc726f233b01a8306707d2c9cc8efa8e224c86d041e73435ee8a
Sep 09 06:03:17.667362 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.667332    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:03:17.667458 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.667396    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:03:17.667458 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:17.667423    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:03:18.507884 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:18.507850    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v" event={"ID":"94be6c7a-4ec7-413c-a13f-49bd419c510c","Type":"ContainerStarted","Data":"a4ecfec995bcd039253027c306e3f1cf424f51f46250b89dca25ea9e52285c58"}
Sep 09 06:03:18.508320 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:18.507899    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v" event={"ID":"94be6c7a-4ec7-413c-a13f-49bd419c510c","Type":"ContainerStarted","Data":"13a02d0451a0dc726f233b01a8306707d2c9cc8efa8e224c86d041e73435ee8a"}
Sep 09 06:03:18.548363 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:18.548310    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v" podStartSLOduration=1.548294711 podStartE2EDuration="1.548294711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:03:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:03:18.546501092 +0000 UTC m=+819.776997644" watchObservedRunningTime="2026-09-09 06:03:18.548294711 +0000 UTC m=+819.778791262"
Sep 09 06:03:19.375855 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:19.375822    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:19.381864 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:19.381837    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:19.512869 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:19.512838    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:19.513786 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:19.513769    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:19.880778 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:19.880748    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:19.979989 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:19.979944    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:21.131817 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:21.131779    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:21.232774 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:21.232741    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:21.618636 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:21.618599    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:21.724279 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:21.724243    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:21.936350 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:21.936261    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:41.643635 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:41.643599    2583 generic.go:356] "Generic (PLEG): container finished" podID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerID="a4ecfec995bcd039253027c306e3f1cf424f51f46250b89dca25ea9e52285c58" exitCode=0
Sep 09 06:03:41.644019 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:41.643675    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v" event={"ID":"94be6c7a-4ec7-413c-a13f-49bd419c510c","Type":"ContainerDied","Data":"a4ecfec995bcd039253027c306e3f1cf424f51f46250b89dca25ea9e52285c58"}
Sep 09 06:03:41.644082 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:41.644067    2583 scope.go:117] "RemoveContainer" containerID="a4ecfec995bcd039253027c306e3f1cf424f51f46250b89dca25ea9e52285c58"
Sep 09 06:03:41.645240 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:41.645216    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:03:41.645304 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:41.645281    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:03:41.645340 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:41.645311    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:03:42.232993 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:42.232955    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:42.651905 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:42.651869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v" event={"ID":"94be6c7a-4ec7-413c-a13f-49bd419c510c","Type":"ContainerStarted","Data":"3e50531ad772f6f0effee00d73f1f70422c7bb334e1f36021e73ec51b769fe47"}
Sep 09 06:03:43.383262 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:43.383213    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:43.383479 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:43.383365    2583 patch_prober.go:28] interesting pod/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 09 06:03:43.383479 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:43.383411    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v" podUID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 09 06:03:44.375943 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:44.375902    2583 patch_prober.go:28] interesting pod/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 09 06:03:44.376542 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:44.376509    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v" podUID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 09 06:03:44.728254 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:44.728157    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:45.097793 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:45.097685    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:45.376004 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:45.375969    2583 patch_prober.go:28] interesting pod/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 09 06:03:45.376616 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:45.376585    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v" podUID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 09 06:03:45.752730 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:45.752642    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:46.376216 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:46.376170    2583 patch_prober.go:28] interesting pod/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 09 06:03:46.376838 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:46.376806    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v" podUID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 09 06:03:46.512076 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:46.512046    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:47.376234 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:47.376175    2583 patch_prober.go:28] interesting pod/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 09 06:03:47.376843 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:47.376806    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v" podUID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 09 06:03:48.375677 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:48.375629    2583 patch_prober.go:28] interesting pod/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Sep 09 06:03:48.375914 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:48.375698    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v" podUID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Sep 09 06:03:49.380008 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:49.379980    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:49.380471 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:49.380239    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:49.381028 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:49.381004    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:51.191113 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:51.191081    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:51.748309 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:51.748270    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:51.820032 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:51.819987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:51.877166 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:51.877113    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:51.945643 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:51.945611    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:52.000374 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:52.000289    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:53.045808 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:53.045772    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"]
Sep 09 06:03:53.046242 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:53.046041    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v" podUID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerName="istio-proxy" containerID="cri-o://3e50531ad772f6f0effee00d73f1f70422c7bb334e1f36021e73ec51b769fe47" gracePeriod=30
Sep 09 06:03:53.116277 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:53.116243    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:53.504029 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:53.503981    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:53.787922 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:53.787831    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:54.129886 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:54.129848    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:55.130685 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:55.130647    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:55.683128 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:55.683102    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:55.707724 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:55.707694    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"]
Sep 09 06:03:55.707894 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:55.707876    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h" podUID="cce65706-6de0-4715-8088-eb46e67228c9" containerName="payload-processing" containerID="cri-o://a269031aea6efea970c223bfc82f512a246a973fb1d6e7052aff71194f9472cf" gracePeriod=30
Sep 09 06:03:55.783166 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:55.783133    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:55.864174 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:55.864118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:55.921329 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:55.921284    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:55.963222 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:55.963199    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"
Sep 09 06:03:56.009491 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.009460    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2skh6\" (UniqueName: \"kubernetes.io/projected/cce65706-6de0-4715-8088-eb46e67228c9-kube-api-access-2skh6\") pod \"cce65706-6de0-4715-8088-eb46e67228c9\" (UID: \"cce65706-6de0-4715-8088-eb46e67228c9\") "
Sep 09 06:03:56.009676 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.009501    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cce65706-6de0-4715-8088-eb46e67228c9-plugins-config-volume\") pod \"cce65706-6de0-4715-8088-eb46e67228c9\" (UID: \"cce65706-6de0-4715-8088-eb46e67228c9\") "
Sep 09 06:03:56.009887 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.009863    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cce65706-6de0-4715-8088-eb46e67228c9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cce65706-6de0-4715-8088-eb46e67228c9" (UID: "cce65706-6de0-4715-8088-eb46e67228c9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:03:56.011668 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.011645    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cce65706-6de0-4715-8088-eb46e67228c9-kube-api-access-2skh6" (OuterVolumeSpecName: "kube-api-access-2skh6") pod "cce65706-6de0-4715-8088-eb46e67228c9" (UID: "cce65706-6de0-4715-8088-eb46e67228c9"). InnerVolumeSpecName "kube-api-access-2skh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:03:56.110341 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.110303    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2skh6\" (UniqueName: \"kubernetes.io/projected/cce65706-6de0-4715-8088-eb46e67228c9-kube-api-access-2skh6\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:03:56.110571 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.110529    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cce65706-6de0-4715-8088-eb46e67228c9-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:03:56.224899 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.224808    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:56.653933 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.653905    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:56.747524 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.747486    2583 generic.go:356] "Generic (PLEG): container finished" podID="cce65706-6de0-4715-8088-eb46e67228c9" containerID="a269031aea6efea970c223bfc82f512a246a973fb1d6e7052aff71194f9472cf" exitCode=0
Sep 09 06:03:56.747524 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.747516    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h" event={"ID":"cce65706-6de0-4715-8088-eb46e67228c9","Type":"ContainerDied","Data":"a269031aea6efea970c223bfc82f512a246a973fb1d6e7052aff71194f9472cf"}
Sep 09 06:03:56.747807 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.747546    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"
Sep 09 06:03:56.747807 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.747598    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h" event={"ID":"cce65706-6de0-4715-8088-eb46e67228c9","Type":"ContainerDied","Data":"5bf7b9a958008407190b376800f8fd4e858d6cd02955b2b3fbf883073c791ab2"}
Sep 09 06:03:56.747807 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.747633    2583 scope.go:117] "RemoveContainer" containerID="a269031aea6efea970c223bfc82f512a246a973fb1d6e7052aff71194f9472cf"
Sep 09 06:03:56.748026 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.748001    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:56.757444 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.757428    2583 scope.go:117] "RemoveContainer" containerID="a269031aea6efea970c223bfc82f512a246a973fb1d6e7052aff71194f9472cf"
Sep 09 06:03:56.757736 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:03:56.757718    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a269031aea6efea970c223bfc82f512a246a973fb1d6e7052aff71194f9472cf\": container with ID starting with a269031aea6efea970c223bfc82f512a246a973fb1d6e7052aff71194f9472cf not found: ID does not exist" containerID="a269031aea6efea970c223bfc82f512a246a973fb1d6e7052aff71194f9472cf"
Sep 09 06:03:56.757821 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.757748    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a269031aea6efea970c223bfc82f512a246a973fb1d6e7052aff71194f9472cf"} err="failed to get container status \"a269031aea6efea970c223bfc82f512a246a973fb1d6e7052aff71194f9472cf\": rpc error: code = NotFound desc = could not find container \"a269031aea6efea970c223bfc82f512a246a973fb1d6e7052aff71194f9472cf\": container with ID starting with a269031aea6efea970c223bfc82f512a246a973fb1d6e7052aff71194f9472cf not found: ID does not exist"
Sep 09 06:03:56.768844 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.768822    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"]
Sep 09 06:03:56.773499 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:56.773478    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-7a357a-6b64797769-b8h8h"]
Sep 09 06:03:57.245190 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:57.245156    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cce65706-6de0-4715-8088-eb46e67228c9" path="/var/lib/kubelet/pods/cce65706-6de0-4715-8088-eb46e67228c9/volumes"
Sep 09 06:03:57.771889 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:57.771841    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:57.847173 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:57.847139    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:58.182641 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.182611    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:58.287749 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.287716    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:58.301505 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.301483    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:58.333539 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.333474    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-podinfo\") pod \"94be6c7a-4ec7-413c-a13f-49bd419c510c\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") "
Sep 09 06:03:58.333539 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.333526    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6lf8\" (UniqueName: \"kubernetes.io/projected/94be6c7a-4ec7-413c-a13f-49bd419c510c-kube-api-access-s6lf8\") pod \"94be6c7a-4ec7-413c-a13f-49bd419c510c\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") "
Sep 09 06:03:58.333762 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.333569    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-workload-certs\") pod \"94be6c7a-4ec7-413c-a13f-49bd419c510c\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") "
Sep 09 06:03:58.333762 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.333594    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94be6c7a-4ec7-413c-a13f-49bd419c510c-istiod-ca-cert\") pod \"94be6c7a-4ec7-413c-a13f-49bd419c510c\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") "
Sep 09 06:03:58.333762 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.333651    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-data\") pod \"94be6c7a-4ec7-413c-a13f-49bd419c510c\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") "
Sep 09 06:03:58.333762 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.333691    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-token\") pod \"94be6c7a-4ec7-413c-a13f-49bd419c510c\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") "
Sep 09 06:03:58.333762 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.333745    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-workload-socket\") pod \"94be6c7a-4ec7-413c-a13f-49bd419c510c\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") "
Sep 09 06:03:58.334026 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.333785    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-credential-socket\") pod \"94be6c7a-4ec7-413c-a13f-49bd419c510c\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") "
Sep 09 06:03:58.334026 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.333838    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-envoy\") pod \"94be6c7a-4ec7-413c-a13f-49bd419c510c\" (UID: \"94be6c7a-4ec7-413c-a13f-49bd419c510c\") "
Sep 09 06:03:58.334026 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.333885    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94be6c7a-4ec7-413c-a13f-49bd419c510c" (UID: "94be6c7a-4ec7-413c-a13f-49bd419c510c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:03:58.334317 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.334201    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-workload-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:03:58.334499 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.334395    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-data" (OuterVolumeSpecName: "istio-data") pod "94be6c7a-4ec7-413c-a13f-49bd419c510c" (UID: "94be6c7a-4ec7-413c-a13f-49bd419c510c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:03:58.334499 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.334479    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94be6c7a-4ec7-413c-a13f-49bd419c510c" (UID: "94be6c7a-4ec7-413c-a13f-49bd419c510c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:03:58.334643 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.334531    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94be6c7a-4ec7-413c-a13f-49bd419c510c" (UID: "94be6c7a-4ec7-413c-a13f-49bd419c510c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:03:58.334721 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.334693    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94be6c7a-4ec7-413c-a13f-49bd419c510c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94be6c7a-4ec7-413c-a13f-49bd419c510c" (UID: "94be6c7a-4ec7-413c-a13f-49bd419c510c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:03:58.336008 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.335984    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94be6c7a-4ec7-413c-a13f-49bd419c510c-kube-api-access-s6lf8" (OuterVolumeSpecName: "kube-api-access-s6lf8") pod "94be6c7a-4ec7-413c-a13f-49bd419c510c" (UID: "94be6c7a-4ec7-413c-a13f-49bd419c510c"). InnerVolumeSpecName "kube-api-access-s6lf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:03:58.336250 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.336231    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94be6c7a-4ec7-413c-a13f-49bd419c510c" (UID: "94be6c7a-4ec7-413c-a13f-49bd419c510c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 06:03:58.336574 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.336531    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-token" (OuterVolumeSpecName: "istio-token") pod "94be6c7a-4ec7-413c-a13f-49bd419c510c" (UID: "94be6c7a-4ec7-413c-a13f-49bd419c510c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:03:58.336632 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.336536    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94be6c7a-4ec7-413c-a13f-49bd419c510c" (UID: "94be6c7a-4ec7-413c-a13f-49bd419c510c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:03:58.384994 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.384957    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:03:58.413892 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.413862    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"]
Sep 09 06:03:58.414369 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.414353    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerName="istio-proxy"
Sep 09 06:03:58.414471 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.414373    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerName="istio-proxy"
Sep 09 06:03:58.414471 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.414403    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96443af3-585f-41c9-9699-0afffa239f48" containerName="istio-proxy"
Sep 09 06:03:58.414471 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.414411    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="96443af3-585f-41c9-9699-0afffa239f48" containerName="istio-proxy"
Sep 09 06:03:58.414471 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.414442    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cce65706-6de0-4715-8088-eb46e67228c9" containerName="payload-processing"
Sep 09 06:03:58.414471 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.414451    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="cce65706-6de0-4715-8088-eb46e67228c9" containerName="payload-processing"
Sep 09 06:03:58.414761 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.414572    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerName="istio-proxy"
Sep 09 06:03:58.414761 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.414584    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerName="istio-proxy"
Sep 09 06:03:58.414761 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.414593    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="cce65706-6de0-4715-8088-eb46e67228c9" containerName="payload-processing"
Sep 09 06:03:58.416975 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.416956    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"
Sep 09 06:03:58.419261 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.419243    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-d1d9fd16\""
Sep 09 06:03:58.419420 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.419397    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-d1d9fd16-dockercfg-w92fh\""
Sep 09 06:03:58.428750 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.428722    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"]
Sep 09 06:03:58.435483 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.435464    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-envoy\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:03:58.435483 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.435483    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-podinfo\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:03:58.435695 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.435492    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6lf8\" (UniqueName: \"kubernetes.io/projected/94be6c7a-4ec7-413c-a13f-49bd419c510c-kube-api-access-s6lf8\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:03:58.435695 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.435501    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94be6c7a-4ec7-413c-a13f-49bd419c510c-istiod-ca-cert\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:03:58.435695 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.435513    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:03:58.435695 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.435524    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94be6c7a-4ec7-413c-a13f-49bd419c510c-istio-token\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:03:58.435695 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.435531    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-workload-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:03:58.435695 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.435538    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94be6c7a-4ec7-413c-a13f-49bd419c510c-credential-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:03:58.536470 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.536439    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xswzw\" (UniqueName: \"kubernetes.io/projected/498088d1-4911-4f7b-980b-ec89259432a6-kube-api-access-xswzw\") pod \"payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6\" (UID: \"498088d1-4911-4f7b-980b-ec89259432a6\") " pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"
Sep 09 06:03:58.536651 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.536532    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/498088d1-4911-4f7b-980b-ec89259432a6-plugins-config-volume\") pod \"payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6\" (UID: \"498088d1-4911-4f7b-980b-ec89259432a6\") " pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"
Sep 09 06:03:58.637076 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.637043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/498088d1-4911-4f7b-980b-ec89259432a6-plugins-config-volume\") pod \"payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6\" (UID: \"498088d1-4911-4f7b-980b-ec89259432a6\") " pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"
Sep 09 06:03:58.637280 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.637116    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xswzw\" (UniqueName: \"kubernetes.io/projected/498088d1-4911-4f7b-980b-ec89259432a6-kube-api-access-xswzw\") pod \"payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6\" (UID: \"498088d1-4911-4f7b-980b-ec89259432a6\") " pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"
Sep 09 06:03:58.637864 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.637841    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/498088d1-4911-4f7b-980b-ec89259432a6-plugins-config-volume\") pod \"payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6\" (UID: \"498088d1-4911-4f7b-980b-ec89259432a6\") " pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"
Sep 09 06:03:58.645257 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.645235    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xswzw\" (UniqueName: \"kubernetes.io/projected/498088d1-4911-4f7b-980b-ec89259432a6-kube-api-access-xswzw\") pod \"payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6\" (UID: \"498088d1-4911-4f7b-980b-ec89259432a6\") " pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"
Sep 09 06:03:58.730851 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.730820    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"
Sep 09 06:03:58.763351 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.763307    2583 generic.go:356] "Generic (PLEG): container finished" podID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerID="3e50531ad772f6f0effee00d73f1f70422c7bb334e1f36021e73ec51b769fe47" exitCode=0
Sep 09 06:03:58.763513 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.763358    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"
Sep 09 06:03:58.763513 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.763379    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v" event={"ID":"94be6c7a-4ec7-413c-a13f-49bd419c510c","Type":"ContainerDied","Data":"3e50531ad772f6f0effee00d73f1f70422c7bb334e1f36021e73ec51b769fe47"}
Sep 09 06:03:58.763513 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.763432    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v" event={"ID":"94be6c7a-4ec7-413c-a13f-49bd419c510c","Type":"ContainerDied","Data":"13a02d0451a0dc726f233b01a8306707d2c9cc8efa8e224c86d041e73435ee8a"}
Sep 09 06:03:58.763513 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.763455    2583 scope.go:117] "RemoveContainer" containerID="3e50531ad772f6f0effee00d73f1f70422c7bb334e1f36021e73ec51b769fe47"
Sep 09 06:03:58.774109 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.774089    2583 scope.go:117] "RemoveContainer" containerID="a4ecfec995bcd039253027c306e3f1cf424f51f46250b89dca25ea9e52285c58"
Sep 09 06:03:58.784997 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.784881    2583 scope.go:117] "RemoveContainer" containerID="3e50531ad772f6f0effee00d73f1f70422c7bb334e1f36021e73ec51b769fe47"
Sep 09 06:03:58.785336 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:03:58.785297    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e50531ad772f6f0effee00d73f1f70422c7bb334e1f36021e73ec51b769fe47\": container with ID starting with 3e50531ad772f6f0effee00d73f1f70422c7bb334e1f36021e73ec51b769fe47 not found: ID does not exist" containerID="3e50531ad772f6f0effee00d73f1f70422c7bb334e1f36021e73ec51b769fe47"
Sep 09 06:03:58.785538 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.785346    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e50531ad772f6f0effee00d73f1f70422c7bb334e1f36021e73ec51b769fe47"} err="failed to get container status \"3e50531ad772f6f0effee00d73f1f70422c7bb334e1f36021e73ec51b769fe47\": rpc error: code = NotFound desc = could not find container \"3e50531ad772f6f0effee00d73f1f70422c7bb334e1f36021e73ec51b769fe47\": container with ID starting with 3e50531ad772f6f0effee00d73f1f70422c7bb334e1f36021e73ec51b769fe47 not found: ID does not exist"
Sep 09 06:03:58.785538 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.785370    2583 scope.go:117] "RemoveContainer" containerID="a4ecfec995bcd039253027c306e3f1cf424f51f46250b89dca25ea9e52285c58"
Sep 09 06:03:58.785864 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:03:58.785719    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4ecfec995bcd039253027c306e3f1cf424f51f46250b89dca25ea9e52285c58\": container with ID starting with a4ecfec995bcd039253027c306e3f1cf424f51f46250b89dca25ea9e52285c58 not found: ID does not exist" containerID="a4ecfec995bcd039253027c306e3f1cf424f51f46250b89dca25ea9e52285c58"
Sep 09 06:03:58.785864 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.785749    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4ecfec995bcd039253027c306e3f1cf424f51f46250b89dca25ea9e52285c58"} err="failed to get container status \"a4ecfec995bcd039253027c306e3f1cf424f51f46250b89dca25ea9e52285c58\": rpc error: code = NotFound desc = could not find container \"a4ecfec995bcd039253027c306e3f1cf424f51f46250b89dca25ea9e52285c58\": container with ID starting with a4ecfec995bcd039253027c306e3f1cf424f51f46250b89dca25ea9e52285c58 not found: ID does not exist"
Sep 09 06:03:58.789718 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.789690    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"]
Sep 09 06:03:58.792930 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:58.792833    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8b70f171-openshift-default-7d4c4b9c96-4xf6v"]
Sep 09 06:03:59.004222 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:59.004197    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"]
Sep 09 06:03:59.005938 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:03:59.005912    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod498088d1_4911_4f7b_980b_ec89259432a6.slice/crio-1ccd3a2bf00d7f16261265ec0bbec0d312957395ae0e01fbb6a1bde448cfce7f WatchSource:0}: Error finding container 1ccd3a2bf00d7f16261265ec0bbec0d312957395ae0e01fbb6a1bde448cfce7f: Status 404 returned error can't find the container with id 1ccd3a2bf00d7f16261265ec0bbec0d312957395ae0e01fbb6a1bde448cfce7f
Sep 09 06:03:59.247318 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:59.247287    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94be6c7a-4ec7-413c-a13f-49bd419c510c" path="/var/lib/kubelet/pods/94be6c7a-4ec7-413c-a13f-49bd419c510c/volumes"
Sep 09 06:03:59.770837 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:59.770802    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6" event={"ID":"498088d1-4911-4f7b-980b-ec89259432a6","Type":"ContainerStarted","Data":"e4a7964d4e8c714be524e49ae85295cae8aac2f46bc6f460e74685dc846e5daa"}
Sep 09 06:03:59.771305 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:59.770973    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"
Sep 09 06:03:59.771305 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:59.771023    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6" event={"ID":"498088d1-4911-4f7b-980b-ec89259432a6","Type":"ContainerStarted","Data":"1ccd3a2bf00d7f16261265ec0bbec0d312957395ae0e01fbb6a1bde448cfce7f"}
Sep 09 06:03:59.786720 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:03:59.786645    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6" podStartSLOduration=1.7866294969999998 podStartE2EDuration="1.786629497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:03:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:03:59.786006659 +0000 UTC m=+861.016503213" watchObservedRunningTime="2026-09-09 06:03:59.786629497 +0000 UTC m=+861.017126063"
Sep 09 06:04:02.028948 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:02.028906    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:02.129992 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:02.129960    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:02.263092 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:02.263054    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"]
Sep 09 06:04:02.263330 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:02.263297    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx" podUID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" containerName="istio-proxy" containerID="cri-o://e2f5e35696d443fe07812442cfd5afd941dc2747bd6765833e376953be1668c1" gracePeriod=30
Sep 09 06:04:02.304880 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:02.304794    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:02.736244 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:02.736201    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:03.019747 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.019668    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"]
Sep 09 06:04:03.020344 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.020328    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerName="istio-proxy"
Sep 09 06:04:03.020387 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.020348    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="94be6c7a-4ec7-413c-a13f-49bd419c510c" containerName="istio-proxy"
Sep 09 06:04:03.023163 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.023145    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.028857 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.028833    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-f631ee-openshift-default-dockercfg-jg97k\""
Sep 09 06:04:03.035912 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.035885    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"]
Sep 09 06:04:03.052438 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.052409    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:03.080877 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.080838    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-podinfo\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.081026 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.080883    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svltw\" (UniqueName: \"kubernetes.io/projected/b591758e-8b9e-46ca-93c5-f19de9718f50-kube-api-access-svltw\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.081026 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.080925    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-token\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.081026 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.080960    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b591758e-8b9e-46ca-93c5-f19de9718f50-istiod-ca-cert\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.081026 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.081004    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-workload-certs\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.081182 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.081047    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-credential-socket\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.081182 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.081104    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-workload-socket\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.081182 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.081176    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-envoy\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.081299 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.081262    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-data\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.182137 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.182099    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-data\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.182341 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.182148    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-podinfo\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.182341 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.182167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svltw\" (UniqueName: \"kubernetes.io/projected/b591758e-8b9e-46ca-93c5-f19de9718f50-kube-api-access-svltw\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.182341 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.182197    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-token\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.182341 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.182312    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b591758e-8b9e-46ca-93c5-f19de9718f50-istiod-ca-cert\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.182595 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.182380    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-workload-certs\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.182595 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.182434    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-credential-socket\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.182595 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.182480    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-workload-socket\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.182595 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.182549    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-data\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.182804 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.182607    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-envoy\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.182804 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.182796    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-credential-socket\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.182916 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.182814    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-workload-certs\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.182977 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.182929    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-workload-socket\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.183034 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.182992    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b591758e-8b9e-46ca-93c5-f19de9718f50-istiod-ca-cert\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.184965 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.184933    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-envoy\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.185165 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.185148    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-podinfo\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.190366 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.190340    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-token\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.190464 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.190419    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svltw\" (UniqueName: \"kubernetes.io/projected/b591758e-8b9e-46ca-93c5-f19de9718f50-kube-api-access-svltw\") pod \"e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") " pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.245841 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.245807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:03.336874 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.336788    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:03.615402 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.615377    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"]
Sep 09 06:04:03.617010 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:04:03.616981    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb591758e_8b9e_46ca_93c5_f19de9718f50.slice/crio-2a352660f3c3e79de5adc47fce6317b4643527d36745709e3d03528083d17eb1 WatchSource:0}: Error finding container 2a352660f3c3e79de5adc47fce6317b4643527d36745709e3d03528083d17eb1: Status 404 returned error can't find the container with id 2a352660f3c3e79de5adc47fce6317b4643527d36745709e3d03528083d17eb1
Sep 09 06:04:03.619415 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.619379    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:04:03.619505 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.619445    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:04:03.619505 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.619496    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:04:03.798003 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.797968    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" event={"ID":"b591758e-8b9e-46ca-93c5-f19de9718f50","Type":"ContainerStarted","Data":"0df3bce0b5f4951eab33ef27f8296528c6ac0a8acbf880cc17fdab0bd35aa3fc"}
Sep 09 06:04:03.798156 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.798032    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" event={"ID":"b591758e-8b9e-46ca-93c5-f19de9718f50","Type":"ContainerStarted","Data":"2a352660f3c3e79de5adc47fce6317b4643527d36745709e3d03528083d17eb1"}
Sep 09 06:04:03.820194 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:03.820141    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" podStartSLOduration=1.820126186 podStartE2EDuration="1.820126186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:04:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:04:03.817864304 +0000 UTC m=+865.048360856" watchObservedRunningTime="2026-09-09 06:04:03.820126186 +0000 UTC m=+865.050622800"
Sep 09 06:04:04.336984 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:04.336952    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:04.341972 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:04.341947    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:04.803893 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:04.803860    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:04.804946 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:04.804924    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:05.728838 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:05.728805    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:05.823815 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:05.823785    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:07.026115 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.026085    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:07.085059 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.085028    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:07.432573 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.432520    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:07.523230 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.523209    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:04:07.568198 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.568114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:07.631168 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.631141    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-workload-certs\") pod \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") "
Sep 09 06:04:07.631356 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.631191    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istiod-ca-cert\") pod \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") "
Sep 09 06:04:07.631356 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.631221    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-data\") pod \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") "
Sep 09 06:04:07.631356 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.631248    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-token\") pod \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") "
Sep 09 06:04:07.631356 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.631270    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-podinfo\") pod \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") "
Sep 09 06:04:07.631356 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.631308    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-envoy\") pod \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") "
Sep 09 06:04:07.631356 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.631328    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmvbb\" (UniqueName: \"kubernetes.io/projected/9d8a8835-6a94-402b-b561-751e5ce0a8a2-kube-api-access-zmvbb\") pod \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") "
Sep 09 06:04:07.631691 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.631379    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-workload-socket\") pod \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") "
Sep 09 06:04:07.631691 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.631414    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-credential-socket\") pod \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\" (UID: \"9d8a8835-6a94-402b-b561-751e5ce0a8a2\") "
Sep 09 06:04:07.631691 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.631432    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d8a8835-6a94-402b-b561-751e5ce0a8a2" (UID: "9d8a8835-6a94-402b-b561-751e5ce0a8a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:04:07.631691 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.631518    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d8a8835-6a94-402b-b561-751e5ce0a8a2" (UID: "9d8a8835-6a94-402b-b561-751e5ce0a8a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:04:07.631896 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.631749    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d8a8835-6a94-402b-b561-751e5ce0a8a2" (UID: "9d8a8835-6a94-402b-b561-751e5ce0a8a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:04:07.631896 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.631760    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d8a8835-6a94-402b-b561-751e5ce0a8a2" (UID: "9d8a8835-6a94-402b-b561-751e5ce0a8a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:04:07.631976 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.631926    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d8a8835-6a94-402b-b561-751e5ce0a8a2" (UID: "9d8a8835-6a94-402b-b561-751e5ce0a8a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:04:07.632299 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.632279    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:04:07.632365 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.632306    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-workload-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:04:07.632365 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.632322    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-credential-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:04:07.632365 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.632337    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-workload-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:04:07.632365 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.632351    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istiod-ca-cert\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:04:07.633661 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.633634    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d8a8835-6a94-402b-b561-751e5ce0a8a2-kube-api-access-zmvbb" (OuterVolumeSpecName: "kube-api-access-zmvbb") pod "9d8a8835-6a94-402b-b561-751e5ce0a8a2" (UID: "9d8a8835-6a94-402b-b561-751e5ce0a8a2"). InnerVolumeSpecName "kube-api-access-zmvbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:04:07.633772 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.633755    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d8a8835-6a94-402b-b561-751e5ce0a8a2" (UID: "9d8a8835-6a94-402b-b561-751e5ce0a8a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 06:04:07.634141 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.634117    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d8a8835-6a94-402b-b561-751e5ce0a8a2" (UID: "9d8a8835-6a94-402b-b561-751e5ce0a8a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:04:07.634194 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.634127    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d8a8835-6a94-402b-b561-751e5ce0a8a2" (UID: "9d8a8835-6a94-402b-b561-751e5ce0a8a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:04:07.733696 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.733659    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-token\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:04:07.733696 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.733690    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-podinfo\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:04:07.733696 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.733699    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d8a8835-6a94-402b-b561-751e5ce0a8a2-istio-envoy\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:04:07.733896 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.733707    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmvbb\" (UniqueName: \"kubernetes.io/projected/9d8a8835-6a94-402b-b561-751e5ce0a8a2-kube-api-access-zmvbb\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:04:07.821047 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.820951    2583 generic.go:356] "Generic (PLEG): container finished" podID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" containerID="e2f5e35696d443fe07812442cfd5afd941dc2747bd6765833e376953be1668c1" exitCode=0
Sep 09 06:04:07.821047 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.820989    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx" event={"ID":"9d8a8835-6a94-402b-b561-751e5ce0a8a2","Type":"ContainerDied","Data":"e2f5e35696d443fe07812442cfd5afd941dc2747bd6765833e376953be1668c1"}
Sep 09 06:04:07.821047 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.821002    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"
Sep 09 06:04:07.821047 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.821029    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx" event={"ID":"9d8a8835-6a94-402b-b561-751e5ce0a8a2","Type":"ContainerDied","Data":"5cd26ca5321c4128015d652464ee6eeece49e7d2a7e5a25a2b03d083ea1fd6bf"}
Sep 09 06:04:07.821362 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.821059    2583 scope.go:117] "RemoveContainer" containerID="e2f5e35696d443fe07812442cfd5afd941dc2747bd6765833e376953be1668c1"
Sep 09 06:04:07.834487 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.834461    2583 scope.go:117] "RemoveContainer" containerID="3242677a6f9088b6a1bc7726957311e392066cc51285448da32121b566df727b"
Sep 09 06:04:07.843655 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.843633    2583 scope.go:117] "RemoveContainer" containerID="e2f5e35696d443fe07812442cfd5afd941dc2747bd6765833e376953be1668c1"
Sep 09 06:04:07.843923 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:04:07.843906    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2f5e35696d443fe07812442cfd5afd941dc2747bd6765833e376953be1668c1\": container with ID starting with e2f5e35696d443fe07812442cfd5afd941dc2747bd6765833e376953be1668c1 not found: ID does not exist" containerID="e2f5e35696d443fe07812442cfd5afd941dc2747bd6765833e376953be1668c1"
Sep 09 06:04:07.843964 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.843932    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2f5e35696d443fe07812442cfd5afd941dc2747bd6765833e376953be1668c1"} err="failed to get container status \"e2f5e35696d443fe07812442cfd5afd941dc2747bd6765833e376953be1668c1\": rpc error: code = NotFound desc = could not find container \"e2f5e35696d443fe07812442cfd5afd941dc2747bd6765833e376953be1668c1\": container with ID starting with e2f5e35696d443fe07812442cfd5afd941dc2747bd6765833e376953be1668c1 not found: ID does not exist"
Sep 09 06:04:07.843964 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.843949    2583 scope.go:117] "RemoveContainer" containerID="3242677a6f9088b6a1bc7726957311e392066cc51285448da32121b566df727b"
Sep 09 06:04:07.844214 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:04:07.844196    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3242677a6f9088b6a1bc7726957311e392066cc51285448da32121b566df727b\": container with ID starting with 3242677a6f9088b6a1bc7726957311e392066cc51285448da32121b566df727b not found: ID does not exist" containerID="3242677a6f9088b6a1bc7726957311e392066cc51285448da32121b566df727b"
Sep 09 06:04:07.844266 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.844219    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3242677a6f9088b6a1bc7726957311e392066cc51285448da32121b566df727b"} err="failed to get container status \"3242677a6f9088b6a1bc7726957311e392066cc51285448da32121b566df727b\": rpc error: code = NotFound desc = could not find container \"3242677a6f9088b6a1bc7726957311e392066cc51285448da32121b566df727b\": container with ID starting with 3242677a6f9088b6a1bc7726957311e392066cc51285448da32121b566df727b not found: ID does not exist"
Sep 09 06:04:07.851165 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.851145    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"]
Sep 09 06:04:07.855417 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:07.855398    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-7a357a-openshift-default-799c779cdb-cpbjx"]
Sep 09 06:04:08.152657 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:08.152621    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:09.244859 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:09.244830    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" path="/var/lib/kubelet/pods/9d8a8835-6a94-402b-b561-751e5ce0a8a2/volumes"
Sep 09 06:04:10.781781 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:10.781742    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"
Sep 09 06:04:18.662421 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:18.662381    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:20.845750 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:20.845706    2583 patch_prober.go:28] interesting pod/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 09 06:04:20.846193 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:20.845789    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 09 06:04:21.899977 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:21.899943    2583 generic.go:356] "Generic (PLEG): container finished" podID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerID="0df3bce0b5f4951eab33ef27f8296528c6ac0a8acbf880cc17fdab0bd35aa3fc" exitCode=0
Sep 09 06:04:21.900393 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:21.900016    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" event={"ID":"b591758e-8b9e-46ca-93c5-f19de9718f50","Type":"ContainerDied","Data":"0df3bce0b5f4951eab33ef27f8296528c6ac0a8acbf880cc17fdab0bd35aa3fc"}
Sep 09 06:04:21.900482 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:21.900465    2583 scope.go:117] "RemoveContainer" containerID="0df3bce0b5f4951eab33ef27f8296528c6ac0a8acbf880cc17fdab0bd35aa3fc"
Sep 09 06:04:21.901603 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:21.901577    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:04:21.901673 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:21.901644    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:04:21.901714 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:21.901676    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:04:22.060456 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:22.060420    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:22.694838 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:22.694795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:22.911829 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:22.911782    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" event={"ID":"b591758e-8b9e-46ca-93c5-f19de9718f50","Type":"ContainerStarted","Data":"3f9266bdacd0e64bc3de0e0cbab51d02f418e663c381d9836fef6a2b92fe1681"}
Sep 09 06:04:23.337481 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:23.337441    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:23.337714 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:23.337679    2583 patch_prober.go:28] interesting pod/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 09 06:04:23.337799 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:23.337740    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 09 06:04:24.337400 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:24.337363    2583 patch_prober.go:28] interesting pod/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 09 06:04:24.337812 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:24.337413    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 09 06:04:25.337902 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:25.337865    2583 patch_prober.go:28] interesting pod/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 09 06:04:25.338289 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:25.337917    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 09 06:04:26.338194 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:26.338154    2583 patch_prober.go:28] interesting pod/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 09 06:04:26.338675 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:26.338250    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 09 06:04:27.337856 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:27.337820    2583 patch_prober.go:28] interesting pod/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 09 06:04:27.338034 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:27.337871    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 09 06:04:28.338050 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.338010    2583 patch_prober.go:28] interesting pod/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 09 06:04:28.338457 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.338078    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 09 06:04:28.444802 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.444771    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:28.477820 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.477781    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"]
Sep 09 06:04:28.478125 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.478083    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6" podUID="498088d1-4911-4f7b-980b-ec89259432a6" containerName="payload-processing" containerID="cri-o://e4a7964d4e8c714be524e49ae85295cae8aac2f46bc6f460e74685dc846e5daa" gracePeriod=30
Sep 09 06:04:28.545484 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.545451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:28.636166 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.636134    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:28.716689 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.716647    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:28.736629 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.736604    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"
Sep 09 06:04:28.758288 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.756052    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/498088d1-4911-4f7b-980b-ec89259432a6-plugins-config-volume\") pod \"498088d1-4911-4f7b-980b-ec89259432a6\" (UID: \"498088d1-4911-4f7b-980b-ec89259432a6\") "
Sep 09 06:04:28.758288 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.756110    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xswzw\" (UniqueName: \"kubernetes.io/projected/498088d1-4911-4f7b-980b-ec89259432a6-kube-api-access-xswzw\") pod \"498088d1-4911-4f7b-980b-ec89259432a6\" (UID: \"498088d1-4911-4f7b-980b-ec89259432a6\") "
Sep 09 06:04:28.758288 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.756512    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/498088d1-4911-4f7b-980b-ec89259432a6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "498088d1-4911-4f7b-980b-ec89259432a6" (UID: "498088d1-4911-4f7b-980b-ec89259432a6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:04:28.758288 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.757594    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/498088d1-4911-4f7b-980b-ec89259432a6-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:04:28.760856 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.760823    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/498088d1-4911-4f7b-980b-ec89259432a6-kube-api-access-xswzw" (OuterVolumeSpecName: "kube-api-access-xswzw") pod "498088d1-4911-4f7b-980b-ec89259432a6" (UID: "498088d1-4911-4f7b-980b-ec89259432a6"). InnerVolumeSpecName "kube-api-access-xswzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:04:28.796156 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.796123    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:28.858917 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.858826    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xswzw\" (UniqueName: \"kubernetes.io/projected/498088d1-4911-4f7b-980b-ec89259432a6-kube-api-access-xswzw\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:04:28.950393 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.950360    2583 generic.go:356] "Generic (PLEG): container finished" podID="498088d1-4911-4f7b-980b-ec89259432a6" containerID="e4a7964d4e8c714be524e49ae85295cae8aac2f46bc6f460e74685dc846e5daa" exitCode=0
Sep 09 06:04:28.950617 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.950407    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"
Sep 09 06:04:28.950617 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.950443    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6" event={"ID":"498088d1-4911-4f7b-980b-ec89259432a6","Type":"ContainerDied","Data":"e4a7964d4e8c714be524e49ae85295cae8aac2f46bc6f460e74685dc846e5daa"}
Sep 09 06:04:28.950617 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.950498    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6" event={"ID":"498088d1-4911-4f7b-980b-ec89259432a6","Type":"ContainerDied","Data":"1ccd3a2bf00d7f16261265ec0bbec0d312957395ae0e01fbb6a1bde448cfce7f"}
Sep 09 06:04:28.950617 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.950522    2583 scope.go:117] "RemoveContainer" containerID="e4a7964d4e8c714be524e49ae85295cae8aac2f46bc6f460e74685dc846e5daa"
Sep 09 06:04:28.960536 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.960506    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:28.962413 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.962397    2583 scope.go:117] "RemoveContainer" containerID="e4a7964d4e8c714be524e49ae85295cae8aac2f46bc6f460e74685dc846e5daa"
Sep 09 06:04:28.962746 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:04:28.962725    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4a7964d4e8c714be524e49ae85295cae8aac2f46bc6f460e74685dc846e5daa\": container with ID starting with e4a7964d4e8c714be524e49ae85295cae8aac2f46bc6f460e74685dc846e5daa not found: ID does not exist" containerID="e4a7964d4e8c714be524e49ae85295cae8aac2f46bc6f460e74685dc846e5daa"
Sep 09 06:04:28.962823 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.962754    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4a7964d4e8c714be524e49ae85295cae8aac2f46bc6f460e74685dc846e5daa"} err="failed to get container status \"e4a7964d4e8c714be524e49ae85295cae8aac2f46bc6f460e74685dc846e5daa\": rpc error: code = NotFound desc = could not find container \"e4a7964d4e8c714be524e49ae85295cae8aac2f46bc6f460e74685dc846e5daa\": container with ID starting with e4a7964d4e8c714be524e49ae85295cae8aac2f46bc6f460e74685dc846e5daa not found: ID does not exist"
Sep 09 06:04:28.974741 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.974717    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"]
Sep 09 06:04:28.978059 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:28.978036    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d1d9fd16-bdfb99d85-jkck6"]
Sep 09 06:04:29.245453 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:29.245419    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="498088d1-4911-4f7b-980b-ec89259432a6" path="/var/lib/kubelet/pods/498088d1-4911-4f7b-980b-ec89259432a6/volumes"
Sep 09 06:04:29.340686 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:29.340652    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:29.341146 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:29.341046    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:29.341746 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:29.341727    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:04:29.498533 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:29.498444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:29.597407 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:29.597371    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:29.724667 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:29.724624    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:30.746934 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:30.746857    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:31.106958 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:31.106876    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:36.866307 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:36.866266    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:36.966255 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:36.966225    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:37.066581 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:37.066526    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:37.123658 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:37.123623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:37.548172 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:37.548091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:39.361850 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:39.361815    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:04:51.514479 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:04:51.514445    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:03.464427 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:03.464390    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:09.219145 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:09.219109    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:09.282391 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:09.282357    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:09.363802 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:09.363763    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:09.590546 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:09.590468    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:11.115955 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.115923    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"]
Sep 09 06:05:11.116433 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.116408    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="498088d1-4911-4f7b-980b-ec89259432a6" containerName="payload-processing"
Sep 09 06:05:11.116648 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.116629    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="498088d1-4911-4f7b-980b-ec89259432a6" containerName="payload-processing"
Sep 09 06:05:11.116754 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.116694    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" containerName="istio-proxy"
Sep 09 06:05:11.116754 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.116722    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" containerName="istio-proxy"
Sep 09 06:05:11.116754 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.116745    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" containerName="istio-proxy"
Sep 09 06:05:11.116754 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.116753    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" containerName="istio-proxy"
Sep 09 06:05:11.116962 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.116895    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" containerName="istio-proxy"
Sep 09 06:05:11.116962 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.116906    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d8a8835-6a94-402b-b561-751e5ce0a8a2" containerName="istio-proxy"
Sep 09 06:05:11.116962 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.116920    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="498088d1-4911-4f7b-980b-ec89259432a6" containerName="payload-processing"
Sep 09 06:05:11.120589 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.120568    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.124323 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.124298    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-f631ee\"/\"explicit-model-f631ee-kserve-self-signed-certs\""
Sep 09 06:05:11.124323 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.124313    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-f631ee\"/\"openshift-service-ca.crt\""
Sep 09 06:05:11.124323 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.124300    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-f631ee\"/\"kube-root-ca.crt\""
Sep 09 06:05:11.124640 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.124317    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-f631ee\"/\"default-dockercfg-hvv8z\""
Sep 09 06:05:11.130826 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.130807    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"]
Sep 09 06:05:11.145764 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.145738    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:11.199583 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.199529    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-model-cache\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.199780 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.199670    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-tmp-dir\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.199780 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.199718    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k49c4\" (UniqueName: \"kubernetes.io/projected/5dcb3985-5167-4318-afe9-3f6eef5b758e-kube-api-access-k49c4\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.199908 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.199818    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-home\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.199908 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.199891    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dcb3985-5167-4318-afe9-3f6eef5b758e-tls-certs\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.200010 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.199921    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-dshm\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.301109 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.301072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dcb3985-5167-4318-afe9-3f6eef5b758e-tls-certs\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.301313 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.301129    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-dshm\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.301313 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.301169    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-model-cache\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.301313 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.301258    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-tmp-dir\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.301313 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.301297    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k49c4\" (UniqueName: \"kubernetes.io/projected/5dcb3985-5167-4318-afe9-3f6eef5b758e-kube-api-access-k49c4\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.301925 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.301897    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-model-cache\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.302143 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.302117    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-tmp-dir\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.304828 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.304802    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-dshm\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.307627 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.305582    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dcb3985-5167-4318-afe9-3f6eef5b758e-tls-certs\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.307627 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.306690    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-home\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.307627 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.307021    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-home\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.311388 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.311363    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k49c4\" (UniqueName: \"kubernetes.io/projected/5dcb3985-5167-4318-afe9-3f6eef5b758e-kube-api-access-k49c4\") pod \"explicit-model-f631ee-kserve-646b4ddb89-2sqg7\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") " pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.431114 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.431073    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:11.705617 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:11.705585    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"]
Sep 09 06:05:11.707085 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:05:11.707059    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dcb3985_5167_4318_afe9_3f6eef5b758e.slice/crio-ca3a9a68bfb7b87002e9777ac9a98c8c7008fb84d199116ac05165fbad80dc46 WatchSource:0}: Error finding container ca3a9a68bfb7b87002e9777ac9a98c8c7008fb84d199116ac05165fbad80dc46: Status 404 returned error can't find the container with id ca3a9a68bfb7b87002e9777ac9a98c8c7008fb84d199116ac05165fbad80dc46
Sep 09 06:05:12.185548 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:12.185510    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7" event={"ID":"5dcb3985-5167-4318-afe9-3f6eef5b758e","Type":"ContainerStarted","Data":"1af3c6223f99e6e0e2a67807240b8859b383663e8edda5155a3a2752d5eb24c5"}
Sep 09 06:05:12.185548 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:12.185570    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7" event={"ID":"5dcb3985-5167-4318-afe9-3f6eef5b758e","Type":"ContainerStarted","Data":"ca3a9a68bfb7b87002e9777ac9a98c8c7008fb84d199116ac05165fbad80dc46"}
Sep 09 06:05:12.204993 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:12.204938    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7" podStartSLOduration=1.204925175 podStartE2EDuration="1.204925175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:05:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:05:12.202243578 +0000 UTC m=+933.432740131" watchObservedRunningTime="2026-09-09 06:05:12.204925175 +0000 UTC m=+933.435421727"
Sep 09 06:05:21.431404 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:21.431364    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:21.431827 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:21.431424    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:21.444026 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:21.444003    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:22.247847 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:22.247815    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:05:25.264052 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:25.264017    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:30.948361 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:30.948322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:31.015798 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:31.015762    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:31.093006 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:31.092969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:31.191321 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:31.191285    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:41.653886 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:41.653851    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:42.424785 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:42.424750    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:45.653819 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:45.653768    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:47.951002 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:47.950953    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"]
Sep 09 06:05:47.968268 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:47.968237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:48.366938 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:48.366856    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:48.432327 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:48.432285    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:48.526797 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:48.526748    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:48.623368 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:48.623281    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:48.726092 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:48.726060    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:49.337053 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:49.337020    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:49.439662 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:49.439628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:51.042801 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:51.042755    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:53.910483 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:53.910436    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:53.980330 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:53.980298    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:54.038760 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:54.038724    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:54.099784 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:54.099746    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:54.156219 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:54.156187    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:54.463165 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:54.463125    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:56.965690 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:56.965652    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:57.067394 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:57.067344    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:57.673448 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:57.673409    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:05:59.528928 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:05:59.528894    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:02.972222 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:02.972105    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7" podUID="5dcb3985-5167-4318-afe9-3f6eef5b758e" containerName="main" containerID="cri-o://1af3c6223f99e6e0e2a67807240b8859b383663e8edda5155a3a2752d5eb24c5" gracePeriod=45
Sep 09 06:06:03.234044 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.233979    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:06:03.258811 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.258781    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:03.323138 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.323101    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:03.331297 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.331271    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-dshm\") pod \"5dcb3985-5167-4318-afe9-3f6eef5b758e\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") "
Sep 09 06:06:03.331422 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.331318    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-tmp-dir\") pod \"5dcb3985-5167-4318-afe9-3f6eef5b758e\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") "
Sep 09 06:06:03.331422 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.331348    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-home\") pod \"5dcb3985-5167-4318-afe9-3f6eef5b758e\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") "
Sep 09 06:06:03.331422 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.331387    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k49c4\" (UniqueName: \"kubernetes.io/projected/5dcb3985-5167-4318-afe9-3f6eef5b758e-kube-api-access-k49c4\") pod \"5dcb3985-5167-4318-afe9-3f6eef5b758e\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") "
Sep 09 06:06:03.331422 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.331416    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dcb3985-5167-4318-afe9-3f6eef5b758e-tls-certs\") pod \"5dcb3985-5167-4318-afe9-3f6eef5b758e\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") "
Sep 09 06:06:03.331636 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.331477    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-model-cache\") pod \"5dcb3985-5167-4318-afe9-3f6eef5b758e\" (UID: \"5dcb3985-5167-4318-afe9-3f6eef5b758e\") "
Sep 09 06:06:03.331701 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.331668    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5dcb3985-5167-4318-afe9-3f6eef5b758e" (UID: "5dcb3985-5167-4318-afe9-3f6eef5b758e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:06:03.331701 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.331681    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-home" (OuterVolumeSpecName: "home") pod "5dcb3985-5167-4318-afe9-3f6eef5b758e" (UID: "5dcb3985-5167-4318-afe9-3f6eef5b758e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:06:03.331870 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.331842    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-model-cache" (OuterVolumeSpecName: "model-cache") pod "5dcb3985-5167-4318-afe9-3f6eef5b758e" (UID: "5dcb3985-5167-4318-afe9-3f6eef5b758e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:06:03.331934 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.331869    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-home\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:03.331934 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.331885    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-tmp-dir\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:03.333775 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.333752    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-dshm" (OuterVolumeSpecName: "dshm") pod "5dcb3985-5167-4318-afe9-3f6eef5b758e" (UID: "5dcb3985-5167-4318-afe9-3f6eef5b758e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:06:03.333862 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.333777    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dcb3985-5167-4318-afe9-3f6eef5b758e-kube-api-access-k49c4" (OuterVolumeSpecName: "kube-api-access-k49c4") pod "5dcb3985-5167-4318-afe9-3f6eef5b758e" (UID: "5dcb3985-5167-4318-afe9-3f6eef5b758e"). InnerVolumeSpecName "kube-api-access-k49c4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:06:03.333862 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.333799    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dcb3985-5167-4318-afe9-3f6eef5b758e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5dcb3985-5167-4318-afe9-3f6eef5b758e" (UID: "5dcb3985-5167-4318-afe9-3f6eef5b758e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 06:06:03.432836 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.432804    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-model-cache\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:03.432836 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.432831    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5dcb3985-5167-4318-afe9-3f6eef5b758e-dshm\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:03.432836 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.432840    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k49c4\" (UniqueName: \"kubernetes.io/projected/5dcb3985-5167-4318-afe9-3f6eef5b758e-kube-api-access-k49c4\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:03.433058 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.432849    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5dcb3985-5167-4318-afe9-3f6eef5b758e-tls-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:03.452484 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.452451    2583 generic.go:356] "Generic (PLEG): container finished" podID="5dcb3985-5167-4318-afe9-3f6eef5b758e" containerID="1af3c6223f99e6e0e2a67807240b8859b383663e8edda5155a3a2752d5eb24c5" exitCode=0
Sep 09 06:06:03.452653 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.452482    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7" event={"ID":"5dcb3985-5167-4318-afe9-3f6eef5b758e","Type":"ContainerDied","Data":"1af3c6223f99e6e0e2a67807240b8859b383663e8edda5155a3a2752d5eb24c5"}
Sep 09 06:06:03.452653 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.452499    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"
Sep 09 06:06:03.452653 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.452524    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7" event={"ID":"5dcb3985-5167-4318-afe9-3f6eef5b758e","Type":"ContainerDied","Data":"ca3a9a68bfb7b87002e9777ac9a98c8c7008fb84d199116ac05165fbad80dc46"}
Sep 09 06:06:03.452653 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.452543    2583 scope.go:117] "RemoveContainer" containerID="1af3c6223f99e6e0e2a67807240b8859b383663e8edda5155a3a2752d5eb24c5"
Sep 09 06:06:03.462669 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.462648    2583 scope.go:117] "RemoveContainer" containerID="1af3c6223f99e6e0e2a67807240b8859b383663e8edda5155a3a2752d5eb24c5"
Sep 09 06:06:03.462968 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:06:03.462949    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1af3c6223f99e6e0e2a67807240b8859b383663e8edda5155a3a2752d5eb24c5\": container with ID starting with 1af3c6223f99e6e0e2a67807240b8859b383663e8edda5155a3a2752d5eb24c5 not found: ID does not exist" containerID="1af3c6223f99e6e0e2a67807240b8859b383663e8edda5155a3a2752d5eb24c5"
Sep 09 06:06:03.463075 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.462981    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1af3c6223f99e6e0e2a67807240b8859b383663e8edda5155a3a2752d5eb24c5"} err="failed to get container status \"1af3c6223f99e6e0e2a67807240b8859b383663e8edda5155a3a2752d5eb24c5\": rpc error: code = NotFound desc = could not find container \"1af3c6223f99e6e0e2a67807240b8859b383663e8edda5155a3a2752d5eb24c5\": container with ID starting with 1af3c6223f99e6e0e2a67807240b8859b383663e8edda5155a3a2752d5eb24c5 not found: ID does not exist"
Sep 09 06:06:03.473491 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.473468    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"]
Sep 09 06:06:03.477234 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.477215    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-f631ee/explicit-model-f631ee-kserve-646b4ddb89-2sqg7"]
Sep 09 06:06:03.503950 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.503890    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:03.780347 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.780257    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"]
Sep 09 06:06:03.780823 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.780797    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dcb3985-5167-4318-afe9-3f6eef5b758e" containerName="main"
Sep 09 06:06:03.780823 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.780820    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dcb3985-5167-4318-afe9-3f6eef5b758e" containerName="main"
Sep 09 06:06:03.781026 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.780918    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dcb3985-5167-4318-afe9-3f6eef5b758e" containerName="main"
Sep 09 06:06:03.785701 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.785681    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.788144 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.788120    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-464e41e7-openshift-default-dockercfg-h77bb\""
Sep 09 06:06:03.796437 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.796416    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"]
Sep 09 06:06:03.810542 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.810515    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:03.836409 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.836378    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-envoy\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.836585 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.836454    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-workload-certs\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.836585 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.836489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istiod-ca-cert\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.836681 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.836628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-workload-socket\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.836724 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.836690    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59k62\" (UniqueName: \"kubernetes.io/projected/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-kube-api-access-59k62\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.836772 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.836721    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-credential-socket\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.836772 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.836748    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-data\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.836864 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.836841    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-token\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.836925 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.836907    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-podinfo\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.937642 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.937608    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-envoy\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.937826 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.937687    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-workload-certs\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.937826 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.937711    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istiod-ca-cert\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.937826 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.937737    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-workload-socket\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.937826 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.937783    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59k62\" (UniqueName: \"kubernetes.io/projected/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-kube-api-access-59k62\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.937826 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.937809    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-credential-socket\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.938093 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.937830    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-data\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.938093 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.937859    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-token\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.938093 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.937892    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-podinfo\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.938255 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.938119    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-workload-certs\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.938255 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.938161    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-workload-socket\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.938387 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.938357    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-data\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.938456 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.938407    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-credential-socket\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.938931 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.938908    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istiod-ca-cert\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.940174 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.940154    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-envoy\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.940595 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.940549    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-podinfo\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.946397 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.946377    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59k62\" (UniqueName: \"kubernetes.io/projected/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-kube-api-access-59k62\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:03.946602 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:03.946488    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-token\") pod \"e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") " pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:04.099320 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:04.099223    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:04.379491 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:04.379466    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"]
Sep 09 06:06:04.381461 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:06:04.381436    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcba759f_c5d5_47b8_ab23_e4cfc42c7ebe.slice/crio-91622b0dd6c3d5dea6c9123cf73839e8cb9f86362c9b3a3b3e9e78ac6face27c WatchSource:0}: Error finding container 91622b0dd6c3d5dea6c9123cf73839e8cb9f86362c9b3a3b3e9e78ac6face27c: Status 404 returned error can't find the container with id 91622b0dd6c3d5dea6c9123cf73839e8cb9f86362c9b3a3b3e9e78ac6face27c
Sep 09 06:06:04.383861 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:04.383831    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:06:04.383925 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:04.383894    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:06:04.383968 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:04.383927    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:06:04.402722 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:04.402698    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:04.461101 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:04.461075    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" event={"ID":"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe","Type":"ContainerStarted","Data":"8ac86c1ed114e9ccd51d185f1dba4222e33ea4c6b1a62ed85f6ba240ff19b718"}
Sep 09 06:06:04.461224 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:04.461130    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" event={"ID":"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe","Type":"ContainerStarted","Data":"91622b0dd6c3d5dea6c9123cf73839e8cb9f86362c9b3a3b3e9e78ac6face27c"}
Sep 09 06:06:04.480117 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:04.480058    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" podStartSLOduration=1.48003883 podStartE2EDuration="1.48003883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:06:04.479507649 +0000 UTC m=+985.710004203" watchObservedRunningTime="2026-09-09 06:06:04.48003883 +0000 UTC m=+985.710535383"
Sep 09 06:06:05.100243 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:05.100207    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:05.101548 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:05.101520    2583 patch_prober.go:28] interesting pod/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 09 06:06:05.101688 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:05.101591    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 09 06:06:05.245401 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:05.245365    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dcb3985-5167-4318-afe9-3f6eef5b758e" path="/var/lib/kubelet/pods/5dcb3985-5167-4318-afe9-3f6eef5b758e/volumes"
Sep 09 06:06:05.626759 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:05.626726    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:05.870775 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:05.870742    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"]
Sep 09 06:06:05.870994 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:05.870970    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerName="istio-proxy" containerID="cri-o://3f9266bdacd0e64bc3de0e0cbab51d02f418e663c381d9836fef6a2b92fe1681" gracePeriod=30
Sep 09 06:06:05.890268 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:05.890185    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:06.104073 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.104041    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:06.339945 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.339864    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:06.471222 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.471188    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:06.472375 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.472350    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:06.647698 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.647660    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"]
Sep 09 06:06:06.651290 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.651269    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.653923 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.653855    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-f8bdbb-openshift-default-dockercfg-9bpt5\""
Sep 09 06:06:06.674677 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.674646    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"]
Sep 09 06:06:06.685213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.685182    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:06.763666 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.763623    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-envoy\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.763842 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.763712    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-workload-certs\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.763842 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.763733    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-podinfo\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.763842 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.763760    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istiod-ca-cert\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.763842 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.763805    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-data\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.763984 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.763856    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-token\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.763984 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.763909    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69flg\" (UniqueName: \"kubernetes.io/projected/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-kube-api-access-69flg\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.763984 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.763946    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-workload-socket\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.763984 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.763966    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-credential-socket\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.771133 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.771103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:06.864898 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.864825    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-data\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.865105 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.864905    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-token\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.865105 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.864971    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69flg\" (UniqueName: \"kubernetes.io/projected/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-kube-api-access-69flg\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.865105 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.865016    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-workload-socket\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.865105 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.865046    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-credential-socket\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.865344 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.865113    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-envoy\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.865344 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.865163    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-workload-certs\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.865344 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.865188    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-podinfo\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.865344 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.865223    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istiod-ca-cert\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.866085 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.866042    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istiod-ca-cert\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.866352 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.866332    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-data\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.867104 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.867081    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-workload-socket\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.867348 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.867329    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-credential-socket\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.868321 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.868292    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-workload-certs\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.883942 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.883392    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-envoy\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.884091 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.884050    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:06.884431 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.884385    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-podinfo\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.886337 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.886311    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69flg\" (UniqueName: \"kubernetes.io/projected/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-kube-api-access-69flg\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.899681 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.887035    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-token\") pod \"e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") " pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:06.963193 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:06.963152    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:07.248972 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:07.248866    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"]
Sep 09 06:06:07.251318 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:06:07.251289    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a47426b_f8aa_4dfd_9f43_b0fc5e686612.slice/crio-65f8bd78930667d092c1a68f23051a47e835e57127b01c8d05c68f48dd58718d WatchSource:0}: Error finding container 65f8bd78930667d092c1a68f23051a47e835e57127b01c8d05c68f48dd58718d: Status 404 returned error can't find the container with id 65f8bd78930667d092c1a68f23051a47e835e57127b01c8d05c68f48dd58718d
Sep 09 06:06:07.253836 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:07.253804    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:06:07.253942 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:07.253878    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:06:07.253942 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:07.253921    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:06:07.480643 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:07.480606    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt" event={"ID":"7a47426b-f8aa-4dfd-9f43-b0fc5e686612","Type":"ContainerStarted","Data":"7e5ffe59d80e035f9f585c4d44122c732cc9dbc48206d96622547d257a0103d5"}
Sep 09 06:06:07.480845 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:07.480672    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt" event={"ID":"7a47426b-f8aa-4dfd-9f43-b0fc5e686612","Type":"ContainerStarted","Data":"65f8bd78930667d092c1a68f23051a47e835e57127b01c8d05c68f48dd58718d"}
Sep 09 06:06:07.504419 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:07.504314    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt" podStartSLOduration=1.5042910840000001 podStartE2EDuration="1.504291084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:06:07.501519629 +0000 UTC m=+988.732016182" watchObservedRunningTime="2026-09-09 06:06:07.504291084 +0000 UTC m=+988.734787637"
Sep 09 06:06:07.795132 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:07.795048    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:07.890204 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:07.890169    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:07.963372 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:07.963333    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:07.990761 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:07.990712    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:08.090530 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:08.090438    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:08.190444 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:08.190410    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:08.554527 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:08.554494    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:08.656452 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:08.656414    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:08.968862 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:08.968835    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:09.491475 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:09.491443    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:09.492378 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:09.492358    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:06:11.131287 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.131263    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:06:11.214176 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214092    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b591758e-8b9e-46ca-93c5-f19de9718f50-istiod-ca-cert\") pod \"b591758e-8b9e-46ca-93c5-f19de9718f50\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") "
Sep 09 06:06:11.214176 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214165    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-workload-socket\") pod \"b591758e-8b9e-46ca-93c5-f19de9718f50\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") "
Sep 09 06:06:11.214395 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214191    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-workload-certs\") pod \"b591758e-8b9e-46ca-93c5-f19de9718f50\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") "
Sep 09 06:06:11.214395 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214211    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-token\") pod \"b591758e-8b9e-46ca-93c5-f19de9718f50\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") "
Sep 09 06:06:11.214395 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214235    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-envoy\") pod \"b591758e-8b9e-46ca-93c5-f19de9718f50\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") "
Sep 09 06:06:11.214395 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214266    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-podinfo\") pod \"b591758e-8b9e-46ca-93c5-f19de9718f50\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") "
Sep 09 06:06:11.214395 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214317    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-credential-socket\") pod \"b591758e-8b9e-46ca-93c5-f19de9718f50\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") "
Sep 09 06:06:11.214395 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214369    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svltw\" (UniqueName: \"kubernetes.io/projected/b591758e-8b9e-46ca-93c5-f19de9718f50-kube-api-access-svltw\") pod \"b591758e-8b9e-46ca-93c5-f19de9718f50\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") "
Sep 09 06:06:11.214395 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214396    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-data\") pod \"b591758e-8b9e-46ca-93c5-f19de9718f50\" (UID: \"b591758e-8b9e-46ca-93c5-f19de9718f50\") "
Sep 09 06:06:11.214781 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214509    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b591758e-8b9e-46ca-93c5-f19de9718f50-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b591758e-8b9e-46ca-93c5-f19de9718f50" (UID: "b591758e-8b9e-46ca-93c5-f19de9718f50"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:06:11.214781 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214526    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b591758e-8b9e-46ca-93c5-f19de9718f50" (UID: "b591758e-8b9e-46ca-93c5-f19de9718f50"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:06:11.214781 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214619    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b591758e-8b9e-46ca-93c5-f19de9718f50" (UID: "b591758e-8b9e-46ca-93c5-f19de9718f50"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:06:11.214781 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214509    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b591758e-8b9e-46ca-93c5-f19de9718f50" (UID: "b591758e-8b9e-46ca-93c5-f19de9718f50"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:06:11.215228 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214797    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-data" (OuterVolumeSpecName: "istio-data") pod "b591758e-8b9e-46ca-93c5-f19de9718f50" (UID: "b591758e-8b9e-46ca-93c5-f19de9718f50"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:06:11.215228 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214919    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b591758e-8b9e-46ca-93c5-f19de9718f50-istiod-ca-cert\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:11.215228 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214940    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-workload-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:11.215228 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214953    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-workload-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:11.215228 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214965    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-credential-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:11.215228 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.214978    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:11.216704 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.216671    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b591758e-8b9e-46ca-93c5-f19de9718f50" (UID: "b591758e-8b9e-46ca-93c5-f19de9718f50"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:06:11.216818 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.216715    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-token" (OuterVolumeSpecName: "istio-token") pod "b591758e-8b9e-46ca-93c5-f19de9718f50" (UID: "b591758e-8b9e-46ca-93c5-f19de9718f50"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:06:11.216818 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.216769    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b591758e-8b9e-46ca-93c5-f19de9718f50-kube-api-access-svltw" (OuterVolumeSpecName: "kube-api-access-svltw") pod "b591758e-8b9e-46ca-93c5-f19de9718f50" (UID: "b591758e-8b9e-46ca-93c5-f19de9718f50"). InnerVolumeSpecName "kube-api-access-svltw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:06:11.216936 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.216910    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b591758e-8b9e-46ca-93c5-f19de9718f50" (UID: "b591758e-8b9e-46ca-93c5-f19de9718f50"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 06:06:11.316071 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.316038    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-token\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:11.316071 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.316066    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-envoy\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:11.316071 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.316076    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b591758e-8b9e-46ca-93c5-f19de9718f50-istio-podinfo\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:11.316296 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.316084    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svltw\" (UniqueName: \"kubernetes.io/projected/b591758e-8b9e-46ca-93c5-f19de9718f50-kube-api-access-svltw\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:06:11.503290 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.503204    2583 generic.go:356] "Generic (PLEG): container finished" podID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerID="3f9266bdacd0e64bc3de0e0cbab51d02f418e663c381d9836fef6a2b92fe1681" exitCode=0
Sep 09 06:06:11.503290 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.503260    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"
Sep 09 06:06:11.503464 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.503288    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" event={"ID":"b591758e-8b9e-46ca-93c5-f19de9718f50","Type":"ContainerDied","Data":"3f9266bdacd0e64bc3de0e0cbab51d02f418e663c381d9836fef6a2b92fe1681"}
Sep 09 06:06:11.503464 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.503343    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7" event={"ID":"b591758e-8b9e-46ca-93c5-f19de9718f50","Type":"ContainerDied","Data":"2a352660f3c3e79de5adc47fce6317b4643527d36745709e3d03528083d17eb1"}
Sep 09 06:06:11.503464 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.503368    2583 scope.go:117] "RemoveContainer" containerID="3f9266bdacd0e64bc3de0e0cbab51d02f418e663c381d9836fef6a2b92fe1681"
Sep 09 06:06:11.512815 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.512790    2583 scope.go:117] "RemoveContainer" containerID="0df3bce0b5f4951eab33ef27f8296528c6ac0a8acbf880cc17fdab0bd35aa3fc"
Sep 09 06:06:11.520240 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.520217    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"]
Sep 09 06:06:11.522704 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.522660    2583 scope.go:117] "RemoveContainer" containerID="3f9266bdacd0e64bc3de0e0cbab51d02f418e663c381d9836fef6a2b92fe1681"
Sep 09 06:06:11.523021 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:06:11.523002    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f9266bdacd0e64bc3de0e0cbab51d02f418e663c381d9836fef6a2b92fe1681\": container with ID starting with 3f9266bdacd0e64bc3de0e0cbab51d02f418e663c381d9836fef6a2b92fe1681 not found: ID does not exist" containerID="3f9266bdacd0e64bc3de0e0cbab51d02f418e663c381d9836fef6a2b92fe1681"
Sep 09 06:06:11.523096 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.523034    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f9266bdacd0e64bc3de0e0cbab51d02f418e663c381d9836fef6a2b92fe1681"} err="failed to get container status \"3f9266bdacd0e64bc3de0e0cbab51d02f418e663c381d9836fef6a2b92fe1681\": rpc error: code = NotFound desc = could not find container \"3f9266bdacd0e64bc3de0e0cbab51d02f418e663c381d9836fef6a2b92fe1681\": container with ID starting with 3f9266bdacd0e64bc3de0e0cbab51d02f418e663c381d9836fef6a2b92fe1681 not found: ID does not exist"
Sep 09 06:06:11.523096 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.523068    2583 scope.go:117] "RemoveContainer" containerID="0df3bce0b5f4951eab33ef27f8296528c6ac0a8acbf880cc17fdab0bd35aa3fc"
Sep 09 06:06:11.523338 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:06:11.523323    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0df3bce0b5f4951eab33ef27f8296528c6ac0a8acbf880cc17fdab0bd35aa3fc\": container with ID starting with 0df3bce0b5f4951eab33ef27f8296528c6ac0a8acbf880cc17fdab0bd35aa3fc not found: ID does not exist" containerID="0df3bce0b5f4951eab33ef27f8296528c6ac0a8acbf880cc17fdab0bd35aa3fc"
Sep 09 06:06:11.523392 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.523345    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0df3bce0b5f4951eab33ef27f8296528c6ac0a8acbf880cc17fdab0bd35aa3fc"} err="failed to get container status \"0df3bce0b5f4951eab33ef27f8296528c6ac0a8acbf880cc17fdab0bd35aa3fc\": rpc error: code = NotFound desc = could not find container \"0df3bce0b5f4951eab33ef27f8296528c6ac0a8acbf880cc17fdab0bd35aa3fc\": container with ID starting with 0df3bce0b5f4951eab33ef27f8296528c6ac0a8acbf880cc17fdab0bd35aa3fc not found: ID does not exist"
Sep 09 06:06:11.524089 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:11.524068    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-f631ee-openshift-default-7cff5f7f5b-ws5l7"]
Sep 09 06:06:13.245414 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:13.245378    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" path="/var/lib/kubelet/pods/b591758e-8b9e-46ca-93c5-f19de9718f50/volumes"
Sep 09 06:06:17.525057 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:17.524947    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:21.731106 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:21.729907    2583 patch_prober.go:28] interesting pod/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:52154->10.134.0.49:15021: read: connection reset by peer" start-of-body=
Sep 09 06:06:21.731106 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:21.729985    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": read tcp 10.134.0.2:52154->10.134.0.49:15021: read: connection reset by peer"
Sep 09 06:06:22.567397 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:22.567360    2583 generic.go:356] "Generic (PLEG): container finished" podID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerID="8ac86c1ed114e9ccd51d185f1dba4222e33ea4c6b1a62ed85f6ba240ff19b718" exitCode=0
Sep 09 06:06:22.567637 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:22.567499    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" event={"ID":"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe","Type":"ContainerDied","Data":"8ac86c1ed114e9ccd51d185f1dba4222e33ea4c6b1a62ed85f6ba240ff19b718"}
Sep 09 06:06:22.568073 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:22.568054    2583 scope.go:117] "RemoveContainer" containerID="8ac86c1ed114e9ccd51d185f1dba4222e33ea4c6b1a62ed85f6ba240ff19b718"
Sep 09 06:06:22.569673 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:22.569637    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:06:22.569792 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:22.569735    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:06:22.569792 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:22.569781    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:06:23.581448 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:23.581399    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" event={"ID":"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe","Type":"ContainerStarted","Data":"fde4490ca9965e8b38107a1cac014ad9df31000da300eb15dc9c64afbda18483"}
Sep 09 06:06:24.100321 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:24.100279    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:24.100597 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:24.100415    2583 patch_prober.go:28] interesting pod/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 09 06:06:24.100597 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:24.100459    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 09 06:06:25.100215 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:25.100180    2583 patch_prober.go:28] interesting pod/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 09 06:06:25.100710 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:25.100236    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 09 06:06:26.099968 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:26.099930    2583 patch_prober.go:28] interesting pod/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 09 06:06:26.100165 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:26.099996    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 09 06:06:27.100080 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:27.100035    2583 patch_prober.go:28] interesting pod/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 09 06:06:27.100608 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:27.100089    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 09 06:06:28.099902 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:28.099860    2583 patch_prober.go:28] interesting pod/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 09 06:06:28.100109 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:28.099946    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 09 06:06:29.103305 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:29.103272    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:29.103695 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:29.103547    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:29.104205 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:29.104189    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:06:31.630850 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:31.630810    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:32.299444 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:32.299407    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:32.399501 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:32.399471    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:32.739352 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:32.739318    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:38.363167 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:38.363128    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:38.463732 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:38.463702    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:49.236427 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:49.236395    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:50.376750 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:50.376715    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:50.437366 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:50.437338    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:52.283370 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:52.283337    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:55.663730 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:55.663689    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:55.764782 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:55.764749    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:55.899626 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:55.899592    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"]
Sep 09 06:06:55.899893 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:55.899857    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy" containerID="cri-o://fde4490ca9965e8b38107a1cac014ad9df31000da300eb15dc9c64afbda18483" gracePeriod=30
Sep 09 06:06:55.922645 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:55.922540    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:56.255680 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:56.255595    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:56.348199 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:56.348157    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:56.463174 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:56.463140    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:06:59.106488 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:59.106454    2583 patch_prober.go:28] interesting pod/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 06:06:59.106872 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:06:59.106525    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 06:07:01.165266 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.165199    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:07:01.233292 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.233257    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-envoy\") pod \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") "
Sep 09 06:07:01.233292 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.233294    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-podinfo\") pod \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") "
Sep 09 06:07:01.233517 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.233362    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-credential-socket\") pod \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") "
Sep 09 06:07:01.233517 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.233390    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59k62\" (UniqueName: \"kubernetes.io/projected/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-kube-api-access-59k62\") pod \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") "
Sep 09 06:07:01.233517 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.233424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-workload-socket\") pod \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") "
Sep 09 06:07:01.233517 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.233478    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-workload-certs\") pod \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") "
Sep 09 06:07:01.233770 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.233520    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-token\") pod \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") "
Sep 09 06:07:01.233770 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.233576    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-data\") pod \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") "
Sep 09 06:07:01.233770 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.233650    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istiod-ca-cert\") pod \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\" (UID: \"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe\") "
Sep 09 06:07:01.233770 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.233700    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" (UID: "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:07:01.233981 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.233864    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" (UID: "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:07:01.233981 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.233917    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-data" (OuterVolumeSpecName: "istio-data") pod "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" (UID: "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:07:01.234266 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.234014    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" (UID: "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:07:01.234266 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.234067    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-credential-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:01.234266 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.234085    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-workload-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:01.234266 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.234097    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:01.234504 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.234344    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" (UID: "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:07:01.235730 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.235701    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" (UID: "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:07:01.235846 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.235729    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-kube-api-access-59k62" (OuterVolumeSpecName: "kube-api-access-59k62") pod "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" (UID: "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe"). InnerVolumeSpecName "kube-api-access-59k62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:07:01.235846 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.235760    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" (UID: "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 06:07:01.235846 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.235760    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-token" (OuterVolumeSpecName: "istio-token") pod "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" (UID: "fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:07:01.335766 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.335732    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-token\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:01.335766 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.335766    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istiod-ca-cert\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:01.336018 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.335777    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-envoy\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:01.336018 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.335785    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-istio-podinfo\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:01.336018 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.335793    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59k62\" (UniqueName: \"kubernetes.io/projected/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-kube-api-access-59k62\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:01.336018 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.335803    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe-workload-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:01.790435 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.790398    2583 generic.go:356] "Generic (PLEG): container finished" podID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerID="fde4490ca9965e8b38107a1cac014ad9df31000da300eb15dc9c64afbda18483" exitCode=0
Sep 09 06:07:01.790670 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.790449    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"
Sep 09 06:07:01.790670 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.790487    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" event={"ID":"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe","Type":"ContainerDied","Data":"fde4490ca9965e8b38107a1cac014ad9df31000da300eb15dc9c64afbda18483"}
Sep 09 06:07:01.790670 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.790579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj" event={"ID":"fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe","Type":"ContainerDied","Data":"91622b0dd6c3d5dea6c9123cf73839e8cb9f86362c9b3a3b3e9e78ac6face27c"}
Sep 09 06:07:01.790670 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.790614    2583 scope.go:117] "RemoveContainer" containerID="fde4490ca9965e8b38107a1cac014ad9df31000da300eb15dc9c64afbda18483"
Sep 09 06:07:01.799874 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.799851    2583 scope.go:117] "RemoveContainer" containerID="8ac86c1ed114e9ccd51d185f1dba4222e33ea4c6b1a62ed85f6ba240ff19b718"
Sep 09 06:07:01.808896 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.808877    2583 scope.go:117] "RemoveContainer" containerID="fde4490ca9965e8b38107a1cac014ad9df31000da300eb15dc9c64afbda18483"
Sep 09 06:07:01.809180 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:07:01.809161    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fde4490ca9965e8b38107a1cac014ad9df31000da300eb15dc9c64afbda18483\": container with ID starting with fde4490ca9965e8b38107a1cac014ad9df31000da300eb15dc9c64afbda18483 not found: ID does not exist" containerID="fde4490ca9965e8b38107a1cac014ad9df31000da300eb15dc9c64afbda18483"
Sep 09 06:07:01.809267 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.809189    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fde4490ca9965e8b38107a1cac014ad9df31000da300eb15dc9c64afbda18483"} err="failed to get container status \"fde4490ca9965e8b38107a1cac014ad9df31000da300eb15dc9c64afbda18483\": rpc error: code = NotFound desc = could not find container \"fde4490ca9965e8b38107a1cac014ad9df31000da300eb15dc9c64afbda18483\": container with ID starting with fde4490ca9965e8b38107a1cac014ad9df31000da300eb15dc9c64afbda18483 not found: ID does not exist"
Sep 09 06:07:01.809267 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.809207    2583 scope.go:117] "RemoveContainer" containerID="8ac86c1ed114e9ccd51d185f1dba4222e33ea4c6b1a62ed85f6ba240ff19b718"
Sep 09 06:07:01.814574 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:07:01.809724    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ac86c1ed114e9ccd51d185f1dba4222e33ea4c6b1a62ed85f6ba240ff19b718\": container with ID starting with 8ac86c1ed114e9ccd51d185f1dba4222e33ea4c6b1a62ed85f6ba240ff19b718 not found: ID does not exist" containerID="8ac86c1ed114e9ccd51d185f1dba4222e33ea4c6b1a62ed85f6ba240ff19b718"
Sep 09 06:07:01.814574 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.809763    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ac86c1ed114e9ccd51d185f1dba4222e33ea4c6b1a62ed85f6ba240ff19b718"} err="failed to get container status \"8ac86c1ed114e9ccd51d185f1dba4222e33ea4c6b1a62ed85f6ba240ff19b718\": rpc error: code = NotFound desc = could not find container \"8ac86c1ed114e9ccd51d185f1dba4222e33ea4c6b1a62ed85f6ba240ff19b718\": container with ID starting with 8ac86c1ed114e9ccd51d185f1dba4222e33ea4c6b1a62ed85f6ba240ff19b718 not found: ID does not exist"
Sep 09 06:07:01.814574 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.811443    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"]
Sep 09 06:07:01.816278 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:01.816254    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-464e41e7-openshift-default-5496fb896-c5nnj"]
Sep 09 06:07:02.066920 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:02.066832    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:02.170141 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:02.170101    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:02.267875 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:02.267842    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:02.457330 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:02.457291    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:02.885491 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:02.885462    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:02.979315 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:02.979281    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"]
Sep 09 06:07:02.979640 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:02.979608    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt" podUID="7a47426b-f8aa-4dfd-9f43-b0fc5e686612" containerName="istio-proxy" containerID="cri-o://7e5ffe59d80e035f9f585c4d44122c732cc9dbc48206d96622547d257a0103d5" gracePeriod=30
Sep 09 06:07:03.002115 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:03.002084    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:03.220975 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:03.220882    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:03.245724 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:03.245695    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" path="/var/lib/kubelet/pods/fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe/volumes"
Sep 09 06:07:03.329803 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:03.329768    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:05.488090 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:05.488053    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:08.046756 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.046724    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:08.147283 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.147250    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:08.230817 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.230796    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:07:08.353094 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.353017    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:08.409311 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.409277    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-envoy\") pod \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") "
Sep 09 06:07:08.409435 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.409393    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-token\") pod \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") "
Sep 09 06:07:08.409435 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.409422    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istiod-ca-cert\") pod \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") "
Sep 09 06:07:08.409517 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.409450    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-credential-socket\") pod \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") "
Sep 09 06:07:08.409517 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.409497    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69flg\" (UniqueName: \"kubernetes.io/projected/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-kube-api-access-69flg\") pod \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") "
Sep 09 06:07:08.409635 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.409526    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-data\") pod \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") "
Sep 09 06:07:08.409635 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.409588    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-workload-certs\") pod \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") "
Sep 09 06:07:08.409730 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.409640    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-workload-socket\") pod \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") "
Sep 09 06:07:08.409730 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.409681    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-podinfo\") pod \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\" (UID: \"7a47426b-f8aa-4dfd-9f43-b0fc5e686612\") "
Sep 09 06:07:08.409976 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.409864    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a47426b-f8aa-4dfd-9f43-b0fc5e686612" (UID: "7a47426b-f8aa-4dfd-9f43-b0fc5e686612"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:07:08.409976 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.409892    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a47426b-f8aa-4dfd-9f43-b0fc5e686612" (UID: "7a47426b-f8aa-4dfd-9f43-b0fc5e686612"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:07:08.409976 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.409879    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a47426b-f8aa-4dfd-9f43-b0fc5e686612" (UID: "7a47426b-f8aa-4dfd-9f43-b0fc5e686612"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:07:08.410341 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.410078    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a47426b-f8aa-4dfd-9f43-b0fc5e686612" (UID: "7a47426b-f8aa-4dfd-9f43-b0fc5e686612"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:07:08.410341 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.410126    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a47426b-f8aa-4dfd-9f43-b0fc5e686612" (UID: "7a47426b-f8aa-4dfd-9f43-b0fc5e686612"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:07:08.410341 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.410291    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istiod-ca-cert\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:08.410341 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.410313    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-credential-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:08.410341 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.410327    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:08.410341 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.410340    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-workload-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:08.410705 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.410353    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-workload-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:08.411831 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.411803    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a47426b-f8aa-4dfd-9f43-b0fc5e686612" (UID: "7a47426b-f8aa-4dfd-9f43-b0fc5e686612"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:07:08.411931 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.411858    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a47426b-f8aa-4dfd-9f43-b0fc5e686612" (UID: "7a47426b-f8aa-4dfd-9f43-b0fc5e686612"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:07:08.411982 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.411966    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-kube-api-access-69flg" (OuterVolumeSpecName: "kube-api-access-69flg") pod "7a47426b-f8aa-4dfd-9f43-b0fc5e686612" (UID: "7a47426b-f8aa-4dfd-9f43-b0fc5e686612"). InnerVolumeSpecName "kube-api-access-69flg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:07:08.412204 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.412190    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a47426b-f8aa-4dfd-9f43-b0fc5e686612" (UID: "7a47426b-f8aa-4dfd-9f43-b0fc5e686612"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 06:07:08.511859 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.511818    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-token\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:08.511859 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.511852    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69flg\" (UniqueName: \"kubernetes.io/projected/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-kube-api-access-69flg\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:08.511859 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.511866    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-podinfo\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:08.512082 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.511877    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a47426b-f8aa-4dfd-9f43-b0fc5e686612-istio-envoy\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:07:08.826712 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.826678    2583 generic.go:356] "Generic (PLEG): container finished" podID="7a47426b-f8aa-4dfd-9f43-b0fc5e686612" containerID="7e5ffe59d80e035f9f585c4d44122c732cc9dbc48206d96622547d257a0103d5" exitCode=0
Sep 09 06:07:08.826885 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.826734    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"
Sep 09 06:07:08.826885 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.826762    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt" event={"ID":"7a47426b-f8aa-4dfd-9f43-b0fc5e686612","Type":"ContainerDied","Data":"7e5ffe59d80e035f9f585c4d44122c732cc9dbc48206d96622547d257a0103d5"}
Sep 09 06:07:08.826885 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.826824    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt" event={"ID":"7a47426b-f8aa-4dfd-9f43-b0fc5e686612","Type":"ContainerDied","Data":"65f8bd78930667d092c1a68f23051a47e835e57127b01c8d05c68f48dd58718d"}
Sep 09 06:07:08.826885 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.826853    2583 scope.go:117] "RemoveContainer" containerID="7e5ffe59d80e035f9f585c4d44122c732cc9dbc48206d96622547d257a0103d5"
Sep 09 06:07:08.838050 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.838031    2583 scope.go:117] "RemoveContainer" containerID="7e5ffe59d80e035f9f585c4d44122c732cc9dbc48206d96622547d257a0103d5"
Sep 09 06:07:08.838365 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:07:08.838346    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e5ffe59d80e035f9f585c4d44122c732cc9dbc48206d96622547d257a0103d5\": container with ID starting with 7e5ffe59d80e035f9f585c4d44122c732cc9dbc48206d96622547d257a0103d5 not found: ID does not exist" containerID="7e5ffe59d80e035f9f585c4d44122c732cc9dbc48206d96622547d257a0103d5"
Sep 09 06:07:08.838419 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.838375    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e5ffe59d80e035f9f585c4d44122c732cc9dbc48206d96622547d257a0103d5"} err="failed to get container status \"7e5ffe59d80e035f9f585c4d44122c732cc9dbc48206d96622547d257a0103d5\": rpc error: code = NotFound desc = could not find container \"7e5ffe59d80e035f9f585c4d44122c732cc9dbc48206d96622547d257a0103d5\": container with ID starting with 7e5ffe59d80e035f9f585c4d44122c732cc9dbc48206d96622547d257a0103d5 not found: ID does not exist"
Sep 09 06:07:08.850235 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.850197    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"]
Sep 09 06:07:08.854439 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.854417    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-f8bdbb-openshift-default-5df74574f6-hzgpt"]
Sep 09 06:07:08.941355 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:08.941320    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:09.231290 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231258    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"]
Sep 09 06:07:09.231741 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231727    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerName="istio-proxy"
Sep 09 06:07:09.231788 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231742    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerName="istio-proxy"
Sep 09 06:07:09.231788 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231750    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a47426b-f8aa-4dfd-9f43-b0fc5e686612" containerName="istio-proxy"
Sep 09 06:07:09.231788 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231756    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a47426b-f8aa-4dfd-9f43-b0fc5e686612" containerName="istio-proxy"
Sep 09 06:07:09.231788 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231773    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerName="istio-proxy"
Sep 09 06:07:09.231788 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231778    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerName="istio-proxy"
Sep 09 06:07:09.231788 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231785    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy"
Sep 09 06:07:09.231968 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231791    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy"
Sep 09 06:07:09.231968 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231811    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy"
Sep 09 06:07:09.231968 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231817    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy"
Sep 09 06:07:09.231968 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231883    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a47426b-f8aa-4dfd-9f43-b0fc5e686612" containerName="istio-proxy"
Sep 09 06:07:09.231968 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231892    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerName="istio-proxy"
Sep 09 06:07:09.231968 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231898    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy"
Sep 09 06:07:09.231968 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.231905    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcba759f-c5d5-47b8-ab23-e4cfc42c7ebe" containerName="istio-proxy"
Sep 09 06:07:09.241410 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.241384    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.244466 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.244439    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-f3d736-openshift-default-dockercfg-hwlxw\""
Sep 09 06:07:09.251329 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.251262    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a47426b-f8aa-4dfd-9f43-b0fc5e686612" path="/var/lib/kubelet/pods/7a47426b-f8aa-4dfd-9f43-b0fc5e686612/volumes"
Sep 09 06:07:09.251642 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.251622    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"]
Sep 09 06:07:09.252269 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.252246    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:09.421095 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.421061    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-envoy\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.421272 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.421115    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-token\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.421272 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.421197    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-workload-certs\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.421272 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.421233    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-podinfo\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.421411 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.421285    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll5hd\" (UniqueName: \"kubernetes.io/projected/b97e8ea2-b0f8-4c84-9849-d53609a22677-kube-api-access-ll5hd\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.421411 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.421318    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-data\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.421411 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.421343    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-workload-socket\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.421504 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.421475    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-credential-socket\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.421551 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.421516    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b97e8ea2-b0f8-4c84-9849-d53609a22677-istiod-ca-cert\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.522675 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.522587    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll5hd\" (UniqueName: \"kubernetes.io/projected/b97e8ea2-b0f8-4c84-9849-d53609a22677-kube-api-access-ll5hd\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.522675 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.522628    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-data\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.522675 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.522652    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-workload-socket\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.522912 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.522699    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-credential-socket\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.522912 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.522729    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b97e8ea2-b0f8-4c84-9849-d53609a22677-istiod-ca-cert\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.522912 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.522793    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-envoy\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.522912 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.522832    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-token\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.522912 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.522872    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-workload-certs\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.522912 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.522897    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-podinfo\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.523167 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.523051    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-data\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.523167 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.523127    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-workload-socket\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.523324 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.523305    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-workload-certs\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.523410 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.523391    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-credential-socket\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.523471 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.523453    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b97e8ea2-b0f8-4c84-9849-d53609a22677-istiod-ca-cert\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.525368 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.525346    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-envoy\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.525652 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.525632    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-podinfo\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.536004 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.535981    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-token\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.536466 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.536444    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll5hd\" (UniqueName: \"kubernetes.io/projected/b97e8ea2-b0f8-4c84-9849-d53609a22677-kube-api-access-ll5hd\") pod \"e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") " pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.555278 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.555255    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:09.833085 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.833005    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"]
Sep 09 06:07:09.836544 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:07:09.836520    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97e8ea2_b0f8_4c84_9849_d53609a22677.slice/crio-e84ae12c2b404c514e6c1350094f95078a4c1841c81832ec4346f5d5dc7663ac WatchSource:0}: Error finding container e84ae12c2b404c514e6c1350094f95078a4c1841c81832ec4346f5d5dc7663ac: Status 404 returned error can't find the container with id e84ae12c2b404c514e6c1350094f95078a4c1841c81832ec4346f5d5dc7663ac
Sep 09 06:07:09.838474 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.838448    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:07:09.838534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.838513    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:07:09.838589 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:09.838541    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:07:10.572579 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:10.572519    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:10.842755 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:10.842664    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql" event={"ID":"b97e8ea2-b0f8-4c84-9849-d53609a22677","Type":"ContainerStarted","Data":"ac1c92fefd57bbb95bf9121c70edd19d3daeba1ae24b5438b7e63fcdd1de821d"}
Sep 09 06:07:10.842755 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:10.842732    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql" event={"ID":"b97e8ea2-b0f8-4c84-9849-d53609a22677","Type":"ContainerStarted","Data":"e84ae12c2b404c514e6c1350094f95078a4c1841c81832ec4346f5d5dc7663ac"}
Sep 09 06:07:10.864213 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:10.864163    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql" podStartSLOduration=1.8641480160000001 podStartE2EDuration="1.864148016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:07:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:07:10.861632012 +0000 UTC m=+1052.092128568" watchObservedRunningTime="2026-09-09 06:07:10.864148016 +0000 UTC m=+1052.094644568"
Sep 09 06:07:11.555928 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:11.555892    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:11.561019 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:11.560994    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:11.848320 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:11.848238    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:11.849676 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:11.849658    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:12.136495 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:12.136461    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:12.749737 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:12.749674    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:12.843899 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:12.843872    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:13.897791 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:13.897754    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:13.996721 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:13.996688    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:14.097203 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.097160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:14.370751 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.370704    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:14.456421 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.456367    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:14.482509 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.482473    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"]
Sep 09 06:07:14.483171 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.483147    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b591758e-8b9e-46ca-93c5-f19de9718f50" containerName="istio-proxy"
Sep 09 06:07:14.486396 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.486379    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"
Sep 09 06:07:14.489049 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.489019    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-f3d736\""
Sep 09 06:07:14.489163 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.489067    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-f3d736-dockercfg-n97dt\""
Sep 09 06:07:14.497570 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.497527    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"]
Sep 09 06:07:14.513841 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.513806    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"]
Sep 09 06:07:14.517534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.517511    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"
Sep 09 06:07:14.524866 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.524596    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"]
Sep 09 06:07:14.568376 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.568345    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx4t2\" (UniqueName: \"kubernetes.io/projected/fb759c51-b618-47eb-9419-70846992730f-kube-api-access-sx4t2\") pod \"payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx\" (UID: \"fb759c51-b618-47eb-9419-70846992730f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"
Sep 09 06:07:14.568539 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.568383    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62169d01-3a8a-45f4-99bd-dba0aeb2fcb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp\" (UID: \"62169d01-3a8a-45f4-99bd-dba0aeb2fcb8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"
Sep 09 06:07:14.568539 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.568494    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb759c51-b618-47eb-9419-70846992730f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx\" (UID: \"fb759c51-b618-47eb-9419-70846992730f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"
Sep 09 06:07:14.568634 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.568539    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cffwb\" (UniqueName: \"kubernetes.io/projected/62169d01-3a8a-45f4-99bd-dba0aeb2fcb8-kube-api-access-cffwb\") pod \"payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp\" (UID: \"62169d01-3a8a-45f4-99bd-dba0aeb2fcb8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"
Sep 09 06:07:14.669108 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.669027    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cffwb\" (UniqueName: \"kubernetes.io/projected/62169d01-3a8a-45f4-99bd-dba0aeb2fcb8-kube-api-access-cffwb\") pod \"payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp\" (UID: \"62169d01-3a8a-45f4-99bd-dba0aeb2fcb8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"
Sep 09 06:07:14.669108 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.669085    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx4t2\" (UniqueName: \"kubernetes.io/projected/fb759c51-b618-47eb-9419-70846992730f-kube-api-access-sx4t2\") pod \"payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx\" (UID: \"fb759c51-b618-47eb-9419-70846992730f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"
Sep 09 06:07:14.669108 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.669107    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62169d01-3a8a-45f4-99bd-dba0aeb2fcb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp\" (UID: \"62169d01-3a8a-45f4-99bd-dba0aeb2fcb8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"
Sep 09 06:07:14.669349 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.669153    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb759c51-b618-47eb-9419-70846992730f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx\" (UID: \"fb759c51-b618-47eb-9419-70846992730f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"
Sep 09 06:07:14.669880 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.669861    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb759c51-b618-47eb-9419-70846992730f-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx\" (UID: \"fb759c51-b618-47eb-9419-70846992730f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"
Sep 09 06:07:14.669880 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.669873    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62169d01-3a8a-45f4-99bd-dba0aeb2fcb8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp\" (UID: \"62169d01-3a8a-45f4-99bd-dba0aeb2fcb8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"
Sep 09 06:07:14.677060 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.677037    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cffwb\" (UniqueName: \"kubernetes.io/projected/62169d01-3a8a-45f4-99bd-dba0aeb2fcb8-kube-api-access-cffwb\") pod \"payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp\" (UID: \"62169d01-3a8a-45f4-99bd-dba0aeb2fcb8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"
Sep 09 06:07:14.677160 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.677116    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx4t2\" (UniqueName: \"kubernetes.io/projected/fb759c51-b618-47eb-9419-70846992730f-kube-api-access-sx4t2\") pod \"payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx\" (UID: \"fb759c51-b618-47eb-9419-70846992730f\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"
Sep 09 06:07:14.798456 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.798416    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"
Sep 09 06:07:14.829828 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.829797    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"
Sep 09 06:07:14.944603 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:14.944484    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:15.082159 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:15.082130    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"]
Sep 09 06:07:15.084054 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:07:15.084025    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62169d01_3a8a_45f4_99bd_dba0aeb2fcb8.slice/crio-1ca1d463fc2d0500324d8defd7a71a5f2375f518235e02b76188f3ea4a75aa99 WatchSource:0}: Error finding container 1ca1d463fc2d0500324d8defd7a71a5f2375f518235e02b76188f3ea4a75aa99: Status 404 returned error can't find the container with id 1ca1d463fc2d0500324d8defd7a71a5f2375f518235e02b76188f3ea4a75aa99
Sep 09 06:07:15.120029 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:15.120002    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"]
Sep 09 06:07:15.122428 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:07:15.122401    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb759c51_b618_47eb_9419_70846992730f.slice/crio-0cfd907b2f006750c9e7b3bf6e3cf08a62dc9b844acecd449f01472989bd80f7 WatchSource:0}: Error finding container 0cfd907b2f006750c9e7b3bf6e3cf08a62dc9b844acecd449f01472989bd80f7: Status 404 returned error can't find the container with id 0cfd907b2f006750c9e7b3bf6e3cf08a62dc9b844acecd449f01472989bd80f7
Sep 09 06:07:15.635858 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:15.635825    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:15.875644 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:15.875607    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx" event={"ID":"fb759c51-b618-47eb-9419-70846992730f","Type":"ContainerStarted","Data":"0aba81c1997bc9cc0f5d69f7fbc4fc7a70f93cff1272899bb9b65f2f6c565f73"}
Sep 09 06:07:15.875839 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:15.875670    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx" event={"ID":"fb759c51-b618-47eb-9419-70846992730f","Type":"ContainerStarted","Data":"0cfd907b2f006750c9e7b3bf6e3cf08a62dc9b844acecd449f01472989bd80f7"}
Sep 09 06:07:15.875839 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:15.875699    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"
Sep 09 06:07:15.877312 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:15.877282    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp" event={"ID":"62169d01-3a8a-45f4-99bd-dba0aeb2fcb8","Type":"ContainerStarted","Data":"77dec38363349b1bc289ea361f6d03086336497c7209ce3589ff2c952a364a24"}
Sep 09 06:07:15.877438 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:15.877326    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp" event={"ID":"62169d01-3a8a-45f4-99bd-dba0aeb2fcb8","Type":"ContainerStarted","Data":"1ca1d463fc2d0500324d8defd7a71a5f2375f518235e02b76188f3ea4a75aa99"}
Sep 09 06:07:15.877438 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:15.877367    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"
Sep 09 06:07:15.891905 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:15.891823    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx" podStartSLOduration=1.891809736 podStartE2EDuration="1.891809736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:07:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:07:15.891114299 +0000 UTC m=+1057.121610855" watchObservedRunningTime="2026-09-09 06:07:15.891809736 +0000 UTC m=+1057.122306281"
Sep 09 06:07:15.907527 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:15.907483    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp" podStartSLOduration=1.907469702 podStartE2EDuration="1.907469702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:07:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:07:15.906819298 +0000 UTC m=+1057.137315850" watchObservedRunningTime="2026-09-09 06:07:15.907469702 +0000 UTC m=+1057.137966253"
Sep 09 06:07:16.262812 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:16.262729    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:26.886116 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:26.886076    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"
Sep 09 06:07:26.886962 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:26.886937    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"
Sep 09 06:07:33.975244 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:33.975210    2583 generic.go:356] "Generic (PLEG): container finished" podID="b97e8ea2-b0f8-4c84-9849-d53609a22677" containerID="ac1c92fefd57bbb95bf9121c70edd19d3daeba1ae24b5438b7e63fcdd1de821d" exitCode=0
Sep 09 06:07:33.975698 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:33.975290    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql" event={"ID":"b97e8ea2-b0f8-4c84-9849-d53609a22677","Type":"ContainerDied","Data":"ac1c92fefd57bbb95bf9121c70edd19d3daeba1ae24b5438b7e63fcdd1de821d"}
Sep 09 06:07:33.975698 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:33.975695    2583 scope.go:117] "RemoveContainer" containerID="ac1c92fefd57bbb95bf9121c70edd19d3daeba1ae24b5438b7e63fcdd1de821d"
Sep 09 06:07:33.976692 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:33.976668    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:07:33.976758 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:33.976731    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:07:33.976813 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:33.976762    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:07:34.773164 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:34.773101    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:34.993004 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:34.992958    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql" event={"ID":"b97e8ea2-b0f8-4c84-9849-d53609a22677","Type":"ContainerStarted","Data":"b056e16d8d617769fc48d4bdd93eecc2d2c385cac9479fb92420f81d77f77420"}
Sep 09 06:07:35.556254 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:35.556219    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:35.556485 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:35.556446    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 09 06:07:35.556540 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:35.556499    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql" podUID="b97e8ea2-b0f8-4c84-9849-d53609a22677" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 09 06:07:36.556115 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:36.556085    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 09 06:07:36.556465 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:36.556137    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql" podUID="b97e8ea2-b0f8-4c84-9849-d53609a22677" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 09 06:07:37.555879 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:37.555843    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 09 06:07:37.556060 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:37.555899    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql" podUID="b97e8ea2-b0f8-4c84-9849-d53609a22677" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 09 06:07:37.734937 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:37.734893    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:38.066685 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:38.066651    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:38.369493 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:38.369455    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:38.556617 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:38.556534    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 09 06:07:38.556830 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:38.556643    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql" podUID="b97e8ea2-b0f8-4c84-9849-d53609a22677" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 09 06:07:38.620924 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:38.620842    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:39.556127 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:39.556090    2583 patch_prober.go:28] interesting pod/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 09 06:07:39.556520 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:39.556144    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql" podUID="b97e8ea2-b0f8-4c84-9849-d53609a22677" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 09 06:07:40.559966 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:40.559926    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:40.560362 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:40.560187    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:40.560816 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:40.560800    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:07:41.545899 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:41.545857    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:41.645485 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:41.645451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:42.685126 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:42.685093    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:42.786972 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:42.786931    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:42.949599 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:42.949497    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:43.151794 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.151761    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:43.252107 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.251999    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:43.277007 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.276976    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"]
Sep 09 06:07:43.280710 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.280693    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"
Sep 09 06:07:43.283365 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.283337    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-750c68\""
Sep 09 06:07:43.283545 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.283523    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-750c68-dockercfg-klknn\""
Sep 09 06:07:43.290975 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.290953    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"]
Sep 09 06:07:43.382020 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.381528    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9aea6dc-f22e-4a0a-afe0-702cad86d203-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx\" (UID: \"c9aea6dc-f22e-4a0a-afe0-702cad86d203\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"
Sep 09 06:07:43.382020 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.381622    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2v44\" (UniqueName: \"kubernetes.io/projected/c9aea6dc-f22e-4a0a-afe0-702cad86d203-kube-api-access-x2v44\") pod \"payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx\" (UID: \"c9aea6dc-f22e-4a0a-afe0-702cad86d203\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"
Sep 09 06:07:43.482485 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.482450    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2v44\" (UniqueName: \"kubernetes.io/projected/c9aea6dc-f22e-4a0a-afe0-702cad86d203-kube-api-access-x2v44\") pod \"payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx\" (UID: \"c9aea6dc-f22e-4a0a-afe0-702cad86d203\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"
Sep 09 06:07:43.482677 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.482620    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9aea6dc-f22e-4a0a-afe0-702cad86d203-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx\" (UID: \"c9aea6dc-f22e-4a0a-afe0-702cad86d203\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"
Sep 09 06:07:43.483271 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.483252    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9aea6dc-f22e-4a0a-afe0-702cad86d203-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx\" (UID: \"c9aea6dc-f22e-4a0a-afe0-702cad86d203\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"
Sep 09 06:07:43.493229 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.493197    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2v44\" (UniqueName: \"kubernetes.io/projected/c9aea6dc-f22e-4a0a-afe0-702cad86d203-kube-api-access-x2v44\") pod \"payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx\" (UID: \"c9aea6dc-f22e-4a0a-afe0-702cad86d203\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"
Sep 09 06:07:43.592948 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.592855    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"
Sep 09 06:07:43.869233 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:43.869113    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"]
Sep 09 06:07:43.871663 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:07:43.871619    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9aea6dc_f22e_4a0a_afe0_702cad86d203.slice/crio-0edd5719cae4b9556bbb77f5ef538596e4d2e13eb629e0e276800b5f0d06a407 WatchSource:0}: Error finding container 0edd5719cae4b9556bbb77f5ef538596e4d2e13eb629e0e276800b5f0d06a407: Status 404 returned error can't find the container with id 0edd5719cae4b9556bbb77f5ef538596e4d2e13eb629e0e276800b5f0d06a407
Sep 09 06:07:44.044173 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:44.044139    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx" event={"ID":"c9aea6dc-f22e-4a0a-afe0-702cad86d203","Type":"ContainerStarted","Data":"622ac2ce51711b90c026b4d251de00e0cbb44c44d3585c32a7d73662dbcb9ecb"}
Sep 09 06:07:44.044368 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:44.044191    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx" event={"ID":"c9aea6dc-f22e-4a0a-afe0-702cad86d203","Type":"ContainerStarted","Data":"0edd5719cae4b9556bbb77f5ef538596e4d2e13eb629e0e276800b5f0d06a407"}
Sep 09 06:07:44.044368 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:44.044245    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"
Sep 09 06:07:44.061954 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:44.061907    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx" podStartSLOduration=1.061893022 podStartE2EDuration="1.061893022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:07:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:07:44.057785828 +0000 UTC m=+1085.288282379" watchObservedRunningTime="2026-09-09 06:07:44.061893022 +0000 UTC m=+1085.292389600"
Sep 09 06:07:45.096493 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:45.096458    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:45.797841 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:45.797811    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:47.198400 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:47.198368    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:47.326837 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:47.326804    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:53.128638 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:53.128599    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:07:55.052179 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:07:55.052148    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"
Sep 09 06:08:01.073850 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:01.073813    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:01.337625 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:01.337505    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:04.437205 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:04.437158    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:06.510612 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:06.510540    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:11.329860 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:11.329816    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:11.881101 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:11.881067    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:11.923140 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:11.923103    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"]
Sep 09 06:08:11.923440 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:11.923406    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5" podUID="23d25539-04dd-4363-ac3c-bd882f1ee7f3" containerName="payload-pre-processing" containerID="cri-o://5238ee74233c57b0db87de2de6dd3a4c1835f09c449b6ceb4c5d470b2ef5f021" gracePeriod=30
Sep 09 06:08:11.960047 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:11.960010    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:12.022269 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.022229    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:12.085331 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.085296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:12.141945 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.141866    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:12.195798 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.195527    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"
Sep 09 06:08:12.201987 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.201956    2583 generic.go:356] "Generic (PLEG): container finished" podID="23d25539-04dd-4363-ac3c-bd882f1ee7f3" containerID="5238ee74233c57b0db87de2de6dd3a4c1835f09c449b6ceb4c5d470b2ef5f021" exitCode=0
Sep 09 06:08:12.202180 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.202004    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"
Sep 09 06:08:12.202180 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.202006    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5" event={"ID":"23d25539-04dd-4363-ac3c-bd882f1ee7f3","Type":"ContainerDied","Data":"5238ee74233c57b0db87de2de6dd3a4c1835f09c449b6ceb4c5d470b2ef5f021"}
Sep 09 06:08:12.202180 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.202138    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5" event={"ID":"23d25539-04dd-4363-ac3c-bd882f1ee7f3","Type":"ContainerDied","Data":"aea8f7b79b0eb3fb23963b08e25b3f1542cb5b30cc59e381296960ad616294d4"}
Sep 09 06:08:12.202180 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.202173    2583 scope.go:117] "RemoveContainer" containerID="5238ee74233c57b0db87de2de6dd3a4c1835f09c449b6ceb4c5d470b2ef5f021"
Sep 09 06:08:12.212784 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.212760    2583 scope.go:117] "RemoveContainer" containerID="5238ee74233c57b0db87de2de6dd3a4c1835f09c449b6ceb4c5d470b2ef5f021"
Sep 09 06:08:12.215775 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:08:12.213257    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5238ee74233c57b0db87de2de6dd3a4c1835f09c449b6ceb4c5d470b2ef5f021\": container with ID starting with 5238ee74233c57b0db87de2de6dd3a4c1835f09c449b6ceb4c5d470b2ef5f021 not found: ID does not exist" containerID="5238ee74233c57b0db87de2de6dd3a4c1835f09c449b6ceb4c5d470b2ef5f021"
Sep 09 06:08:12.215775 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.213316    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5238ee74233c57b0db87de2de6dd3a4c1835f09c449b6ceb4c5d470b2ef5f021"} err="failed to get container status \"5238ee74233c57b0db87de2de6dd3a4c1835f09c449b6ceb4c5d470b2ef5f021\": rpc error: code = NotFound desc = could not find container \"5238ee74233c57b0db87de2de6dd3a4c1835f09c449b6ceb4c5d470b2ef5f021\": container with ID starting with 5238ee74233c57b0db87de2de6dd3a4c1835f09c449b6ceb4c5d470b2ef5f021 not found: ID does not exist"
Sep 09 06:08:12.286293 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.286264    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23d25539-04dd-4363-ac3c-bd882f1ee7f3-plugins-config-volume\") pod \"23d25539-04dd-4363-ac3c-bd882f1ee7f3\" (UID: \"23d25539-04dd-4363-ac3c-bd882f1ee7f3\") "
Sep 09 06:08:12.286483 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.286396    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grt9n\" (UniqueName: \"kubernetes.io/projected/23d25539-04dd-4363-ac3c-bd882f1ee7f3-kube-api-access-grt9n\") pod \"23d25539-04dd-4363-ac3c-bd882f1ee7f3\" (UID: \"23d25539-04dd-4363-ac3c-bd882f1ee7f3\") "
Sep 09 06:08:12.286739 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.286710    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23d25539-04dd-4363-ac3c-bd882f1ee7f3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "23d25539-04dd-4363-ac3c-bd882f1ee7f3" (UID: "23d25539-04dd-4363-ac3c-bd882f1ee7f3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:08:12.286848 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.286833    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23d25539-04dd-4363-ac3c-bd882f1ee7f3-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:12.288658 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.288636    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23d25539-04dd-4363-ac3c-bd882f1ee7f3-kube-api-access-grt9n" (OuterVolumeSpecName: "kube-api-access-grt9n") pod "23d25539-04dd-4363-ac3c-bd882f1ee7f3" (UID: "23d25539-04dd-4363-ac3c-bd882f1ee7f3"). InnerVolumeSpecName "kube-api-access-grt9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:08:12.388335 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.388294    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grt9n\" (UniqueName: \"kubernetes.io/projected/23d25539-04dd-4363-ac3c-bd882f1ee7f3-kube-api-access-grt9n\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:12.443675 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.443574    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:12.525487 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.525454    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"]
Sep 09 06:08:12.527795 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:12.527777    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ecd13e-54c8f9c9bb-nxtc5"]
Sep 09 06:08:13.245002 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:13.244968    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23d25539-04dd-4363-ac3c-bd882f1ee7f3" path="/var/lib/kubelet/pods/23d25539-04dd-4363-ac3c-bd882f1ee7f3/volumes"
Sep 09 06:08:18.164638 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:18.164607    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:18.232800 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:18.232747    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:18.296571 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:18.296525    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:18.412906 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:18.412871    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"]
Sep 09 06:08:18.413106 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:18.413083    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerName="istio-proxy" containerID="cri-o://2b637ae367bba4bfe166f4dacfa8faeef49d6afc6f32b0f29319dc51706f0d87" gracePeriod=30
Sep 09 06:08:18.432616 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:18.432524    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:18.940280 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:18.940247    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:20.700810 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:20.700768    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:21.022888 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:21.022800    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:21.727668 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:21.727638    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:23.668275 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.668250    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:08:23.805288 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805195    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-envoy\") pod \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") "
Sep 09 06:08:23.805288 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805247    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-workload-socket\") pod \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") "
Sep 09 06:08:23.805534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805297    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-workload-certs\") pod \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") "
Sep 09 06:08:23.805534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805317    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-token\") pod \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") "
Sep 09 06:08:23.805534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805350    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-data\") pod \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") "
Sep 09 06:08:23.805534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805384    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istiod-ca-cert\") pod \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") "
Sep 09 06:08:23.805534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805407    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-credential-socket\") pod \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") "
Sep 09 06:08:23.805534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805426    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-podinfo\") pod \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") "
Sep 09 06:08:23.805534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805464    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vb4d9\" (UniqueName: \"kubernetes.io/projected/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-kube-api-access-vb4d9\") pod \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\" (UID: \"fbbb7cb0-e64b-4be1-9032-b747865ed6ab\") "
Sep 09 06:08:23.805928 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805619    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fbbb7cb0-e64b-4be1-9032-b747865ed6ab" (UID: "fbbb7cb0-e64b-4be1-9032-b747865ed6ab"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:08:23.805928 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805630    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fbbb7cb0-e64b-4be1-9032-b747865ed6ab" (UID: "fbbb7cb0-e64b-4be1-9032-b747865ed6ab"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:08:23.805928 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805766    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fbbb7cb0-e64b-4be1-9032-b747865ed6ab" (UID: "fbbb7cb0-e64b-4be1-9032-b747865ed6ab"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:08:23.806252 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805944    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fbbb7cb0-e64b-4be1-9032-b747865ed6ab" (UID: "fbbb7cb0-e64b-4be1-9032-b747865ed6ab"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:08:23.806252 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805973    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-workload-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:23.806252 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.805995    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-workload-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:23.806252 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.806009    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-credential-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:23.806252 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.806098    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-data" (OuterVolumeSpecName: "istio-data") pod "fbbb7cb0-e64b-4be1-9032-b747865ed6ab" (UID: "fbbb7cb0-e64b-4be1-9032-b747865ed6ab"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:08:23.807731 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.807707    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fbbb7cb0-e64b-4be1-9032-b747865ed6ab" (UID: "fbbb7cb0-e64b-4be1-9032-b747865ed6ab"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:08:23.807857 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.807748    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-token" (OuterVolumeSpecName: "istio-token") pod "fbbb7cb0-e64b-4be1-9032-b747865ed6ab" (UID: "fbbb7cb0-e64b-4be1-9032-b747865ed6ab"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:08:23.808263 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.808242    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fbbb7cb0-e64b-4be1-9032-b747865ed6ab" (UID: "fbbb7cb0-e64b-4be1-9032-b747865ed6ab"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 06:08:23.808324 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.808259    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-kube-api-access-vb4d9" (OuterVolumeSpecName: "kube-api-access-vb4d9") pod "fbbb7cb0-e64b-4be1-9032-b747865ed6ab" (UID: "fbbb7cb0-e64b-4be1-9032-b747865ed6ab"). InnerVolumeSpecName "kube-api-access-vb4d9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:08:23.907204 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.907176    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-envoy\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:23.907204 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.907203    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-token\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:23.907204 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.907211    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:23.907434 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.907229    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istiod-ca-cert\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:23.907434 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.907236    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-istio-podinfo\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:23.907434 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.907244    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vb4d9\" (UniqueName: \"kubernetes.io/projected/fbbb7cb0-e64b-4be1-9032-b747865ed6ab-kube-api-access-vb4d9\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:23.967022 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:23.966985    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:24.122503 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:24.122455    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:24.269964 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:24.269930    2583 generic.go:356] "Generic (PLEG): container finished" podID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerID="2b637ae367bba4bfe166f4dacfa8faeef49d6afc6f32b0f29319dc51706f0d87" exitCode=0
Sep 09 06:08:24.270131 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:24.270001    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" event={"ID":"fbbb7cb0-e64b-4be1-9032-b747865ed6ab","Type":"ContainerDied","Data":"2b637ae367bba4bfe166f4dacfa8faeef49d6afc6f32b0f29319dc51706f0d87"}
Sep 09 06:08:24.270131 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:24.270032    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"
Sep 09 06:08:24.270131 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:24.270043    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n" event={"ID":"fbbb7cb0-e64b-4be1-9032-b747865ed6ab","Type":"ContainerDied","Data":"17ad64a19a46c7f1b92232f21e1a03e41d4863f2aa269f7e685e0cbcf2252fb2"}
Sep 09 06:08:24.270131 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:24.270065    2583 scope.go:117] "RemoveContainer" containerID="2b637ae367bba4bfe166f4dacfa8faeef49d6afc6f32b0f29319dc51706f0d87"
Sep 09 06:08:24.279822 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:24.279803    2583 scope.go:117] "RemoveContainer" containerID="40f2bc06b1c4fde6b961e211b8f1d5496c1c3a2ed41361de32363d36754459ba"
Sep 09 06:08:24.288255 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:24.288237    2583 scope.go:117] "RemoveContainer" containerID="2b637ae367bba4bfe166f4dacfa8faeef49d6afc6f32b0f29319dc51706f0d87"
Sep 09 06:08:24.288516 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:08:24.288499    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b637ae367bba4bfe166f4dacfa8faeef49d6afc6f32b0f29319dc51706f0d87\": container with ID starting with 2b637ae367bba4bfe166f4dacfa8faeef49d6afc6f32b0f29319dc51706f0d87 not found: ID does not exist" containerID="2b637ae367bba4bfe166f4dacfa8faeef49d6afc6f32b0f29319dc51706f0d87"
Sep 09 06:08:24.288608 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:24.288527    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b637ae367bba4bfe166f4dacfa8faeef49d6afc6f32b0f29319dc51706f0d87"} err="failed to get container status \"2b637ae367bba4bfe166f4dacfa8faeef49d6afc6f32b0f29319dc51706f0d87\": rpc error: code = NotFound desc = could not find container \"2b637ae367bba4bfe166f4dacfa8faeef49d6afc6f32b0f29319dc51706f0d87\": container with ID starting with 2b637ae367bba4bfe166f4dacfa8faeef49d6afc6f32b0f29319dc51706f0d87 not found: ID does not exist"
Sep 09 06:08:24.288608 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:24.288550    2583 scope.go:117] "RemoveContainer" containerID="40f2bc06b1c4fde6b961e211b8f1d5496c1c3a2ed41361de32363d36754459ba"
Sep 09 06:08:24.288835 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:08:24.288816    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40f2bc06b1c4fde6b961e211b8f1d5496c1c3a2ed41361de32363d36754459ba\": container with ID starting with 40f2bc06b1c4fde6b961e211b8f1d5496c1c3a2ed41361de32363d36754459ba not found: ID does not exist" containerID="40f2bc06b1c4fde6b961e211b8f1d5496c1c3a2ed41361de32363d36754459ba"
Sep 09 06:08:24.288876 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:24.288841    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40f2bc06b1c4fde6b961e211b8f1d5496c1c3a2ed41361de32363d36754459ba"} err="failed to get container status \"40f2bc06b1c4fde6b961e211b8f1d5496c1c3a2ed41361de32363d36754459ba\": rpc error: code = NotFound desc = could not find container \"40f2bc06b1c4fde6b961e211b8f1d5496c1c3a2ed41361de32363d36754459ba\": container with ID starting with 40f2bc06b1c4fde6b961e211b8f1d5496c1c3a2ed41361de32363d36754459ba not found: ID does not exist"
Sep 09 06:08:24.297846 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:24.297822    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"]
Sep 09 06:08:24.302046 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:24.302027    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ecd13e-openshift-default-77dbb58cb8-lr78n"]
Sep 09 06:08:25.053716 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.053684    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"]
Sep 09 06:08:25.054318 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.054296    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerName="istio-proxy"
Sep 09 06:08:25.054411 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.054320    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerName="istio-proxy"
Sep 09 06:08:25.054411 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.054340    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23d25539-04dd-4363-ac3c-bd882f1ee7f3" containerName="payload-pre-processing"
Sep 09 06:08:25.054411 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.054350    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="23d25539-04dd-4363-ac3c-bd882f1ee7f3" containerName="payload-pre-processing"
Sep 09 06:08:25.054411 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.054380    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerName="istio-proxy"
Sep 09 06:08:25.054411 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.054389    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerName="istio-proxy"
Sep 09 06:08:25.054701 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.054494    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerName="istio-proxy"
Sep 09 06:08:25.054701 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.054506    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="23d25539-04dd-4363-ac3c-bd882f1ee7f3" containerName="payload-pre-processing"
Sep 09 06:08:25.057794 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.057773    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:25.060034 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.060009    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-389cd1da-serving-cert\""
Sep 09 06:08:25.069898 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.069877    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"]
Sep 09 06:08:25.087502 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.087478    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:25.116682 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.116647    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p7bs\" (UniqueName: \"kubernetes.io/projected/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-kube-api-access-4p7bs\") pod \"maas-api-e2e-mt-389cd1da-7c55867597-q2hqr\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:25.116824 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.116788    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-metrics-certs\") pod \"maas-api-e2e-mt-389cd1da-7c55867597-q2hqr\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:25.116892 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.116833    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-openshift-service-ca\") pod \"maas-api-e2e-mt-389cd1da-7c55867597-q2hqr\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:25.116892 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.116881    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-maas-api-tls\") pod \"maas-api-e2e-mt-389cd1da-7c55867597-q2hqr\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:25.151433 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.151407    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:25.217891 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.217855    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-metrics-certs\") pod \"maas-api-e2e-mt-389cd1da-7c55867597-q2hqr\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:25.218096 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.218046    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-openshift-service-ca\") pod \"maas-api-e2e-mt-389cd1da-7c55867597-q2hqr\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:25.218096 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.218091    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-maas-api-tls\") pod \"maas-api-e2e-mt-389cd1da-7c55867597-q2hqr\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:25.218248 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.218227    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p7bs\" (UniqueName: \"kubernetes.io/projected/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-kube-api-access-4p7bs\") pod \"maas-api-e2e-mt-389cd1da-7c55867597-q2hqr\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:25.218758 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.218694    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-openshift-service-ca\") pod \"maas-api-e2e-mt-389cd1da-7c55867597-q2hqr\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:25.220609 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.220589    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-metrics-certs\") pod \"maas-api-e2e-mt-389cd1da-7c55867597-q2hqr\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:25.220763 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.220741    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-maas-api-tls\") pod \"maas-api-e2e-mt-389cd1da-7c55867597-q2hqr\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:25.226504 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.226444    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p7bs\" (UniqueName: \"kubernetes.io/projected/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-kube-api-access-4p7bs\") pod \"maas-api-e2e-mt-389cd1da-7c55867597-q2hqr\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:25.244996 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.244968    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" path="/var/lib/kubelet/pods/fbbb7cb0-e64b-4be1-9032-b747865ed6ab/volumes"
Sep 09 06:08:25.372538 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.372509    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:25.647704 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.647675    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"]
Sep 09 06:08:25.650179 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:08:25.650148    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8c8aff_f81a_43fb_8b38_258aa8f889ab.slice/crio-75c0ba2bc65325f24c1da6d8af947c17f7f4ab5b507c1b646342578744623f83 WatchSource:0}: Error finding container 75c0ba2bc65325f24c1da6d8af947c17f7f4ab5b507c1b646342578744623f83: Status 404 returned error can't find the container with id 75c0ba2bc65325f24c1da6d8af947c17f7f4ab5b507c1b646342578744623f83
Sep 09 06:08:25.651521 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.651500    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 06:08:25.748122 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.748094    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"]
Sep 09 06:08:25.748642 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.748628    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbbb7cb0-e64b-4be1-9032-b747865ed6ab" containerName="istio-proxy"
Sep 09 06:08:25.751265 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.751251    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"
Sep 09 06:08:25.753643 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.753625    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-389cd1da\""
Sep 09 06:08:25.753754 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.753627    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-389cd1da-dockercfg-ntgbw\""
Sep 09 06:08:25.758836 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.758814    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"]
Sep 09 06:08:25.790298 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.790253    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:25.826378 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.826341    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqkks\" (UniqueName: \"kubernetes.io/projected/f53425fd-4ea6-48b2-aaa9-992663170400-kube-api-access-hqkks\") pod \"payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr\" (UID: \"f53425fd-4ea6-48b2-aaa9-992663170400\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"
Sep 09 06:08:25.826549 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.826474    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f53425fd-4ea6-48b2-aaa9-992663170400-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr\" (UID: \"f53425fd-4ea6-48b2-aaa9-992663170400\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"
Sep 09 06:08:25.890280 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.890250    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:25.927093 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.927010    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqkks\" (UniqueName: \"kubernetes.io/projected/f53425fd-4ea6-48b2-aaa9-992663170400-kube-api-access-hqkks\") pod \"payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr\" (UID: \"f53425fd-4ea6-48b2-aaa9-992663170400\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"
Sep 09 06:08:25.927246 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.927120    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f53425fd-4ea6-48b2-aaa9-992663170400-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr\" (UID: \"f53425fd-4ea6-48b2-aaa9-992663170400\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"
Sep 09 06:08:25.927812 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.927792    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f53425fd-4ea6-48b2-aaa9-992663170400-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr\" (UID: \"f53425fd-4ea6-48b2-aaa9-992663170400\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"
Sep 09 06:08:25.935158 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:25.935133    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqkks\" (UniqueName: \"kubernetes.io/projected/f53425fd-4ea6-48b2-aaa9-992663170400-kube-api-access-hqkks\") pod \"payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr\" (UID: \"f53425fd-4ea6-48b2-aaa9-992663170400\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"
Sep 09 06:08:26.064524 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:26.064472    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"
Sep 09 06:08:26.287208 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:26.287160    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr" event={"ID":"0e8c8aff-f81a-43fb-8b38-258aa8f889ab","Type":"ContainerStarted","Data":"b664996bd64734b1bdc3ba572e69571e58d2f75fdaa9fb89b704e76e7e557eb1"}
Sep 09 06:08:26.287481 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:26.287231    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr" event={"ID":"0e8c8aff-f81a-43fb-8b38-258aa8f889ab","Type":"ContainerStarted","Data":"75c0ba2bc65325f24c1da6d8af947c17f7f4ab5b507c1b646342578744623f83"}
Sep 09 06:08:26.287582 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:26.287472    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:26.306848 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:26.306802    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr" podStartSLOduration=0.764486002 podStartE2EDuration="1.306787579s" totalImagesPullingTime="542.301577ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:08:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:08:26.305159368 +0000 UTC m=+1127.535655921" watchObservedRunningTime="2026-09-09 06:08:26.306787579 +0000 UTC m=+1127.537284131"
Sep 09 06:08:26.350122 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:26.350097    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"]
Sep 09 06:08:26.351674 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:08:26.351643    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf53425fd_4ea6_48b2_aaa9_992663170400.slice/crio-22bfb3ad69f9fa0fb32ca3b790136d7b577225caa99bd43133de3d964cf1837a WatchSource:0}: Error finding container 22bfb3ad69f9fa0fb32ca3b790136d7b577225caa99bd43133de3d964cf1837a: Status 404 returned error can't find the container with id 22bfb3ad69f9fa0fb32ca3b790136d7b577225caa99bd43133de3d964cf1837a
Sep 09 06:08:27.294330 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:27.294288    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr" event={"ID":"f53425fd-4ea6-48b2-aaa9-992663170400","Type":"ContainerStarted","Data":"e0b5bfc7fd4c122796ea8707022db27199443183e262ccf4325118708f2c7fb8"}
Sep 09 06:08:27.294777 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:27.294354    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr" event={"ID":"f53425fd-4ea6-48b2-aaa9-992663170400","Type":"ContainerStarted","Data":"22bfb3ad69f9fa0fb32ca3b790136d7b577225caa99bd43133de3d964cf1837a"}
Sep 09 06:08:27.294777 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:27.294569    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"
Sep 09 06:08:27.311459 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:27.311407    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr" podStartSLOduration=2.311390666 podStartE2EDuration="2.311390666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:08:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:08:27.310121392 +0000 UTC m=+1128.540617942" watchObservedRunningTime="2026-09-09 06:08:27.311390666 +0000 UTC m=+1128.541887218"
Sep 09 06:08:29.034088 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:29.034049    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:29.597417 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:29.597375    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:30.140751 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:30.140717    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:30.191723 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:30.191682    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:32.300275 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:32.300246    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:08:35.883197 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:35.883162    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:35.947863 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:35.947830    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:36.120945 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:36.120911    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"]
Sep 09 06:08:36.121153 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:36.121129    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj" podUID="b8662601-8cfb-4491-aae3-f52f4eededad" containerName="istio-proxy" containerID="cri-o://2c1dc7f849bbf4ac2304469ff1f6946c74b6926cead36efa3710e3c064ab9b5c" gracePeriod=30
Sep 09 06:08:36.143145 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:36.143063    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:36.715227 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:36.715192    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:37.000867 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:37.000788    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:37.387823 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:37.387784    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:38.302730 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:38.302701    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"
Sep 09 06:08:41.378986 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.378961    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:08:41.380404 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.380381    2583 generic.go:356] "Generic (PLEG): container finished" podID="b8662601-8cfb-4491-aae3-f52f4eededad" containerID="2c1dc7f849bbf4ac2304469ff1f6946c74b6926cead36efa3710e3c064ab9b5c" exitCode=0
Sep 09 06:08:41.380524 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.380451    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj" event={"ID":"b8662601-8cfb-4491-aae3-f52f4eededad","Type":"ContainerDied","Data":"2c1dc7f849bbf4ac2304469ff1f6946c74b6926cead36efa3710e3c064ab9b5c"}
Sep 09 06:08:41.380524 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.380503    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj" event={"ID":"b8662601-8cfb-4491-aae3-f52f4eededad","Type":"ContainerDied","Data":"047ebbc975c057f16d1f7a97afa806993f684039c67d4de6a978db5bc9daa5f5"}
Sep 09 06:08:41.380663 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.380529    2583 scope.go:117] "RemoveContainer" containerID="2c1dc7f849bbf4ac2304469ff1f6946c74b6926cead36efa3710e3c064ab9b5c"
Sep 09 06:08:41.381337 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.381322    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-workload-certs\") pod \"b8662601-8cfb-4491-aae3-f52f4eededad\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") "
Sep 09 06:08:41.381441 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.381365    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-istio-envoy\") pod \"b8662601-8cfb-4491-aae3-f52f4eededad\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") "
Sep 09 06:08:41.381441 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.381391    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8662601-8cfb-4491-aae3-f52f4eededad-istiod-ca-cert\") pod \"b8662601-8cfb-4491-aae3-f52f4eededad\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") "
Sep 09 06:08:41.381441 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.381415    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-istio-data\") pod \"b8662601-8cfb-4491-aae3-f52f4eededad\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") "
Sep 09 06:08:41.381646 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.381442    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-workload-socket\") pod \"b8662601-8cfb-4491-aae3-f52f4eededad\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") "
Sep 09 06:08:41.381646 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.381469    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8662601-8cfb-4491-aae3-f52f4eededad-istio-podinfo\") pod \"b8662601-8cfb-4491-aae3-f52f4eededad\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") "
Sep 09 06:08:41.381646 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.381590    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8662601-8cfb-4491-aae3-f52f4eededad-istio-token\") pod \"b8662601-8cfb-4491-aae3-f52f4eededad\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") "
Sep 09 06:08:41.381646 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.381613    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8662601-8cfb-4491-aae3-f52f4eededad" (UID: "b8662601-8cfb-4491-aae3-f52f4eededad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:08:41.381949 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.381646    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-credential-socket\") pod \"b8662601-8cfb-4491-aae3-f52f4eededad\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") "
Sep 09 06:08:41.381949 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.381699    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqghz\" (UniqueName: \"kubernetes.io/projected/b8662601-8cfb-4491-aae3-f52f4eededad-kube-api-access-kqghz\") pod \"b8662601-8cfb-4491-aae3-f52f4eededad\" (UID: \"b8662601-8cfb-4491-aae3-f52f4eededad\") "
Sep 09 06:08:41.381949 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.381789    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8662601-8cfb-4491-aae3-f52f4eededad" (UID: "b8662601-8cfb-4491-aae3-f52f4eededad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:08:41.381949 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.381834    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8662601-8cfb-4491-aae3-f52f4eededad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8662601-8cfb-4491-aae3-f52f4eededad" (UID: "b8662601-8cfb-4491-aae3-f52f4eededad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:08:41.381949 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.381936    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8662601-8cfb-4491-aae3-f52f4eededad" (UID: "b8662601-8cfb-4491-aae3-f52f4eededad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:08:41.382210 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.382178    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8662601-8cfb-4491-aae3-f52f4eededad" (UID: "b8662601-8cfb-4491-aae3-f52f4eededad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:08:41.382210 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.382203    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-workload-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:41.382321 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.382223    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8662601-8cfb-4491-aae3-f52f4eededad-istiod-ca-cert\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:41.382321 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.382237    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-istio-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:41.382321 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.382251    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-workload-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:41.384180 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.384159    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8662601-8cfb-4491-aae3-f52f4eededad" (UID: "b8662601-8cfb-4491-aae3-f52f4eededad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:08:41.384180 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.384168    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8662601-8cfb-4491-aae3-f52f4eededad-kube-api-access-kqghz" (OuterVolumeSpecName: "kube-api-access-kqghz") pod "b8662601-8cfb-4491-aae3-f52f4eededad" (UID: "b8662601-8cfb-4491-aae3-f52f4eededad"). InnerVolumeSpecName "kube-api-access-kqghz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:08:41.384388 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.384372    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8662601-8cfb-4491-aae3-f52f4eededad-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8662601-8cfb-4491-aae3-f52f4eededad" (UID: "b8662601-8cfb-4491-aae3-f52f4eededad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:08:41.384664 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.384632    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8662601-8cfb-4491-aae3-f52f4eededad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8662601-8cfb-4491-aae3-f52f4eededad" (UID: "b8662601-8cfb-4491-aae3-f52f4eededad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 06:08:41.405738 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.405715    2583 scope.go:117] "RemoveContainer" containerID="df9994ccc2989ff09fba8ef2fa96143c6b84d97f81743e9e3eaf682423f6a871"
Sep 09 06:08:41.414123 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.414101    2583 scope.go:117] "RemoveContainer" containerID="2c1dc7f849bbf4ac2304469ff1f6946c74b6926cead36efa3710e3c064ab9b5c"
Sep 09 06:08:41.414419 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:08:41.414398    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c1dc7f849bbf4ac2304469ff1f6946c74b6926cead36efa3710e3c064ab9b5c\": container with ID starting with 2c1dc7f849bbf4ac2304469ff1f6946c74b6926cead36efa3710e3c064ab9b5c not found: ID does not exist" containerID="2c1dc7f849bbf4ac2304469ff1f6946c74b6926cead36efa3710e3c064ab9b5c"
Sep 09 06:08:41.414498 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.414427    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c1dc7f849bbf4ac2304469ff1f6946c74b6926cead36efa3710e3c064ab9b5c"} err="failed to get container status \"2c1dc7f849bbf4ac2304469ff1f6946c74b6926cead36efa3710e3c064ab9b5c\": rpc error: code = NotFound desc = could not find container \"2c1dc7f849bbf4ac2304469ff1f6946c74b6926cead36efa3710e3c064ab9b5c\": container with ID starting with 2c1dc7f849bbf4ac2304469ff1f6946c74b6926cead36efa3710e3c064ab9b5c not found: ID does not exist"
Sep 09 06:08:41.414498 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.414447    2583 scope.go:117] "RemoveContainer" containerID="df9994ccc2989ff09fba8ef2fa96143c6b84d97f81743e9e3eaf682423f6a871"
Sep 09 06:08:41.414752 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:08:41.414728    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df9994ccc2989ff09fba8ef2fa96143c6b84d97f81743e9e3eaf682423f6a871\": container with ID starting with df9994ccc2989ff09fba8ef2fa96143c6b84d97f81743e9e3eaf682423f6a871 not found: ID does not exist" containerID="df9994ccc2989ff09fba8ef2fa96143c6b84d97f81743e9e3eaf682423f6a871"
Sep 09 06:08:41.414797 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.414764    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df9994ccc2989ff09fba8ef2fa96143c6b84d97f81743e9e3eaf682423f6a871"} err="failed to get container status \"df9994ccc2989ff09fba8ef2fa96143c6b84d97f81743e9e3eaf682423f6a871\": rpc error: code = NotFound desc = could not find container \"df9994ccc2989ff09fba8ef2fa96143c6b84d97f81743e9e3eaf682423f6a871\": container with ID starting with df9994ccc2989ff09fba8ef2fa96143c6b84d97f81743e9e3eaf682423f6a871 not found: ID does not exist"
Sep 09 06:08:41.483601 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.483543    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-istio-envoy\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:41.483601 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.483592    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8662601-8cfb-4491-aae3-f52f4eededad-istio-podinfo\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:41.483601 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.483601    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8662601-8cfb-4491-aae3-f52f4eededad-istio-token\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:41.483601 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.483609    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8662601-8cfb-4491-aae3-f52f4eededad-credential-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:41.483847 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:41.483619    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqghz\" (UniqueName: \"kubernetes.io/projected/b8662601-8cfb-4491-aae3-f52f4eededad-kube-api-access-kqghz\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:08:42.387812 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:42.387784    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"
Sep 09 06:08:42.409333 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:42.409303    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"]
Sep 09 06:08:42.413502 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:42.413477    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-fe8eaa-openshift-default-5cb856d54d-2l9tj"]
Sep 09 06:08:42.993269 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:42.993232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:43.091829 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:43.091793    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:43.251994 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:43.251912    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8662601-8cfb-4491-aae3-f52f4eededad" path="/var/lib/kubelet/pods/b8662601-8cfb-4491-aae3-f52f4eededad/volumes"
Sep 09 06:08:44.145908 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.145873    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:44.241455 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.241423    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:44.468025 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.467930    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:44.635264 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.635228    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:44.730666 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.730529    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:44.747072 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.747031    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"]
Sep 09 06:08:44.747582 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.747567    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8662601-8cfb-4491-aae3-f52f4eededad" containerName="istio-proxy"
Sep 09 06:08:44.747630 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.747584    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8662601-8cfb-4491-aae3-f52f4eededad" containerName="istio-proxy"
Sep 09 06:08:44.747630 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.747593    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8662601-8cfb-4491-aae3-f52f4eededad" containerName="istio-proxy"
Sep 09 06:08:44.747630 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.747599    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8662601-8cfb-4491-aae3-f52f4eededad" containerName="istio-proxy"
Sep 09 06:08:44.747725 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.747686    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8662601-8cfb-4491-aae3-f52f4eededad" containerName="istio-proxy"
Sep 09 06:08:44.747725 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.747697    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8662601-8cfb-4491-aae3-f52f4eededad" containerName="istio-proxy"
Sep 09 06:08:44.751830 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.751815    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"
Sep 09 06:08:44.755133 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.755097    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-6b5d89-dockercfg-wqn2n\""
Sep 09 06:08:44.755262 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.755193    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-6b5d89\""
Sep 09 06:08:44.765316 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.765290    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"]
Sep 09 06:08:44.782804 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.782773    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"]
Sep 09 06:08:44.786440 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.786421    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"
Sep 09 06:08:44.797473 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.797448    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"]
Sep 09 06:08:44.814260 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.814235    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62555542-12e9-447e-a7f3-ab2bf5c1ffa0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf\" (UID: \"62555542-12e9-447e-a7f3-ab2bf5c1ffa0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"
Sep 09 06:08:44.814359 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.814275    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/799bb589-c072-4ec7-8a37-7658055fc9c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn\" (UID: \"799bb589-c072-4ec7-8a37-7658055fc9c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"
Sep 09 06:08:44.814409 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.814361    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7s8x\" (UniqueName: \"kubernetes.io/projected/62555542-12e9-447e-a7f3-ab2bf5c1ffa0-kube-api-access-p7s8x\") pod \"payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf\" (UID: \"62555542-12e9-447e-a7f3-ab2bf5c1ffa0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"
Sep 09 06:08:44.814444 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.814407    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2jdz\" (UniqueName: \"kubernetes.io/projected/799bb589-c072-4ec7-8a37-7658055fc9c8-kube-api-access-z2jdz\") pod \"payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn\" (UID: \"799bb589-c072-4ec7-8a37-7658055fc9c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"
Sep 09 06:08:44.915635 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.915597    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62555542-12e9-447e-a7f3-ab2bf5c1ffa0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf\" (UID: \"62555542-12e9-447e-a7f3-ab2bf5c1ffa0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"
Sep 09 06:08:44.915823 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.915649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/799bb589-c072-4ec7-8a37-7658055fc9c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn\" (UID: \"799bb589-c072-4ec7-8a37-7658055fc9c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"
Sep 09 06:08:44.915823 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.915722    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7s8x\" (UniqueName: \"kubernetes.io/projected/62555542-12e9-447e-a7f3-ab2bf5c1ffa0-kube-api-access-p7s8x\") pod \"payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf\" (UID: \"62555542-12e9-447e-a7f3-ab2bf5c1ffa0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"
Sep 09 06:08:44.915823 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.915767    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2jdz\" (UniqueName: \"kubernetes.io/projected/799bb589-c072-4ec7-8a37-7658055fc9c8-kube-api-access-z2jdz\") pod \"payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn\" (UID: \"799bb589-c072-4ec7-8a37-7658055fc9c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"
Sep 09 06:08:44.916346 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.916326    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/799bb589-c072-4ec7-8a37-7658055fc9c8-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn\" (UID: \"799bb589-c072-4ec7-8a37-7658055fc9c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"
Sep 09 06:08:44.916395 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.916363    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62555542-12e9-447e-a7f3-ab2bf5c1ffa0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf\" (UID: \"62555542-12e9-447e-a7f3-ab2bf5c1ffa0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"
Sep 09 06:08:44.923793 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.923767    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2jdz\" (UniqueName: \"kubernetes.io/projected/799bb589-c072-4ec7-8a37-7658055fc9c8-kube-api-access-z2jdz\") pod \"payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn\" (UID: \"799bb589-c072-4ec7-8a37-7658055fc9c8\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"
Sep 09 06:08:44.923950 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:44.923921    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7s8x\" (UniqueName: \"kubernetes.io/projected/62555542-12e9-447e-a7f3-ab2bf5c1ffa0-kube-api-access-p7s8x\") pod \"payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf\" (UID: \"62555542-12e9-447e-a7f3-ab2bf5c1ffa0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"
Sep 09 06:08:45.063233 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:45.063152    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"
Sep 09 06:08:45.097641 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:45.097602    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"
Sep 09 06:08:45.342847 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:45.342816    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"]
Sep 09 06:08:45.344256 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:08:45.344230    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod799bb589_c072_4ec7_8a37_7658055fc9c8.slice/crio-0f4db4f5fb471259d28feb187ee5f3b7040bff43b0ef607d70b75b1e6e9d449b WatchSource:0}: Error finding container 0f4db4f5fb471259d28feb187ee5f3b7040bff43b0ef607d70b75b1e6e9d449b: Status 404 returned error can't find the container with id 0f4db4f5fb471259d28feb187ee5f3b7040bff43b0ef607d70b75b1e6e9d449b
Sep 09 06:08:45.381504 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:45.381476    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"]
Sep 09 06:08:45.382981 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:08:45.382958    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62555542_12e9_447e_a7f3_ab2bf5c1ffa0.slice/crio-d12896e44b2684e642894eada193b63409533d52f534015e4f935679edf87bdf WatchSource:0}: Error finding container d12896e44b2684e642894eada193b63409533d52f534015e4f935679edf87bdf: Status 404 returned error can't find the container with id d12896e44b2684e642894eada193b63409533d52f534015e4f935679edf87bdf
Sep 09 06:08:45.407754 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:45.407721    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf" event={"ID":"62555542-12e9-447e-a7f3-ab2bf5c1ffa0","Type":"ContainerStarted","Data":"d12896e44b2684e642894eada193b63409533d52f534015e4f935679edf87bdf"}
Sep 09 06:08:45.409094 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:45.409070    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn" event={"ID":"799bb589-c072-4ec7-8a37-7658055fc9c8","Type":"ContainerStarted","Data":"0f4db4f5fb471259d28feb187ee5f3b7040bff43b0ef607d70b75b1e6e9d449b"}
Sep 09 06:08:45.687652 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:45.687607    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:45.788549 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:45.788516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:46.417143 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:46.417099    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf" event={"ID":"62555542-12e9-447e-a7f3-ab2bf5c1ffa0","Type":"ContainerStarted","Data":"d054dfef3469d2b4a9c97e410993359f07ff8af512108335a92ec23fc69c2dae"}
Sep 09 06:08:46.417618 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:46.417216    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"
Sep 09 06:08:46.418915 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:46.418889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn" event={"ID":"799bb589-c072-4ec7-8a37-7658055fc9c8","Type":"ContainerStarted","Data":"0bac06ec24c0df9da4ffb76ae359cb3b8876e90bdc7c10b78c4f0f09c3b2a7d2"}
Sep 09 06:08:46.419064 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:46.419004    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"
Sep 09 06:08:46.433972 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:46.433926    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf" podStartSLOduration=2.433913655 podStartE2EDuration="2.433913655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:08:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:08:46.432472969 +0000 UTC m=+1147.662969522" watchObservedRunningTime="2026-09-09 06:08:46.433913655 +0000 UTC m=+1147.664410262"
Sep 09 06:08:46.446118 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:46.446072    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn" podStartSLOduration=2.446054088 podStartE2EDuration="2.446054088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:08:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:08:46.445508551 +0000 UTC m=+1147.676005107" watchObservedRunningTime="2026-09-09 06:08:46.446054088 +0000 UTC m=+1147.676550642"
Sep 09 06:08:46.961616 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:46.961548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:48.834253 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:48.834221    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:08:57.427430 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:57.427394    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"
Sep 09 06:08:57.427901 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:08:57.427615    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"
Sep 09 06:09:06.023434 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:06.023332    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:06.615890 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:06.615858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:07.983787 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:07.983751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:08.330625 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.330520    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:08.604869 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.604772    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"]
Sep 09 06:09:08.608969 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.608944    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.611441 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.611415    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-7cf6be-openshift-default-dockercfg-85lmt\""
Sep 09 06:09:08.623198 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.623166    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"]
Sep 09 06:09:08.633781 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.633737    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:08.763757 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.763720    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-data\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.763757 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.763756    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-token\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.764008 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.763782    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-credential-socket\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.764008 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.763858    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzjhv\" (UniqueName: \"kubernetes.io/projected/ecd60c99-3d95-46b0-b739-2dea29198d46-kube-api-access-tzjhv\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.764008 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.763888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-workload-socket\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.764008 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.763978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-workload-certs\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.764196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.764057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-podinfo\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.764196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.764095    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecd60c99-3d95-46b0-b739-2dea29198d46-istiod-ca-cert\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.764196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.764133    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-envoy\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.865624 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.865507    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-data\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.865624 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.865582    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-token\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.865624 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.865620    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-credential-socket\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.865918 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.865677    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzjhv\" (UniqueName: \"kubernetes.io/projected/ecd60c99-3d95-46b0-b739-2dea29198d46-kube-api-access-tzjhv\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.865918 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.865726    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-workload-socket\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.865918 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.865761    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-workload-certs\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.865918 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.865814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-podinfo\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.865918 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.865838    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecd60c99-3d95-46b0-b739-2dea29198d46-istiod-ca-cert\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.865918 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.865894    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-envoy\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.866218 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.865946    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-data\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.866218 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.866010    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-credential-socket\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.866218 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.866113    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-workload-socket\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.866346 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.866253    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-workload-certs\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.866819 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.866798    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecd60c99-3d95-46b0-b739-2dea29198d46-istiod-ca-cert\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.868283 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.868261    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-envoy\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.868370 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.868336    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-podinfo\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.880604 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.880580    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzjhv\" (UniqueName: \"kubernetes.io/projected/ecd60c99-3d95-46b0-b739-2dea29198d46-kube-api-access-tzjhv\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.880724 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.880684    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-token\") pod \"e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") " pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:08.924762 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:08.924721    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:09.203743 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:09.203709    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"]
Sep 09 06:09:09.204286 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:09:09.204262    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecd60c99_3d95_46b0_b739_2dea29198d46.slice/crio-cabd7ee29f9be30617d8e25001eb2d6e530e2e6855b0514c777308ec0d68a4d5 WatchSource:0}: Error finding container cabd7ee29f9be30617d8e25001eb2d6e530e2e6855b0514c777308ec0d68a4d5: Status 404 returned error can't find the container with id cabd7ee29f9be30617d8e25001eb2d6e530e2e6855b0514c777308ec0d68a4d5
Sep 09 06:09:09.206620 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:09.206588    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:09:09.206712 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:09.206652    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:09:09.206712 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:09.206680    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:09:09.547182 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:09.547078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" event={"ID":"ecd60c99-3d95-46b0-b739-2dea29198d46","Type":"ContainerStarted","Data":"750fe01b67f2309e4eaf92cf459d1b81c9eb835fcdfa8d161388ee66f79eb274"}
Sep 09 06:09:09.547182 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:09.547141    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" event={"ID":"ecd60c99-3d95-46b0-b739-2dea29198d46","Type":"ContainerStarted","Data":"cabd7ee29f9be30617d8e25001eb2d6e530e2e6855b0514c777308ec0d68a4d5"}
Sep 09 06:09:09.568119 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:09.568072    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" podStartSLOduration=1.568052478 podStartE2EDuration="1.568052478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:09:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:09:09.5670761 +0000 UTC m=+1170.797572654" watchObservedRunningTime="2026-09-09 06:09:09.568052478 +0000 UTC m=+1170.798549030"
Sep 09 06:09:09.569506 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:09.569476    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:09.925597 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:09.925544    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:10.930036 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:10.930004    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:11.473792 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:11.473754    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:11.561507 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:11.561466    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:11.564906 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:11.564880    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:11.565055 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:11.564992    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:12.727138 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:12.727107    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:12.826201 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:12.826164    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:12.928047 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:12.928019    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:13.177175 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:13.177141    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:13.277775 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:13.277741    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:22.715153 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:22.715115    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:23.228492 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:23.228459    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:30.665961 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:30.665865    2583 generic.go:356] "Generic (PLEG): container finished" podID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerID="750fe01b67f2309e4eaf92cf459d1b81c9eb835fcdfa8d161388ee66f79eb274" exitCode=0
Sep 09 06:09:30.665961 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:30.665925    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" event={"ID":"ecd60c99-3d95-46b0-b739-2dea29198d46","Type":"ContainerDied","Data":"750fe01b67f2309e4eaf92cf459d1b81c9eb835fcdfa8d161388ee66f79eb274"}
Sep 09 06:09:30.666502 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:30.666469    2583 scope.go:117] "RemoveContainer" containerID="750fe01b67f2309e4eaf92cf459d1b81c9eb835fcdfa8d161388ee66f79eb274"
Sep 09 06:09:30.667664 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:30.667631    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:09:30.667783 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:30.667720    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:09:30.667783 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:30.667770    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:09:31.673336 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:31.673300    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" event={"ID":"ecd60c99-3d95-46b0-b739-2dea29198d46","Type":"ContainerStarted","Data":"8b176248d173f92e74752bd991cb6f5db436218cd6e1b2e199a74d7d1b348b35"}
Sep 09 06:09:31.925932 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:31.925849    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:31.926103 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:31.926057    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 09 06:09:31.926192 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:31.926126    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 09 06:09:32.926038 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:32.925991    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 09 06:09:32.926438 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:32.926056    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 09 06:09:33.555780 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:33.555739    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:33.925631 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:33.925597    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 09 06:09:33.925809 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:33.925655    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 09 06:09:34.925732 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:34.925697    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 09 06:09:34.926122 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:34.925750    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 09 06:09:35.925935 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:35.925899    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 09 06:09:35.926435 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:35.925962    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 09 06:09:36.469587 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:36.469539    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:09:36.926140 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:36.926091    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 09 06:09:36.926673 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:36.926170    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 09 06:09:37.929060 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:37.929029    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:37.929445 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:37.929294    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:37.929929 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:37.929912    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:09:59.530476 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:09:59.530441    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:10:01.036867 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:01.036814    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:10:08.632886 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.632853    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"]
Sep 09 06:10:08.636505 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.636486    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.638964 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.638945    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-6b5d89\"/\"kube-root-ca.crt\""
Sep 09 06:10:08.639331 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.639316    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-6b5d89\"/\"default-dockercfg-cjhg2\""
Sep 09 06:10:08.639966 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.639950    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-6b5d89\"/\"openshift-service-ca.crt\""
Sep 09 06:10:08.640061 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.640007    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-6b5d89\"/\"auth-test-model-6b5d89-kserve-self-signed-certs\""
Sep 09 06:10:08.646093 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.646067    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"]
Sep 09 06:10:08.662205 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.662179    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:10:08.760291 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.760256    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8b96bd-91a9-4ace-934c-265acca14b70-tls-certs\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.760291 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.760294    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-tmp-dir\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.760544 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.760324    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-home\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.760544 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.760484    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-dshm\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.760680 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.760572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-model-cache\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.760680 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.760607    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4m2jq\" (UniqueName: \"kubernetes.io/projected/da8b96bd-91a9-4ace-934c-265acca14b70-kube-api-access-4m2jq\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.862099 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.862065    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-model-cache\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.862099 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.862097    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4m2jq\" (UniqueName: \"kubernetes.io/projected/da8b96bd-91a9-4ace-934c-265acca14b70-kube-api-access-4m2jq\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.862347 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.862128    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8b96bd-91a9-4ace-934c-265acca14b70-tls-certs\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.862347 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.862149    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-tmp-dir\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.862347 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.862185    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-home\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.862347 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.862296    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-dshm\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.862610 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.862483    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-model-cache\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.862610 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.862515    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-tmp-dir\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.862691 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.862612    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-home\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.864533 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.864513    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-dshm\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.864916 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.864897    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8b96bd-91a9-4ace-934c-265acca14b70-tls-certs\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.870457 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.870438    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4m2jq\" (UniqueName: \"kubernetes.io/projected/da8b96bd-91a9-4ace-934c-265acca14b70-kube-api-access-4m2jq\") pod \"auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") " pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:08.948859 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:08.948801    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:09.221859 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:09.221832    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"]
Sep 09 06:10:09.224007 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:10:09.223981    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda8b96bd_91a9_4ace_934c_265acca14b70.slice/crio-ef60e8054daeddad7f1e219011dc57ef8cc37266bf8e879d261bed9ba3e37b34 WatchSource:0}: Error finding container ef60e8054daeddad7f1e219011dc57ef8cc37266bf8e879d261bed9ba3e37b34: Status 404 returned error can't find the container with id ef60e8054daeddad7f1e219011dc57ef8cc37266bf8e879d261bed9ba3e37b34
Sep 09 06:10:09.890958 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:09.890924    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf" event={"ID":"da8b96bd-91a9-4ace-934c-265acca14b70","Type":"ContainerStarted","Data":"3d4d640140a1ca517b1e61a2f0890d17b6aa5d7791a27d37a8d91fd9a8fb18a9"}
Sep 09 06:10:09.891301 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:09.890963    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf" event={"ID":"da8b96bd-91a9-4ace-934c-265acca14b70","Type":"ContainerStarted","Data":"ef60e8054daeddad7f1e219011dc57ef8cc37266bf8e879d261bed9ba3e37b34"}
Sep 09 06:10:09.908880 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:09.908826    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf" podStartSLOduration=1.9088123970000002 podStartE2EDuration="1.908812397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:10:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:10:09.905697125 +0000 UTC m=+1231.136193676" watchObservedRunningTime="2026-09-09 06:10:09.908812397 +0000 UTC m=+1231.139308966"
Sep 09 06:10:14.962162 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:14.962124    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"]
Sep 09 06:10:14.962650 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:14.962474    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr" podUID="0e8c8aff-f81a-43fb-8b38-258aa8f889ab" containerName="maas-api" containerID="cri-o://b664996bd64734b1bdc3ba572e69571e58d2f75fdaa9fb89b704e76e7e557eb1" gracePeriod=30
Sep 09 06:10:14.981159 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:14.980336    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:10:15.014221 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.014186    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"]
Sep 09 06:10:15.014466 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.014438    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr" podUID="f53425fd-4ea6-48b2-aaa9-992663170400" containerName="payload-pre-processing" containerID="cri-o://e0b5bfc7fd4c122796ea8707022db27199443183e262ccf4325118708f2c7fb8" gracePeriod=30
Sep 09 06:10:15.074199 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.074170    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:10:15.164060 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.164026    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:10:15.220762 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.220685    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:10:15.313707 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.313672    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"
Sep 09 06:10:15.316509 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.316487    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:10:15.422776 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.422745    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-metrics-certs\") pod \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") "
Sep 09 06:10:15.422940 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.422838    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f53425fd-4ea6-48b2-aaa9-992663170400-plugins-config-volume\") pod \"f53425fd-4ea6-48b2-aaa9-992663170400\" (UID: \"f53425fd-4ea6-48b2-aaa9-992663170400\") "
Sep 09 06:10:15.422940 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.422864    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-maas-api-tls\") pod \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") "
Sep 09 06:10:15.422940 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.422909    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p7bs\" (UniqueName: \"kubernetes.io/projected/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-kube-api-access-4p7bs\") pod \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") "
Sep 09 06:10:15.423091 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.422996    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-openshift-service-ca\") pod \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\" (UID: \"0e8c8aff-f81a-43fb-8b38-258aa8f889ab\") "
Sep 09 06:10:15.423091 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.423061    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqkks\" (UniqueName: \"kubernetes.io/projected/f53425fd-4ea6-48b2-aaa9-992663170400-kube-api-access-hqkks\") pod \"f53425fd-4ea6-48b2-aaa9-992663170400\" (UID: \"f53425fd-4ea6-48b2-aaa9-992663170400\") "
Sep 09 06:10:15.423287 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.423256    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f53425fd-4ea6-48b2-aaa9-992663170400-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f53425fd-4ea6-48b2-aaa9-992663170400" (UID: "f53425fd-4ea6-48b2-aaa9-992663170400"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:10:15.423455 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.423336    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0e8c8aff-f81a-43fb-8b38-258aa8f889ab" (UID: "0e8c8aff-f81a-43fb-8b38-258aa8f889ab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:10:15.423547 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.423524    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-openshift-service-ca\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:10:15.423808 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.423585    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f53425fd-4ea6-48b2-aaa9-992663170400-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:10:15.425104 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.425083    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0e8c8aff-f81a-43fb-8b38-258aa8f889ab" (UID: "0e8c8aff-f81a-43fb-8b38-258aa8f889ab"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 06:10:15.425236 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.425203    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-kube-api-access-4p7bs" (OuterVolumeSpecName: "kube-api-access-4p7bs") pod "0e8c8aff-f81a-43fb-8b38-258aa8f889ab" (UID: "0e8c8aff-f81a-43fb-8b38-258aa8f889ab"). InnerVolumeSpecName "kube-api-access-4p7bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:10:15.425342 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.425290    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0e8c8aff-f81a-43fb-8b38-258aa8f889ab" (UID: "0e8c8aff-f81a-43fb-8b38-258aa8f889ab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 06:10:15.425342 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.425313    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f53425fd-4ea6-48b2-aaa9-992663170400-kube-api-access-hqkks" (OuterVolumeSpecName: "kube-api-access-hqkks") pod "f53425fd-4ea6-48b2-aaa9-992663170400" (UID: "f53425fd-4ea6-48b2-aaa9-992663170400"). InnerVolumeSpecName "kube-api-access-hqkks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:10:15.525019 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.524934    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-maas-api-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:10:15.525019 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.524962    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p7bs\" (UniqueName: \"kubernetes.io/projected/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-kube-api-access-4p7bs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:10:15.525019 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.524975    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqkks\" (UniqueName: \"kubernetes.io/projected/f53425fd-4ea6-48b2-aaa9-992663170400-kube-api-access-hqkks\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:10:15.525019 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.524987    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e8c8aff-f81a-43fb-8b38-258aa8f889ab-metrics-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:10:15.924304 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.924267    2583 generic.go:356] "Generic (PLEG): container finished" podID="0e8c8aff-f81a-43fb-8b38-258aa8f889ab" containerID="b664996bd64734b1bdc3ba572e69571e58d2f75fdaa9fb89b704e76e7e557eb1" exitCode=0
Sep 09 06:10:15.924480 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.924320    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"
Sep 09 06:10:15.924480 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.924320    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr" event={"ID":"0e8c8aff-f81a-43fb-8b38-258aa8f889ab","Type":"ContainerDied","Data":"b664996bd64734b1bdc3ba572e69571e58d2f75fdaa9fb89b704e76e7e557eb1"}
Sep 09 06:10:15.924480 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.924385    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr" event={"ID":"0e8c8aff-f81a-43fb-8b38-258aa8f889ab","Type":"ContainerDied","Data":"75c0ba2bc65325f24c1da6d8af947c17f7f4ab5b507c1b646342578744623f83"}
Sep 09 06:10:15.924480 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.924417    2583 scope.go:117] "RemoveContainer" containerID="b664996bd64734b1bdc3ba572e69571e58d2f75fdaa9fb89b704e76e7e557eb1"
Sep 09 06:10:15.925901 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.925875    2583 generic.go:356] "Generic (PLEG): container finished" podID="f53425fd-4ea6-48b2-aaa9-992663170400" containerID="e0b5bfc7fd4c122796ea8707022db27199443183e262ccf4325118708f2c7fb8" exitCode=0
Sep 09 06:10:15.926006 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.925914    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"
Sep 09 06:10:15.926006 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.925928    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr" event={"ID":"f53425fd-4ea6-48b2-aaa9-992663170400","Type":"ContainerDied","Data":"e0b5bfc7fd4c122796ea8707022db27199443183e262ccf4325118708f2c7fb8"}
Sep 09 06:10:15.926006 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.925964    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr" event={"ID":"f53425fd-4ea6-48b2-aaa9-992663170400","Type":"ContainerDied","Data":"22bfb3ad69f9fa0fb32ca3b790136d7b577225caa99bd43133de3d964cf1837a"}
Sep 09 06:10:15.933766 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.933637    2583 scope.go:117] "RemoveContainer" containerID="b664996bd64734b1bdc3ba572e69571e58d2f75fdaa9fb89b704e76e7e557eb1"
Sep 09 06:10:15.933887 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:10:15.933862    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b664996bd64734b1bdc3ba572e69571e58d2f75fdaa9fb89b704e76e7e557eb1\": container with ID starting with b664996bd64734b1bdc3ba572e69571e58d2f75fdaa9fb89b704e76e7e557eb1 not found: ID does not exist" containerID="b664996bd64734b1bdc3ba572e69571e58d2f75fdaa9fb89b704e76e7e557eb1"
Sep 09 06:10:15.933969 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.933899    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b664996bd64734b1bdc3ba572e69571e58d2f75fdaa9fb89b704e76e7e557eb1"} err="failed to get container status \"b664996bd64734b1bdc3ba572e69571e58d2f75fdaa9fb89b704e76e7e557eb1\": rpc error: code = NotFound desc = could not find container \"b664996bd64734b1bdc3ba572e69571e58d2f75fdaa9fb89b704e76e7e557eb1\": container with ID starting with b664996bd64734b1bdc3ba572e69571e58d2f75fdaa9fb89b704e76e7e557eb1 not found: ID does not exist"
Sep 09 06:10:15.933969 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.933922    2583 scope.go:117] "RemoveContainer" containerID="e0b5bfc7fd4c122796ea8707022db27199443183e262ccf4325118708f2c7fb8"
Sep 09 06:10:15.942503 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.942488    2583 scope.go:117] "RemoveContainer" containerID="e0b5bfc7fd4c122796ea8707022db27199443183e262ccf4325118708f2c7fb8"
Sep 09 06:10:15.942781 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:10:15.942765    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0b5bfc7fd4c122796ea8707022db27199443183e262ccf4325118708f2c7fb8\": container with ID starting with e0b5bfc7fd4c122796ea8707022db27199443183e262ccf4325118708f2c7fb8 not found: ID does not exist" containerID="e0b5bfc7fd4c122796ea8707022db27199443183e262ccf4325118708f2c7fb8"
Sep 09 06:10:15.942842 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.942789    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0b5bfc7fd4c122796ea8707022db27199443183e262ccf4325118708f2c7fb8"} err="failed to get container status \"e0b5bfc7fd4c122796ea8707022db27199443183e262ccf4325118708f2c7fb8\": rpc error: code = NotFound desc = could not find container \"e0b5bfc7fd4c122796ea8707022db27199443183e262ccf4325118708f2c7fb8\": container with ID starting with e0b5bfc7fd4c122796ea8707022db27199443183e262ccf4325118708f2c7fb8 not found: ID does not exist"
Sep 09 06:10:15.952732 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.952704    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"]
Sep 09 06:10:15.955029 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.955007    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-389cd1da-7c55867597-q2hqr"]
Sep 09 06:10:15.964661 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.964642    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"]
Sep 09 06:10:15.970019 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:15.969997    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-389cd1da-76f6ffb9d-hd4dr"]
Sep 09 06:10:17.245096 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:17.245059    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e8c8aff-f81a-43fb-8b38-258aa8f889ab" path="/var/lib/kubelet/pods/0e8c8aff-f81a-43fb-8b38-258aa8f889ab/volumes"
Sep 09 06:10:17.245477 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:17.245415    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f53425fd-4ea6-48b2-aaa9-992663170400" path="/var/lib/kubelet/pods/f53425fd-4ea6-48b2-aaa9-992663170400/volumes"
Sep 09 06:10:18.480237 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:18.480199    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:10:18.949436 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:18.949408    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:18.949634 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:18.949455    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:18.962133 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:18.962111    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:19.959745 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:19.959712    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:10:21.457382 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:21.457347    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:10:23.500742 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:23.500702    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:10:44.442083 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:44.442049    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:10:45.218027 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:45.217989    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:10:50.808505 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:50.808470    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:10:52.662127 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:52.662091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:10:54.846803 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:10:54.846770    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:04.700008 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:04.699961    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:04.769667 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:04.769581    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:04.969149 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:04.969071    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:06.236643 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:06.236610    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:06.338192 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:06.338160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:06.439377 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:06.439299    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:07.123027 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:07.122995    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:07.222866 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:07.222831    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:07.323610 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:07.323548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:08.599460 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:08.599424    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:11.265695 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:11.265658    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:14.428833 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:14.428797    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:14.528826 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:14.528797    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:15.108545 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:15.108511    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:20.826869 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:20.826829    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:20.892461 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:20.892427    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:20.975649 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:20.975616    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:31.541821 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:31.541777    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:31.765348 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:31.765313    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:52.669539 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:52.669509    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:58.496546 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:58.496508    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:58.604831 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:58.604796    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:58.880409 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:58.880375    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:59.181835 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:59.181751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:11:59.555837 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:11:59.555748    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:02.141763 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:02.141681    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:02.244065 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:02.244027    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:03.342515 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:03.342481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:03.443423 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:03.443392    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:03.747254 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:03.747211    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:03.962669 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:03.962639    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:04.061783 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.061703    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:04.087947 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.087916    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"]
Sep 09 06:12:04.088371 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.088359    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8c8aff-f81a-43fb-8b38-258aa8f889ab" containerName="maas-api"
Sep 09 06:12:04.088420 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.088374    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8c8aff-f81a-43fb-8b38-258aa8f889ab" containerName="maas-api"
Sep 09 06:12:04.088420 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.088383    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f53425fd-4ea6-48b2-aaa9-992663170400" containerName="payload-pre-processing"
Sep 09 06:12:04.088420 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.088388    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f53425fd-4ea6-48b2-aaa9-992663170400" containerName="payload-pre-processing"
Sep 09 06:12:04.088521 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.088476    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f53425fd-4ea6-48b2-aaa9-992663170400" containerName="payload-pre-processing"
Sep 09 06:12:04.088521 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.088485    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e8c8aff-f81a-43fb-8b38-258aa8f889ab" containerName="maas-api"
Sep 09 06:12:04.091923 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.091904    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"
Sep 09 06:12:04.094424 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.094401    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-e1ed02\""
Sep 09 06:12:04.094525 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.094482    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-e1ed02-dockercfg-qmwjk\""
Sep 09 06:12:04.104681 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.104661    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"]
Sep 09 06:12:04.162282 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.162248    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"]
Sep 09 06:12:04.165961 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.165942    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"
Sep 09 06:12:04.178544 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.178518    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"]
Sep 09 06:12:04.208112 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.208078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac756985-7b1f-4973-8eb5-4e4083ff7fac-plugins-config-volume\") pod \"payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8\" (UID: \"ac756985-7b1f-4973-8eb5-4e4083ff7fac\") " pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"
Sep 09 06:12:04.208294 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.208133    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8p7t\" (UniqueName: \"kubernetes.io/projected/119b5a91-4c98-4529-9844-e01694823a3c-kube-api-access-s8p7t\") pod \"payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7\" (UID: \"119b5a91-4c98-4529-9844-e01694823a3c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"
Sep 09 06:12:04.208294 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.208267    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/119b5a91-4c98-4529-9844-e01694823a3c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7\" (UID: \"119b5a91-4c98-4529-9844-e01694823a3c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"
Sep 09 06:12:04.208395 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.208348    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52tqm\" (UniqueName: \"kubernetes.io/projected/ac756985-7b1f-4973-8eb5-4e4083ff7fac-kube-api-access-52tqm\") pod \"payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8\" (UID: \"ac756985-7b1f-4973-8eb5-4e4083ff7fac\") " pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"
Sep 09 06:12:04.309182 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.309144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/119b5a91-4c98-4529-9844-e01694823a3c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7\" (UID: \"119b5a91-4c98-4529-9844-e01694823a3c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"
Sep 09 06:12:04.309364 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.309223    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52tqm\" (UniqueName: \"kubernetes.io/projected/ac756985-7b1f-4973-8eb5-4e4083ff7fac-kube-api-access-52tqm\") pod \"payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8\" (UID: \"ac756985-7b1f-4973-8eb5-4e4083ff7fac\") " pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"
Sep 09 06:12:04.309364 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.309267    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac756985-7b1f-4973-8eb5-4e4083ff7fac-plugins-config-volume\") pod \"payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8\" (UID: \"ac756985-7b1f-4973-8eb5-4e4083ff7fac\") " pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"
Sep 09 06:12:04.309364 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.309297    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8p7t\" (UniqueName: \"kubernetes.io/projected/119b5a91-4c98-4529-9844-e01694823a3c-kube-api-access-s8p7t\") pod \"payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7\" (UID: \"119b5a91-4c98-4529-9844-e01694823a3c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"
Sep 09 06:12:04.310057 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.310031    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/119b5a91-4c98-4529-9844-e01694823a3c-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7\" (UID: \"119b5a91-4c98-4529-9844-e01694823a3c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"
Sep 09 06:12:04.310137 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.310064    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac756985-7b1f-4973-8eb5-4e4083ff7fac-plugins-config-volume\") pod \"payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8\" (UID: \"ac756985-7b1f-4973-8eb5-4e4083ff7fac\") " pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"
Sep 09 06:12:04.317467 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.317415    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52tqm\" (UniqueName: \"kubernetes.io/projected/ac756985-7b1f-4973-8eb5-4e4083ff7fac-kube-api-access-52tqm\") pod \"payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8\" (UID: \"ac756985-7b1f-4973-8eb5-4e4083ff7fac\") " pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"
Sep 09 06:12:04.317884 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.317868    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8p7t\" (UniqueName: \"kubernetes.io/projected/119b5a91-4c98-4529-9844-e01694823a3c-kube-api-access-s8p7t\") pod \"payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7\" (UID: \"119b5a91-4c98-4529-9844-e01694823a3c\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"
Sep 09 06:12:04.403150 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.403117    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"
Sep 09 06:12:04.477335 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.477309    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"
Sep 09 06:12:04.680011 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.679988    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"]
Sep 09 06:12:04.682199 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:12:04.682170    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac756985_7b1f_4973_8eb5_4e4083ff7fac.slice/crio-5c24397f3f3e49530173319c05dca95e9e0a1fdd94aea4b033939fdece8236e7 WatchSource:0}: Error finding container 5c24397f3f3e49530173319c05dca95e9e0a1fdd94aea4b033939fdece8236e7: Status 404 returned error can't find the container with id 5c24397f3f3e49530173319c05dca95e9e0a1fdd94aea4b033939fdece8236e7
Sep 09 06:12:04.760935 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:04.760911    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"]
Sep 09 06:12:04.762773 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:12:04.762744    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod119b5a91_4c98_4529_9844_e01694823a3c.slice/crio-f072e84cb3d0f8a21f8db3fb7a707731a8c5ba56c8b577cd2e1dfdd374554bcc WatchSource:0}: Error finding container f072e84cb3d0f8a21f8db3fb7a707731a8c5ba56c8b577cd2e1dfdd374554bcc: Status 404 returned error can't find the container with id f072e84cb3d0f8a21f8db3fb7a707731a8c5ba56c8b577cd2e1dfdd374554bcc
Sep 09 06:12:05.532183 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:05.532142    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7" event={"ID":"119b5a91-4c98-4529-9844-e01694823a3c","Type":"ContainerStarted","Data":"1183c499d4310f8795c47f1589d5a9a67111cf7fd13f3eea60d1edc1d50cb8a4"}
Sep 09 06:12:05.532684 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:05.532202    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7" event={"ID":"119b5a91-4c98-4529-9844-e01694823a3c","Type":"ContainerStarted","Data":"f072e84cb3d0f8a21f8db3fb7a707731a8c5ba56c8b577cd2e1dfdd374554bcc"}
Sep 09 06:12:05.532684 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:05.532229    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"
Sep 09 06:12:05.533861 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:05.533835    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8" event={"ID":"ac756985-7b1f-4973-8eb5-4e4083ff7fac","Type":"ContainerStarted","Data":"c1c360f27809f8a09a65ed0198ceed2f8b3fe5c20cc965563ff36d3f7820732d"}
Sep 09 06:12:05.533992 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:05.533877    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8" event={"ID":"ac756985-7b1f-4973-8eb5-4e4083ff7fac","Type":"ContainerStarted","Data":"5c24397f3f3e49530173319c05dca95e9e0a1fdd94aea4b033939fdece8236e7"}
Sep 09 06:12:05.533992 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:05.533910    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"
Sep 09 06:12:05.559628 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:05.559588    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7" podStartSLOduration=1.559549771 podStartE2EDuration="1.559549771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:12:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:12:05.557536549 +0000 UTC m=+1346.788033102" watchObservedRunningTime="2026-09-09 06:12:05.559549771 +0000 UTC m=+1346.790046322"
Sep 09 06:12:05.576711 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:05.576671    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8" podStartSLOduration=1.576658681 podStartE2EDuration="1.576658681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:12:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:12:05.575333603 +0000 UTC m=+1346.805830157" watchObservedRunningTime="2026-09-09 06:12:05.576658681 +0000 UTC m=+1346.807155262"
Sep 09 06:12:15.730252 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:15.730219    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:16.541943 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:16.541911    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"
Sep 09 06:12:16.542110 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:16.542000    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"
Sep 09 06:12:18.931753 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:18.931711    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:22.858326 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:22.858290    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:24.382849 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:24.382807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:26.968571 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:26.968530    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:27.380189 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:27.380152    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:27.660115 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:27.660016    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:27.981978 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:27.981888    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:31.156152 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:31.156118    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:31.255300 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:31.255266    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:32.313023 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:32.312972    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:32.412372 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:32.412336    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:32.512183 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:32.512145    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:32.928144 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:32.928106    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:33.023107 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.023080    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:33.060856 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.060826    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"]
Sep 09 06:12:33.065358 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.065332    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"
Sep 09 06:12:33.067794 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.067769    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-d907ff-dockercfg-2hngv\""
Sep 09 06:12:33.067922 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.067853    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-d907ff\""
Sep 09 06:12:33.077872 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.077844    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"]
Sep 09 06:12:33.099380 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.099350    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57be429a-14f7-4682-bd48-8da3232350bd-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj\" (UID: \"57be429a-14f7-4682-bd48-8da3232350bd\") " pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"
Sep 09 06:12:33.099584 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.099412    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2574\" (UniqueName: \"kubernetes.io/projected/57be429a-14f7-4682-bd48-8da3232350bd-kube-api-access-v2574\") pod \"payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj\" (UID: \"57be429a-14f7-4682-bd48-8da3232350bd\") " pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"
Sep 09 06:12:33.200804 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.200705    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57be429a-14f7-4682-bd48-8da3232350bd-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj\" (UID: \"57be429a-14f7-4682-bd48-8da3232350bd\") " pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"
Sep 09 06:12:33.200804 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.200797    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2574\" (UniqueName: \"kubernetes.io/projected/57be429a-14f7-4682-bd48-8da3232350bd-kube-api-access-v2574\") pod \"payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj\" (UID: \"57be429a-14f7-4682-bd48-8da3232350bd\") " pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"
Sep 09 06:12:33.201414 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.201394    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57be429a-14f7-4682-bd48-8da3232350bd-plugins-config-volume\") pod \"payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj\" (UID: \"57be429a-14f7-4682-bd48-8da3232350bd\") " pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"
Sep 09 06:12:33.208535 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.208507    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2574\" (UniqueName: \"kubernetes.io/projected/57be429a-14f7-4682-bd48-8da3232350bd-kube-api-access-v2574\") pod \"payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj\" (UID: \"57be429a-14f7-4682-bd48-8da3232350bd\") " pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"
Sep 09 06:12:33.380106 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.380075    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"
Sep 09 06:12:33.654178 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.654151    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"]
Sep 09 06:12:33.656140 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:12:33.656109    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57be429a_14f7_4682_bd48_8da3232350bd.slice/crio-0e909cf78545e95e56d2b3633daa26ce45d7adfbfaa2221a26018c74806a5212 WatchSource:0}: Error finding container 0e909cf78545e95e56d2b3633daa26ce45d7adfbfaa2221a26018c74806a5212: Status 404 returned error can't find the container with id 0e909cf78545e95e56d2b3633daa26ce45d7adfbfaa2221a26018c74806a5212
Sep 09 06:12:33.692450 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:33.692419    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj" event={"ID":"57be429a-14f7-4682-bd48-8da3232350bd","Type":"ContainerStarted","Data":"0e909cf78545e95e56d2b3633daa26ce45d7adfbfaa2221a26018c74806a5212"}
Sep 09 06:12:34.700331 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:34.700292    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj" event={"ID":"57be429a-14f7-4682-bd48-8da3232350bd","Type":"ContainerStarted","Data":"55db925587ad87997d15f990b98f4a0ade688748bd6091518c3ee79bec049bbf"}
Sep 09 06:12:34.700740 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:34.700401    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"
Sep 09 06:12:35.450306 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:35.450265    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:45.709376 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:45.709346    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"
Sep 09 06:12:45.725668 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:45.725611    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj" podStartSLOduration=12.725596583 podStartE2EDuration="12.725596583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:12:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:12:34.725399222 +0000 UTC m=+1375.955895775" watchObservedRunningTime="2026-09-09 06:12:45.725596583 +0000 UTC m=+1386.956093135"
Sep 09 06:12:53.437067 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:53.437031    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:56.108740 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:56.108691    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:12:59.148217 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:12:59.148186    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:05.096443 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:05.096408    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:09.326000 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:09.325962    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:14.883248 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:14.883210    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:14.905056 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:14.905022    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"]
Sep 09 06:13:14.905303 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:14.905273    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8" podUID="ac756985-7b1f-4973-8eb5-4e4083ff7fac" containerName="payload-processing" containerID="cri-o://c1c360f27809f8a09a65ed0198ceed2f8b3fe5c20cc965563ff36d3f7820732d" gracePeriod=30
Sep 09 06:13:14.914139 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:14.913471    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"]
Sep 09 06:13:14.914139 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:14.913837    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7" podUID="119b5a91-4c98-4529-9844-e01694823a3c" containerName="payload-pre-processing" containerID="cri-o://1183c499d4310f8795c47f1589d5a9a67111cf7fd13f3eea60d1edc1d50cb8a4" gracePeriod=30
Sep 09 06:13:14.942941 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:14.942915    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:14.999049 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:14.999019    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:15.068036 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.067999    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:15.123408 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.123377    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:15.185017 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.184989    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"
Sep 09 06:13:15.213305 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.213271    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52tqm\" (UniqueName: \"kubernetes.io/projected/ac756985-7b1f-4973-8eb5-4e4083ff7fac-kube-api-access-52tqm\") pod \"ac756985-7b1f-4973-8eb5-4e4083ff7fac\" (UID: \"ac756985-7b1f-4973-8eb5-4e4083ff7fac\") "
Sep 09 06:13:15.213443 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.213357    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac756985-7b1f-4973-8eb5-4e4083ff7fac-plugins-config-volume\") pod \"ac756985-7b1f-4973-8eb5-4e4083ff7fac\" (UID: \"ac756985-7b1f-4973-8eb5-4e4083ff7fac\") "
Sep 09 06:13:15.213770 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.213747    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac756985-7b1f-4973-8eb5-4e4083ff7fac-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ac756985-7b1f-4973-8eb5-4e4083ff7fac" (UID: "ac756985-7b1f-4973-8eb5-4e4083ff7fac"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:13:15.214258 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.214236    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"
Sep 09 06:13:15.215676 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.215653    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac756985-7b1f-4973-8eb5-4e4083ff7fac-kube-api-access-52tqm" (OuterVolumeSpecName: "kube-api-access-52tqm") pod "ac756985-7b1f-4973-8eb5-4e4083ff7fac" (UID: "ac756985-7b1f-4973-8eb5-4e4083ff7fac"). InnerVolumeSpecName "kube-api-access-52tqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:13:15.314395 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.314362    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8p7t\" (UniqueName: \"kubernetes.io/projected/119b5a91-4c98-4529-9844-e01694823a3c-kube-api-access-s8p7t\") pod \"119b5a91-4c98-4529-9844-e01694823a3c\" (UID: \"119b5a91-4c98-4529-9844-e01694823a3c\") "
Sep 09 06:13:15.314530 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.314427    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/119b5a91-4c98-4529-9844-e01694823a3c-plugins-config-volume\") pod \"119b5a91-4c98-4529-9844-e01694823a3c\" (UID: \"119b5a91-4c98-4529-9844-e01694823a3c\") "
Sep 09 06:13:15.314788 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.314767    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52tqm\" (UniqueName: \"kubernetes.io/projected/ac756985-7b1f-4973-8eb5-4e4083ff7fac-kube-api-access-52tqm\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:15.314788 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.314786    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac756985-7b1f-4973-8eb5-4e4083ff7fac-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:15.314926 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.314791    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/119b5a91-4c98-4529-9844-e01694823a3c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "119b5a91-4c98-4529-9844-e01694823a3c" (UID: "119b5a91-4c98-4529-9844-e01694823a3c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:13:15.316521 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.316505    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/119b5a91-4c98-4529-9844-e01694823a3c-kube-api-access-s8p7t" (OuterVolumeSpecName: "kube-api-access-s8p7t") pod "119b5a91-4c98-4529-9844-e01694823a3c" (UID: "119b5a91-4c98-4529-9844-e01694823a3c"). InnerVolumeSpecName "kube-api-access-s8p7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:13:15.402027 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.402002    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:15.415494 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.415440    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8p7t\" (UniqueName: \"kubernetes.io/projected/119b5a91-4c98-4529-9844-e01694823a3c-kube-api-access-s8p7t\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:15.415494 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.415460    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/119b5a91-4c98-4529-9844-e01694823a3c-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:15.457940 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.457917    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:15.940040 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.940008    2583 generic.go:356] "Generic (PLEG): container finished" podID="119b5a91-4c98-4529-9844-e01694823a3c" containerID="1183c499d4310f8795c47f1589d5a9a67111cf7fd13f3eea60d1edc1d50cb8a4" exitCode=0
Sep 09 06:13:15.940481 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.940102    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"
Sep 09 06:13:15.940481 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.940118    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7" event={"ID":"119b5a91-4c98-4529-9844-e01694823a3c","Type":"ContainerDied","Data":"1183c499d4310f8795c47f1589d5a9a67111cf7fd13f3eea60d1edc1d50cb8a4"}
Sep 09 06:13:15.940481 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.940172    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7" event={"ID":"119b5a91-4c98-4529-9844-e01694823a3c","Type":"ContainerDied","Data":"f072e84cb3d0f8a21f8db3fb7a707731a8c5ba56c8b577cd2e1dfdd374554bcc"}
Sep 09 06:13:15.940481 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.940205    2583 scope.go:117] "RemoveContainer" containerID="1183c499d4310f8795c47f1589d5a9a67111cf7fd13f3eea60d1edc1d50cb8a4"
Sep 09 06:13:15.941801 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.941500    2583 generic.go:356] "Generic (PLEG): container finished" podID="ac756985-7b1f-4973-8eb5-4e4083ff7fac" containerID="c1c360f27809f8a09a65ed0198ceed2f8b3fe5c20cc965563ff36d3f7820732d" exitCode=0
Sep 09 06:13:15.941801 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.941541    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"
Sep 09 06:13:15.941801 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.941548    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8" event={"ID":"ac756985-7b1f-4973-8eb5-4e4083ff7fac","Type":"ContainerDied","Data":"c1c360f27809f8a09a65ed0198ceed2f8b3fe5c20cc965563ff36d3f7820732d"}
Sep 09 06:13:15.941801 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.941677    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8" event={"ID":"ac756985-7b1f-4973-8eb5-4e4083ff7fac","Type":"ContainerDied","Data":"5c24397f3f3e49530173319c05dca95e9e0a1fdd94aea4b033939fdece8236e7"}
Sep 09 06:13:15.949919 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.949900    2583 scope.go:117] "RemoveContainer" containerID="1183c499d4310f8795c47f1589d5a9a67111cf7fd13f3eea60d1edc1d50cb8a4"
Sep 09 06:13:15.950185 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:13:15.950164    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1183c499d4310f8795c47f1589d5a9a67111cf7fd13f3eea60d1edc1d50cb8a4\": container with ID starting with 1183c499d4310f8795c47f1589d5a9a67111cf7fd13f3eea60d1edc1d50cb8a4 not found: ID does not exist" containerID="1183c499d4310f8795c47f1589d5a9a67111cf7fd13f3eea60d1edc1d50cb8a4"
Sep 09 06:13:15.950234 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.950193    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1183c499d4310f8795c47f1589d5a9a67111cf7fd13f3eea60d1edc1d50cb8a4"} err="failed to get container status \"1183c499d4310f8795c47f1589d5a9a67111cf7fd13f3eea60d1edc1d50cb8a4\": rpc error: code = NotFound desc = could not find container \"1183c499d4310f8795c47f1589d5a9a67111cf7fd13f3eea60d1edc1d50cb8a4\": container with ID starting with 1183c499d4310f8795c47f1589d5a9a67111cf7fd13f3eea60d1edc1d50cb8a4 not found: ID does not exist"
Sep 09 06:13:15.950234 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.950209    2583 scope.go:117] "RemoveContainer" containerID="c1c360f27809f8a09a65ed0198ceed2f8b3fe5c20cc965563ff36d3f7820732d"
Sep 09 06:13:15.958969 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.958952    2583 scope.go:117] "RemoveContainer" containerID="c1c360f27809f8a09a65ed0198ceed2f8b3fe5c20cc965563ff36d3f7820732d"
Sep 09 06:13:15.959254 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:13:15.959236    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1c360f27809f8a09a65ed0198ceed2f8b3fe5c20cc965563ff36d3f7820732d\": container with ID starting with c1c360f27809f8a09a65ed0198ceed2f8b3fe5c20cc965563ff36d3f7820732d not found: ID does not exist" containerID="c1c360f27809f8a09a65ed0198ceed2f8b3fe5c20cc965563ff36d3f7820732d"
Sep 09 06:13:15.959306 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.959259    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1c360f27809f8a09a65ed0198ceed2f8b3fe5c20cc965563ff36d3f7820732d"} err="failed to get container status \"c1c360f27809f8a09a65ed0198ceed2f8b3fe5c20cc965563ff36d3f7820732d\": rpc error: code = NotFound desc = could not find container \"c1c360f27809f8a09a65ed0198ceed2f8b3fe5c20cc965563ff36d3f7820732d\": container with ID starting with c1c360f27809f8a09a65ed0198ceed2f8b3fe5c20cc965563ff36d3f7820732d not found: ID does not exist"
Sep 09 06:13:15.966378 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.966354    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"]
Sep 09 06:13:15.968680 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.968653    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-e1ed02-84c5cbb8f8-nkxz7"]
Sep 09 06:13:15.981664 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.981640    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"]
Sep 09 06:13:15.984342 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:15.984322    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-e1ed02-6b97c85bc7-cx2l8"]
Sep 09 06:13:17.246164 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:17.246132    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="119b5a91-4c98-4529-9844-e01694823a3c" path="/var/lib/kubelet/pods/119b5a91-4c98-4529-9844-e01694823a3c/volumes"
Sep 09 06:13:17.246526 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:17.246498    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac756985-7b1f-4973-8eb5-4e4083ff7fac" path="/var/lib/kubelet/pods/ac756985-7b1f-4973-8eb5-4e4083ff7fac/volumes"
Sep 09 06:13:19.689640 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:19.689566    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:19.940183 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:19.940107    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:21.176059 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:21.176025    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:21.276315 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:21.276278    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:21.438613 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:21.438509    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:21.918306 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:21.918275    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:24.748835 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:24.748794    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:30.036236 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:30.036192    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:31.860603 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:31.860572    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:35.591353 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.591311    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"]
Sep 09 06:13:35.591844 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.591594    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d" podUID="efad91d5-7d39-4f6e-8ca1-09a57b2efd7d" containerName="maas-api" containerID="cri-o://a77676cc7f48833cade04ff86a014e8a62f9ab35c6fadb0ab78caf74038af364" gracePeriod=30
Sep 09 06:13:35.617900 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.617867    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:35.693952 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.693918    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:35.760165 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.760097    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:35.852112 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.852055    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:13:35.859748 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.859722    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:35.924154 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.924123    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkw95\" (UniqueName: \"kubernetes.io/projected/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-kube-api-access-mkw95\") pod \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") "
Sep 09 06:13:35.924331 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.924200    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-metrics-certs\") pod \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") "
Sep 09 06:13:35.924331 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.924221    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-openshift-service-ca\") pod \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") "
Sep 09 06:13:35.924331 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.924279    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-maas-api-tls\") pod \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\" (UID: \"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d\") "
Sep 09 06:13:35.924682 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.924650    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "efad91d5-7d39-4f6e-8ca1-09a57b2efd7d" (UID: "efad91d5-7d39-4f6e-8ca1-09a57b2efd7d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:13:35.926549 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.926513    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "efad91d5-7d39-4f6e-8ca1-09a57b2efd7d" (UID: "efad91d5-7d39-4f6e-8ca1-09a57b2efd7d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 06:13:35.926549 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.926530    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "efad91d5-7d39-4f6e-8ca1-09a57b2efd7d" (UID: "efad91d5-7d39-4f6e-8ca1-09a57b2efd7d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 06:13:35.926714 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:35.926654    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-kube-api-access-mkw95" (OuterVolumeSpecName: "kube-api-access-mkw95") pod "efad91d5-7d39-4f6e-8ca1-09a57b2efd7d" (UID: "efad91d5-7d39-4f6e-8ca1-09a57b2efd7d"). InnerVolumeSpecName "kube-api-access-mkw95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:13:36.025489 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:36.025448    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkw95\" (UniqueName: \"kubernetes.io/projected/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-kube-api-access-mkw95\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:36.025489 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:36.025482    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-metrics-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:36.025489 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:36.025492    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-openshift-service-ca\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:36.025757 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:36.025500    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d-maas-api-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:36.059534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:36.059498    2583 generic.go:356] "Generic (PLEG): container finished" podID="efad91d5-7d39-4f6e-8ca1-09a57b2efd7d" containerID="a77676cc7f48833cade04ff86a014e8a62f9ab35c6fadb0ab78caf74038af364" exitCode=0
Sep 09 06:13:36.059732 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:36.059545    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"
Sep 09 06:13:36.059732 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:36.059582    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d" event={"ID":"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d","Type":"ContainerDied","Data":"a77676cc7f48833cade04ff86a014e8a62f9ab35c6fadb0ab78caf74038af364"}
Sep 09 06:13:36.059732 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:36.059641    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d" event={"ID":"efad91d5-7d39-4f6e-8ca1-09a57b2efd7d","Type":"ContainerDied","Data":"d00be9e8121454165bb9a943ca7fffb6cd4f3e49c4dfc2dc6b973f96ec42fe77"}
Sep 09 06:13:36.059732 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:36.059664    2583 scope.go:117] "RemoveContainer" containerID="a77676cc7f48833cade04ff86a014e8a62f9ab35c6fadb0ab78caf74038af364"
Sep 09 06:13:36.069239 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:36.069218    2583 scope.go:117] "RemoveContainer" containerID="a77676cc7f48833cade04ff86a014e8a62f9ab35c6fadb0ab78caf74038af364"
Sep 09 06:13:36.069603 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:13:36.069583    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a77676cc7f48833cade04ff86a014e8a62f9ab35c6fadb0ab78caf74038af364\": container with ID starting with a77676cc7f48833cade04ff86a014e8a62f9ab35c6fadb0ab78caf74038af364 not found: ID does not exist" containerID="a77676cc7f48833cade04ff86a014e8a62f9ab35c6fadb0ab78caf74038af364"
Sep 09 06:13:36.069658 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:36.069614    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a77676cc7f48833cade04ff86a014e8a62f9ab35c6fadb0ab78caf74038af364"} err="failed to get container status \"a77676cc7f48833cade04ff86a014e8a62f9ab35c6fadb0ab78caf74038af364\": rpc error: code = NotFound desc = could not find container \"a77676cc7f48833cade04ff86a014e8a62f9ab35c6fadb0ab78caf74038af364\": container with ID starting with a77676cc7f48833cade04ff86a014e8a62f9ab35c6fadb0ab78caf74038af364 not found: ID does not exist"
Sep 09 06:13:36.082594 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:36.082569    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"]
Sep 09 06:13:36.090894 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:36.090867    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-43eb2d-6dcf45b467-vr25d"]
Sep 09 06:13:36.144890 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:36.144861    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:37.244940 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.244904    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efad91d5-7d39-4f6e-8ca1-09a57b2efd7d" path="/var/lib/kubelet/pods/efad91d5-7d39-4f6e-8ca1-09a57b2efd7d/volumes"
Sep 09 06:13:37.427467 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.427433    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:37.449719 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.449685    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"]
Sep 09 06:13:37.449990 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.449934    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj" podUID="57be429a-14f7-4682-bd48-8da3232350bd" containerName="payload-processing" containerID="cri-o://55db925587ad87997d15f990b98f4a0ade688748bd6091518c3ee79bec049bbf" gracePeriod=30
Sep 09 06:13:37.531010 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.530937    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:37.604477 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.604441    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:37.669204 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.669168    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:37.728963 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.728940    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"
Sep 09 06:13:37.844820 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.844739    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2574\" (UniqueName: \"kubernetes.io/projected/57be429a-14f7-4682-bd48-8da3232350bd-kube-api-access-v2574\") pod \"57be429a-14f7-4682-bd48-8da3232350bd\" (UID: \"57be429a-14f7-4682-bd48-8da3232350bd\") "
Sep 09 06:13:37.844820 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.844779    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57be429a-14f7-4682-bd48-8da3232350bd-plugins-config-volume\") pod \"57be429a-14f7-4682-bd48-8da3232350bd\" (UID: \"57be429a-14f7-4682-bd48-8da3232350bd\") "
Sep 09 06:13:37.845208 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.845184    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57be429a-14f7-4682-bd48-8da3232350bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "57be429a-14f7-4682-bd48-8da3232350bd" (UID: "57be429a-14f7-4682-bd48-8da3232350bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:13:37.847172 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.847149    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57be429a-14f7-4682-bd48-8da3232350bd-kube-api-access-v2574" (OuterVolumeSpecName: "kube-api-access-v2574") pod "57be429a-14f7-4682-bd48-8da3232350bd" (UID: "57be429a-14f7-4682-bd48-8da3232350bd"). InnerVolumeSpecName "kube-api-access-v2574". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:13:37.946262 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.946229    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2574\" (UniqueName: \"kubernetes.io/projected/57be429a-14f7-4682-bd48-8da3232350bd-kube-api-access-v2574\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:37.946262 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.946259    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/57be429a-14f7-4682-bd48-8da3232350bd-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:37.983205 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:37.983174    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:38.071986 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:38.071949    2583 generic.go:356] "Generic (PLEG): container finished" podID="57be429a-14f7-4682-bd48-8da3232350bd" containerID="55db925587ad87997d15f990b98f4a0ade688748bd6091518c3ee79bec049bbf" exitCode=0
Sep 09 06:13:38.072150 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:38.071989    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"
Sep 09 06:13:38.072150 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:38.071999    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj" event={"ID":"57be429a-14f7-4682-bd48-8da3232350bd","Type":"ContainerDied","Data":"55db925587ad87997d15f990b98f4a0ade688748bd6091518c3ee79bec049bbf"}
Sep 09 06:13:38.072150 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:38.072045    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj" event={"ID":"57be429a-14f7-4682-bd48-8da3232350bd","Type":"ContainerDied","Data":"0e909cf78545e95e56d2b3633daa26ce45d7adfbfaa2221a26018c74806a5212"}
Sep 09 06:13:38.072150 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:38.072067    2583 scope.go:117] "RemoveContainer" containerID="55db925587ad87997d15f990b98f4a0ade688748bd6091518c3ee79bec049bbf"
Sep 09 06:13:38.082254 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:38.082238    2583 scope.go:117] "RemoveContainer" containerID="55db925587ad87997d15f990b98f4a0ade688748bd6091518c3ee79bec049bbf"
Sep 09 06:13:38.082521 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:13:38.082502    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55db925587ad87997d15f990b98f4a0ade688748bd6091518c3ee79bec049bbf\": container with ID starting with 55db925587ad87997d15f990b98f4a0ade688748bd6091518c3ee79bec049bbf not found: ID does not exist" containerID="55db925587ad87997d15f990b98f4a0ade688748bd6091518c3ee79bec049bbf"
Sep 09 06:13:38.082591 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:38.082530    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55db925587ad87997d15f990b98f4a0ade688748bd6091518c3ee79bec049bbf"} err="failed to get container status \"55db925587ad87997d15f990b98f4a0ade688748bd6091518c3ee79bec049bbf\": rpc error: code = NotFound desc = could not find container \"55db925587ad87997d15f990b98f4a0ade688748bd6091518c3ee79bec049bbf\": container with ID starting with 55db925587ad87997d15f990b98f4a0ade688748bd6091518c3ee79bec049bbf not found: ID does not exist"
Sep 09 06:13:38.093136 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:38.093110    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"]
Sep 09 06:13:38.096872 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:38.096822    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-d907ff-bf4d4c997-z9ctj"]
Sep 09 06:13:39.245686 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:39.245655    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57be429a-14f7-4682-bd48-8da3232350bd" path="/var/lib/kubelet/pods/57be429a-14f7-4682-bd48-8da3232350bd/volumes"
Sep 09 06:13:42.093771 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:42.093646    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:42.195023 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:42.194987    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:42.345899 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:42.345809    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"]
Sep 09 06:13:42.346057 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:42.346031    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerName="istio-proxy" containerID="cri-o://5c77c7bcd20c3353485ff4419e10b1ffa80c662031aac949666b1e8217ba738e" gracePeriod=30
Sep 09 06:13:42.395071 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:42.395035    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:44.008207 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:44.008156    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:44.105620 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:44.105590    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:44.284074 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:44.283995    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:44.747433 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:44.747399    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:44.906677 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:44.906639    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 06:13:44.906838 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:44.906709    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 06:13:45.678919 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:45.678889    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:45.928456 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:45.928424    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:47.621094 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.621072    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:13:47.648003 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.647874    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istiod-ca-cert\") pod \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") "
Sep 09 06:13:47.648003 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.647926    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-credential-socket\") pod \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") "
Sep 09 06:13:47.648003 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.647971    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-workload-certs\") pod \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") "
Sep 09 06:13:47.648241 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.648043    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8686\" (UniqueName: \"kubernetes.io/projected/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-kube-api-access-s8686\") pod \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") "
Sep 09 06:13:47.648241 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.648114    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-token\") pod \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") "
Sep 09 06:13:47.648241 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.648151    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-envoy\") pod \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") "
Sep 09 06:13:47.648241 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.648177    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-data\") pod \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") "
Sep 09 06:13:47.648241 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.648214    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-podinfo\") pod \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") "
Sep 09 06:13:47.648446 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.648244    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-workload-socket\") pod \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\" (UID: \"431656ac-7a14-4ff8-b26b-7f4f8fcc192b\") "
Sep 09 06:13:47.648446 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.648308    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "431656ac-7a14-4ff8-b26b-7f4f8fcc192b" (UID: "431656ac-7a14-4ff8-b26b-7f4f8fcc192b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:13:47.648873 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.648603    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "431656ac-7a14-4ff8-b26b-7f4f8fcc192b" (UID: "431656ac-7a14-4ff8-b26b-7f4f8fcc192b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:13:47.648873 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.648628    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-workload-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:47.648873 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.648759    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "431656ac-7a14-4ff8-b26b-7f4f8fcc192b" (UID: "431656ac-7a14-4ff8-b26b-7f4f8fcc192b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:13:47.649228 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.649200    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-data" (OuterVolumeSpecName: "istio-data") pod "431656ac-7a14-4ff8-b26b-7f4f8fcc192b" (UID: "431656ac-7a14-4ff8-b26b-7f4f8fcc192b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:13:47.649697 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.649667    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "431656ac-7a14-4ff8-b26b-7f4f8fcc192b" (UID: "431656ac-7a14-4ff8-b26b-7f4f8fcc192b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:13:47.651488 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.651454    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "431656ac-7a14-4ff8-b26b-7f4f8fcc192b" (UID: "431656ac-7a14-4ff8-b26b-7f4f8fcc192b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:13:47.652350 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.652309    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-kube-api-access-s8686" (OuterVolumeSpecName: "kube-api-access-s8686") pod "431656ac-7a14-4ff8-b26b-7f4f8fcc192b" (UID: "431656ac-7a14-4ff8-b26b-7f4f8fcc192b"). InnerVolumeSpecName "kube-api-access-s8686". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:13:47.653038 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.652999    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-token" (OuterVolumeSpecName: "istio-token") pod "431656ac-7a14-4ff8-b26b-7f4f8fcc192b" (UID: "431656ac-7a14-4ff8-b26b-7f4f8fcc192b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:13:47.653357 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.653335    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "431656ac-7a14-4ff8-b26b-7f4f8fcc192b" (UID: "431656ac-7a14-4ff8-b26b-7f4f8fcc192b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 06:13:47.749943 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.749913    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8686\" (UniqueName: \"kubernetes.io/projected/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-kube-api-access-s8686\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:47.749943 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.749939    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-token\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:47.749943 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.749948    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-envoy\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:47.750155 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.749957    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:47.750155 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.749965    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istio-podinfo\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:47.750155 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.749973    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-workload-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:47.750155 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.749981    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-istiod-ca-cert\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:47.750155 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:47.749990    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/431656ac-7a14-4ff8-b26b-7f4f8fcc192b-credential-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:48.133817 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:48.133783    2583 generic.go:356] "Generic (PLEG): container finished" podID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerID="5c77c7bcd20c3353485ff4419e10b1ffa80c662031aac949666b1e8217ba738e" exitCode=0
Sep 09 06:13:48.133968 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:48.133838    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"
Sep 09 06:13:48.133968 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:48.133873    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" event={"ID":"431656ac-7a14-4ff8-b26b-7f4f8fcc192b","Type":"ContainerDied","Data":"5c77c7bcd20c3353485ff4419e10b1ffa80c662031aac949666b1e8217ba738e"}
Sep 09 06:13:48.133968 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:48.133943    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q" event={"ID":"431656ac-7a14-4ff8-b26b-7f4f8fcc192b","Type":"ContainerDied","Data":"dcbc115270dd6e93bca091205fe9d623d36991b24f984f90edfde44dbfc5a7a5"}
Sep 09 06:13:48.133968 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:48.133968    2583 scope.go:117] "RemoveContainer" containerID="5c77c7bcd20c3353485ff4419e10b1ffa80c662031aac949666b1e8217ba738e"
Sep 09 06:13:48.143582 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:48.143548    2583 scope.go:117] "RemoveContainer" containerID="79e5771a5cf8cebbf203fb6136543e28487d0813ed8b1d839b9aaffa94fce084"
Sep 09 06:13:48.151503 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:48.151488    2583 scope.go:117] "RemoveContainer" containerID="5c77c7bcd20c3353485ff4419e10b1ffa80c662031aac949666b1e8217ba738e"
Sep 09 06:13:48.151769 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:13:48.151752    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c77c7bcd20c3353485ff4419e10b1ffa80c662031aac949666b1e8217ba738e\": container with ID starting with 5c77c7bcd20c3353485ff4419e10b1ffa80c662031aac949666b1e8217ba738e not found: ID does not exist" containerID="5c77c7bcd20c3353485ff4419e10b1ffa80c662031aac949666b1e8217ba738e"
Sep 09 06:13:48.151815 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:48.151779    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c77c7bcd20c3353485ff4419e10b1ffa80c662031aac949666b1e8217ba738e"} err="failed to get container status \"5c77c7bcd20c3353485ff4419e10b1ffa80c662031aac949666b1e8217ba738e\": rpc error: code = NotFound desc = could not find container \"5c77c7bcd20c3353485ff4419e10b1ffa80c662031aac949666b1e8217ba738e\": container with ID starting with 5c77c7bcd20c3353485ff4419e10b1ffa80c662031aac949666b1e8217ba738e not found: ID does not exist"
Sep 09 06:13:48.151815 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:48.151794    2583 scope.go:117] "RemoveContainer" containerID="79e5771a5cf8cebbf203fb6136543e28487d0813ed8b1d839b9aaffa94fce084"
Sep 09 06:13:48.152023 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:13:48.152008    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79e5771a5cf8cebbf203fb6136543e28487d0813ed8b1d839b9aaffa94fce084\": container with ID starting with 79e5771a5cf8cebbf203fb6136543e28487d0813ed8b1d839b9aaffa94fce084 not found: ID does not exist" containerID="79e5771a5cf8cebbf203fb6136543e28487d0813ed8b1d839b9aaffa94fce084"
Sep 09 06:13:48.152068 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:48.152026    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79e5771a5cf8cebbf203fb6136543e28487d0813ed8b1d839b9aaffa94fce084"} err="failed to get container status \"79e5771a5cf8cebbf203fb6136543e28487d0813ed8b1d839b9aaffa94fce084\": rpc error: code = NotFound desc = could not find container \"79e5771a5cf8cebbf203fb6136543e28487d0813ed8b1d839b9aaffa94fce084\": container with ID starting with 79e5771a5cf8cebbf203fb6136543e28487d0813ed8b1d839b9aaffa94fce084 not found: ID does not exist"
Sep 09 06:13:48.159180 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:48.159157    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"]
Sep 09 06:13:48.164855 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:48.164836    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-43eb2d-openshift-default-cf78fd55b-v9r7q"]
Sep 09 06:13:49.245586 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:49.245519    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" path="/var/lib/kubelet/pods/431656ac-7a14-4ff8-b26b-7f4f8fcc192b/volumes"
Sep 09 06:13:55.107345 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.107313    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:55.128938 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.128908    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"]
Sep 09 06:13:55.129205 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.129141    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx" podUID="fb759c51-b618-47eb-9419-70846992730f" containerName="payload-processing" containerID="cri-o://0aba81c1997bc9cc0f5d69f7fbc4fc7a70f93cff1272899bb9b65f2f6c565f73" gracePeriod=30
Sep 09 06:13:55.138401 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.138375    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"]
Sep 09 06:13:55.138795 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.138750    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp" podUID="62169d01-3a8a-45f4-99bd-dba0aeb2fcb8" containerName="payload-pre-processing" containerID="cri-o://77dec38363349b1bc289ea361f6d03086336497c7209ce3589ff2c952a364a24" gracePeriod=30
Sep 09 06:13:55.187503 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.187404    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:55.317490 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.317464    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:55.418178 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.418146    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:55.436029 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.436004    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"
Sep 09 06:13:55.437972 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.437957    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"
Sep 09 06:13:55.524372 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.524346    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sx4t2\" (UniqueName: \"kubernetes.io/projected/fb759c51-b618-47eb-9419-70846992730f-kube-api-access-sx4t2\") pod \"fb759c51-b618-47eb-9419-70846992730f\" (UID: \"fb759c51-b618-47eb-9419-70846992730f\") "
Sep 09 06:13:55.524551 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.524426    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb759c51-b618-47eb-9419-70846992730f-plugins-config-volume\") pod \"fb759c51-b618-47eb-9419-70846992730f\" (UID: \"fb759c51-b618-47eb-9419-70846992730f\") "
Sep 09 06:13:55.524551 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.524449    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cffwb\" (UniqueName: \"kubernetes.io/projected/62169d01-3a8a-45f4-99bd-dba0aeb2fcb8-kube-api-access-cffwb\") pod \"62169d01-3a8a-45f4-99bd-dba0aeb2fcb8\" (UID: \"62169d01-3a8a-45f4-99bd-dba0aeb2fcb8\") "
Sep 09 06:13:55.524551 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.524521    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62169d01-3a8a-45f4-99bd-dba0aeb2fcb8-plugins-config-volume\") pod \"62169d01-3a8a-45f4-99bd-dba0aeb2fcb8\" (UID: \"62169d01-3a8a-45f4-99bd-dba0aeb2fcb8\") "
Sep 09 06:13:55.524894 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.524858    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb759c51-b618-47eb-9419-70846992730f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fb759c51-b618-47eb-9419-70846992730f" (UID: "fb759c51-b618-47eb-9419-70846992730f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:13:55.524959 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.524943    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62169d01-3a8a-45f4-99bd-dba0aeb2fcb8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "62169d01-3a8a-45f4-99bd-dba0aeb2fcb8" (UID: "62169d01-3a8a-45f4-99bd-dba0aeb2fcb8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:13:55.526633 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.526608    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb759c51-b618-47eb-9419-70846992730f-kube-api-access-sx4t2" (OuterVolumeSpecName: "kube-api-access-sx4t2") pod "fb759c51-b618-47eb-9419-70846992730f" (UID: "fb759c51-b618-47eb-9419-70846992730f"). InnerVolumeSpecName "kube-api-access-sx4t2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:13:55.526695 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.526656    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62169d01-3a8a-45f4-99bd-dba0aeb2fcb8-kube-api-access-cffwb" (OuterVolumeSpecName: "kube-api-access-cffwb") pod "62169d01-3a8a-45f4-99bd-dba0aeb2fcb8" (UID: "62169d01-3a8a-45f4-99bd-dba0aeb2fcb8"). InnerVolumeSpecName "kube-api-access-cffwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:13:55.625600 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.625575    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62169d01-3a8a-45f4-99bd-dba0aeb2fcb8-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:55.625600 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.625599    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx4t2\" (UniqueName: \"kubernetes.io/projected/fb759c51-b618-47eb-9419-70846992730f-kube-api-access-sx4t2\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:55.625740 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.625608    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb759c51-b618-47eb-9419-70846992730f-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:55.625740 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.625617    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cffwb\" (UniqueName: \"kubernetes.io/projected/62169d01-3a8a-45f4-99bd-dba0aeb2fcb8-kube-api-access-cffwb\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:13:55.632756 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:55.632726    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:13:56.184988 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.184953    2583 generic.go:356] "Generic (PLEG): container finished" podID="fb759c51-b618-47eb-9419-70846992730f" containerID="0aba81c1997bc9cc0f5d69f7fbc4fc7a70f93cff1272899bb9b65f2f6c565f73" exitCode=0
Sep 09 06:13:56.185417 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.185000    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"
Sep 09 06:13:56.185417 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.185042    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx" event={"ID":"fb759c51-b618-47eb-9419-70846992730f","Type":"ContainerDied","Data":"0aba81c1997bc9cc0f5d69f7fbc4fc7a70f93cff1272899bb9b65f2f6c565f73"}
Sep 09 06:13:56.185417 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.185099    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx" event={"ID":"fb759c51-b618-47eb-9419-70846992730f","Type":"ContainerDied","Data":"0cfd907b2f006750c9e7b3bf6e3cf08a62dc9b844acecd449f01472989bd80f7"}
Sep 09 06:13:56.185417 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.185125    2583 scope.go:117] "RemoveContainer" containerID="0aba81c1997bc9cc0f5d69f7fbc4fc7a70f93cff1272899bb9b65f2f6c565f73"
Sep 09 06:13:56.186715 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.186694    2583 generic.go:356] "Generic (PLEG): container finished" podID="62169d01-3a8a-45f4-99bd-dba0aeb2fcb8" containerID="77dec38363349b1bc289ea361f6d03086336497c7209ce3589ff2c952a364a24" exitCode=0
Sep 09 06:13:56.186816 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.186736    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"
Sep 09 06:13:56.186861 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.186736    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp" event={"ID":"62169d01-3a8a-45f4-99bd-dba0aeb2fcb8","Type":"ContainerDied","Data":"77dec38363349b1bc289ea361f6d03086336497c7209ce3589ff2c952a364a24"}
Sep 09 06:13:56.186914 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.186869    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp" event={"ID":"62169d01-3a8a-45f4-99bd-dba0aeb2fcb8","Type":"ContainerDied","Data":"1ca1d463fc2d0500324d8defd7a71a5f2375f518235e02b76188f3ea4a75aa99"}
Sep 09 06:13:56.195652 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.195633    2583 scope.go:117] "RemoveContainer" containerID="0aba81c1997bc9cc0f5d69f7fbc4fc7a70f93cff1272899bb9b65f2f6c565f73"
Sep 09 06:13:56.195951 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:13:56.195929    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aba81c1997bc9cc0f5d69f7fbc4fc7a70f93cff1272899bb9b65f2f6c565f73\": container with ID starting with 0aba81c1997bc9cc0f5d69f7fbc4fc7a70f93cff1272899bb9b65f2f6c565f73 not found: ID does not exist" containerID="0aba81c1997bc9cc0f5d69f7fbc4fc7a70f93cff1272899bb9b65f2f6c565f73"
Sep 09 06:13:56.196021 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.195956    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aba81c1997bc9cc0f5d69f7fbc4fc7a70f93cff1272899bb9b65f2f6c565f73"} err="failed to get container status \"0aba81c1997bc9cc0f5d69f7fbc4fc7a70f93cff1272899bb9b65f2f6c565f73\": rpc error: code = NotFound desc = could not find container \"0aba81c1997bc9cc0f5d69f7fbc4fc7a70f93cff1272899bb9b65f2f6c565f73\": container with ID starting with 0aba81c1997bc9cc0f5d69f7fbc4fc7a70f93cff1272899bb9b65f2f6c565f73 not found: ID does not exist"
Sep 09 06:13:56.196021 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.195973    2583 scope.go:117] "RemoveContainer" containerID="77dec38363349b1bc289ea361f6d03086336497c7209ce3589ff2c952a364a24"
Sep 09 06:13:56.204024 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.203997    2583 scope.go:117] "RemoveContainer" containerID="77dec38363349b1bc289ea361f6d03086336497c7209ce3589ff2c952a364a24"
Sep 09 06:13:56.204261 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:13:56.204242    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77dec38363349b1bc289ea361f6d03086336497c7209ce3589ff2c952a364a24\": container with ID starting with 77dec38363349b1bc289ea361f6d03086336497c7209ce3589ff2c952a364a24 not found: ID does not exist" containerID="77dec38363349b1bc289ea361f6d03086336497c7209ce3589ff2c952a364a24"
Sep 09 06:13:56.204307 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.204267    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77dec38363349b1bc289ea361f6d03086336497c7209ce3589ff2c952a364a24"} err="failed to get container status \"77dec38363349b1bc289ea361f6d03086336497c7209ce3589ff2c952a364a24\": rpc error: code = NotFound desc = could not find container \"77dec38363349b1bc289ea361f6d03086336497c7209ce3589ff2c952a364a24\": container with ID starting with 77dec38363349b1bc289ea361f6d03086336497c7209ce3589ff2c952a364a24 not found: ID does not exist"
Sep 09 06:13:56.215607 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.215587    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"]
Sep 09 06:13:56.220920 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.220899    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-f3d736-cc58d86-d5xpp"]
Sep 09 06:13:56.231023 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.231001    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"]
Sep 09 06:13:56.235002 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:56.234984    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-f3d736-5d59bc5fc5-cpmsx"]
Sep 09 06:13:57.244711 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:57.244679    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62169d01-3a8a-45f4-99bd-dba0aeb2fcb8" path="/var/lib/kubelet/pods/62169d01-3a8a-45f4-99bd-dba0aeb2fcb8/volumes"
Sep 09 06:13:57.245084 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:13:57.245030    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb759c51-b618-47eb-9419-70846992730f" path="/var/lib/kubelet/pods/fb759c51-b618-47eb-9419-70846992730f/volumes"
Sep 09 06:14:01.179285 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:01.179222    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:01.273513 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:01.273481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:01.827685 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:01.827650    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:02.842665 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:02.842629    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:02.982234 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:02.982198    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:03.088310 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:03.088279    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:03.238409 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:03.238374    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"]
Sep 09 06:14:03.238736 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:03.238700    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql" podUID="b97e8ea2-b0f8-4c84-9849-d53609a22677" containerName="istio-proxy" containerID="cri-o://b056e16d8d617769fc48d4bdd93eecc2d2c385cac9479fb92420f81d77f77420" gracePeriod=30
Sep 09 06:14:03.264674 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:03.264638    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:03.944268 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:03.944235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:06.709080 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:06.709047    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:08.449081 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.449054    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:08.496754 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.496726    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:14:08.551591 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.551510    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-credential-socket\") pod \"b97e8ea2-b0f8-4c84-9849-d53609a22677\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") "
Sep 09 06:14:08.551591 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.551540    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-workload-socket\") pod \"b97e8ea2-b0f8-4c84-9849-d53609a22677\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") "
Sep 09 06:14:08.551799 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.551599    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-podinfo\") pod \"b97e8ea2-b0f8-4c84-9849-d53609a22677\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") "
Sep 09 06:14:08.551799 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.551633    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-data\") pod \"b97e8ea2-b0f8-4c84-9849-d53609a22677\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") "
Sep 09 06:14:08.551799 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.551694    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b97e8ea2-b0f8-4c84-9849-d53609a22677-istiod-ca-cert\") pod \"b97e8ea2-b0f8-4c84-9849-d53609a22677\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") "
Sep 09 06:14:08.551799 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.551781    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-token\") pod \"b97e8ea2-b0f8-4c84-9849-d53609a22677\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") "
Sep 09 06:14:08.552000 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.551780    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b97e8ea2-b0f8-4c84-9849-d53609a22677" (UID: "b97e8ea2-b0f8-4c84-9849-d53609a22677"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:14:08.552000 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.551835    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll5hd\" (UniqueName: \"kubernetes.io/projected/b97e8ea2-b0f8-4c84-9849-d53609a22677-kube-api-access-ll5hd\") pod \"b97e8ea2-b0f8-4c84-9849-d53609a22677\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") "
Sep 09 06:14:08.552000 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.551865    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-envoy\") pod \"b97e8ea2-b0f8-4c84-9849-d53609a22677\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") "
Sep 09 06:14:08.552000 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.551906    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-workload-certs\") pod \"b97e8ea2-b0f8-4c84-9849-d53609a22677\" (UID: \"b97e8ea2-b0f8-4c84-9849-d53609a22677\") "
Sep 09 06:14:08.552000 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.551936    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b97e8ea2-b0f8-4c84-9849-d53609a22677" (UID: "b97e8ea2-b0f8-4c84-9849-d53609a22677"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:14:08.552289 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.552083    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-data" (OuterVolumeSpecName: "istio-data") pod "b97e8ea2-b0f8-4c84-9849-d53609a22677" (UID: "b97e8ea2-b0f8-4c84-9849-d53609a22677"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:14:08.552289 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.552156    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b97e8ea2-b0f8-4c84-9849-d53609a22677-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b97e8ea2-b0f8-4c84-9849-d53609a22677" (UID: "b97e8ea2-b0f8-4c84-9849-d53609a22677"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:14:08.552402 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.552304    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b97e8ea2-b0f8-4c84-9849-d53609a22677" (UID: "b97e8ea2-b0f8-4c84-9849-d53609a22677"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:14:08.552402 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.552321    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-credential-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:08.552402 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.552343    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-workload-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:08.552402 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.552358    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:08.552402 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.552371    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b97e8ea2-b0f8-4c84-9849-d53609a22677-istiod-ca-cert\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:08.554082 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.554061    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b97e8ea2-b0f8-4c84-9849-d53609a22677-kube-api-access-ll5hd" (OuterVolumeSpecName: "kube-api-access-ll5hd") pod "b97e8ea2-b0f8-4c84-9849-d53609a22677" (UID: "b97e8ea2-b0f8-4c84-9849-d53609a22677"). InnerVolumeSpecName "kube-api-access-ll5hd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:14:08.554701 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.554675    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b97e8ea2-b0f8-4c84-9849-d53609a22677" (UID: "b97e8ea2-b0f8-4c84-9849-d53609a22677"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 06:14:08.554794 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.554696    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b97e8ea2-b0f8-4c84-9849-d53609a22677" (UID: "b97e8ea2-b0f8-4c84-9849-d53609a22677"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:14:08.554794 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.554702    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-token" (OuterVolumeSpecName: "istio-token") pod "b97e8ea2-b0f8-4c84-9849-d53609a22677" (UID: "b97e8ea2-b0f8-4c84-9849-d53609a22677"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:14:08.653278 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.653228    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-token\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:08.653278 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.653258    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll5hd\" (UniqueName: \"kubernetes.io/projected/b97e8ea2-b0f8-4c84-9849-d53609a22677-kube-api-access-ll5hd\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:08.653278 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.653278    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-envoy\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:08.653278 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.653287    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b97e8ea2-b0f8-4c84-9849-d53609a22677-workload-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:08.653698 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:08.653294    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b97e8ea2-b0f8-4c84-9849-d53609a22677-istio-podinfo\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:09.259771 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:09.259742    2583 generic.go:356] "Generic (PLEG): container finished" podID="b97e8ea2-b0f8-4c84-9849-d53609a22677" containerID="b056e16d8d617769fc48d4bdd93eecc2d2c385cac9479fb92420f81d77f77420" exitCode=0
Sep 09 06:14:09.259906 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:09.259779    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql" event={"ID":"b97e8ea2-b0f8-4c84-9849-d53609a22677","Type":"ContainerDied","Data":"b056e16d8d617769fc48d4bdd93eecc2d2c385cac9479fb92420f81d77f77420"}
Sep 09 06:14:09.259906 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:09.259791    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"
Sep 09 06:14:09.259906 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:09.259818    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql" event={"ID":"b97e8ea2-b0f8-4c84-9849-d53609a22677","Type":"ContainerDied","Data":"e84ae12c2b404c514e6c1350094f95078a4c1841c81832ec4346f5d5dc7663ac"}
Sep 09 06:14:09.259906 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:09.259839    2583 scope.go:117] "RemoveContainer" containerID="b056e16d8d617769fc48d4bdd93eecc2d2c385cac9479fb92420f81d77f77420"
Sep 09 06:14:09.268810 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:09.268789    2583 scope.go:117] "RemoveContainer" containerID="ac1c92fefd57bbb95bf9121c70edd19d3daeba1ae24b5438b7e63fcdd1de821d"
Sep 09 06:14:09.277090 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:09.277008    2583 scope.go:117] "RemoveContainer" containerID="b056e16d8d617769fc48d4bdd93eecc2d2c385cac9479fb92420f81d77f77420"
Sep 09 06:14:09.277366 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:14:09.277315    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b056e16d8d617769fc48d4bdd93eecc2d2c385cac9479fb92420f81d77f77420\": container with ID starting with b056e16d8d617769fc48d4bdd93eecc2d2c385cac9479fb92420f81d77f77420 not found: ID does not exist" containerID="b056e16d8d617769fc48d4bdd93eecc2d2c385cac9479fb92420f81d77f77420"
Sep 09 06:14:09.277366 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:09.277352    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b056e16d8d617769fc48d4bdd93eecc2d2c385cac9479fb92420f81d77f77420"} err="failed to get container status \"b056e16d8d617769fc48d4bdd93eecc2d2c385cac9479fb92420f81d77f77420\": rpc error: code = NotFound desc = could not find container \"b056e16d8d617769fc48d4bdd93eecc2d2c385cac9479fb92420f81d77f77420\": container with ID starting with b056e16d8d617769fc48d4bdd93eecc2d2c385cac9479fb92420f81d77f77420 not found: ID does not exist"
Sep 09 06:14:09.277534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:09.277377    2583 scope.go:117] "RemoveContainer" containerID="ac1c92fefd57bbb95bf9121c70edd19d3daeba1ae24b5438b7e63fcdd1de821d"
Sep 09 06:14:09.277736 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:14:09.277709    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac1c92fefd57bbb95bf9121c70edd19d3daeba1ae24b5438b7e63fcdd1de821d\": container with ID starting with ac1c92fefd57bbb95bf9121c70edd19d3daeba1ae24b5438b7e63fcdd1de821d not found: ID does not exist" containerID="ac1c92fefd57bbb95bf9121c70edd19d3daeba1ae24b5438b7e63fcdd1de821d"
Sep 09 06:14:09.277827 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:09.277743    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac1c92fefd57bbb95bf9121c70edd19d3daeba1ae24b5438b7e63fcdd1de821d"} err="failed to get container status \"ac1c92fefd57bbb95bf9121c70edd19d3daeba1ae24b5438b7e63fcdd1de821d\": rpc error: code = NotFound desc = could not find container \"ac1c92fefd57bbb95bf9121c70edd19d3daeba1ae24b5438b7e63fcdd1de821d\": container with ID starting with ac1c92fefd57bbb95bf9121c70edd19d3daeba1ae24b5438b7e63fcdd1de821d not found: ID does not exist"
Sep 09 06:14:09.279407 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:09.279380    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"]
Sep 09 06:14:09.283773 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:09.283753    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-f3d736-openshift-default-78d79f86f6-pqxql"]
Sep 09 06:14:11.244410 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:11.244375    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b97e8ea2-b0f8-4c84-9849-d53609a22677" path="/var/lib/kubelet/pods/b97e8ea2-b0f8-4c84-9849-d53609a22677/volumes"
Sep 09 06:14:13.333926 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:13.333893    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"]
Sep 09 06:14:13.357080 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:13.357044    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:13.727541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:13.727510    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:14.260429 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:14.260401    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:14.395818 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:14.395785    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:14.453543 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:14.453511    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"]
Sep 09 06:14:14.453784 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:14.453740    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx" podUID="c9aea6dc-f22e-4a0a-afe0-702cad86d203" containerName="payload-pre-processing" containerID="cri-o://622ac2ce51711b90c026b4d251de00e0cbb44c44d3585c32a7d73662dbcb9ecb" gracePeriod=30
Sep 09 06:14:14.526393 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:14.526279    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:14.711896 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:14.711864    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"
Sep 09 06:14:14.809127 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:14.809051    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9aea6dc-f22e-4a0a-afe0-702cad86d203-plugins-config-volume\") pod \"c9aea6dc-f22e-4a0a-afe0-702cad86d203\" (UID: \"c9aea6dc-f22e-4a0a-afe0-702cad86d203\") "
Sep 09 06:14:14.809127 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:14.809087    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2v44\" (UniqueName: \"kubernetes.io/projected/c9aea6dc-f22e-4a0a-afe0-702cad86d203-kube-api-access-x2v44\") pod \"c9aea6dc-f22e-4a0a-afe0-702cad86d203\" (UID: \"c9aea6dc-f22e-4a0a-afe0-702cad86d203\") "
Sep 09 06:14:14.809442 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:14.809419    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9aea6dc-f22e-4a0a-afe0-702cad86d203-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c9aea6dc-f22e-4a0a-afe0-702cad86d203" (UID: "c9aea6dc-f22e-4a0a-afe0-702cad86d203"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:14:14.811312 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:14.811290    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9aea6dc-f22e-4a0a-afe0-702cad86d203-kube-api-access-x2v44" (OuterVolumeSpecName: "kube-api-access-x2v44") pod "c9aea6dc-f22e-4a0a-afe0-702cad86d203" (UID: "c9aea6dc-f22e-4a0a-afe0-702cad86d203"). InnerVolumeSpecName "kube-api-access-x2v44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:14:14.910891 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:14.910825    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c9aea6dc-f22e-4a0a-afe0-702cad86d203-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:14.910891 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:14.910865    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2v44\" (UniqueName: \"kubernetes.io/projected/c9aea6dc-f22e-4a0a-afe0-702cad86d203-kube-api-access-x2v44\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:15.291568 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:15.291528    2583 generic.go:356] "Generic (PLEG): container finished" podID="c9aea6dc-f22e-4a0a-afe0-702cad86d203" containerID="622ac2ce51711b90c026b4d251de00e0cbb44c44d3585c32a7d73662dbcb9ecb" exitCode=0
Sep 09 06:14:15.291709 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:15.291587    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"
Sep 09 06:14:15.291709 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:15.291589    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx" event={"ID":"c9aea6dc-f22e-4a0a-afe0-702cad86d203","Type":"ContainerDied","Data":"622ac2ce51711b90c026b4d251de00e0cbb44c44d3585c32a7d73662dbcb9ecb"}
Sep 09 06:14:15.291709 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:15.291644    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx" event={"ID":"c9aea6dc-f22e-4a0a-afe0-702cad86d203","Type":"ContainerDied","Data":"0edd5719cae4b9556bbb77f5ef538596e4d2e13eb629e0e276800b5f0d06a407"}
Sep 09 06:14:15.291709 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:15.291672    2583 scope.go:117] "RemoveContainer" containerID="622ac2ce51711b90c026b4d251de00e0cbb44c44d3585c32a7d73662dbcb9ecb"
Sep 09 06:14:15.300302 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:15.300283    2583 scope.go:117] "RemoveContainer" containerID="622ac2ce51711b90c026b4d251de00e0cbb44c44d3585c32a7d73662dbcb9ecb"
Sep 09 06:14:15.300592 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:14:15.300576    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"622ac2ce51711b90c026b4d251de00e0cbb44c44d3585c32a7d73662dbcb9ecb\": container with ID starting with 622ac2ce51711b90c026b4d251de00e0cbb44c44d3585c32a7d73662dbcb9ecb not found: ID does not exist" containerID="622ac2ce51711b90c026b4d251de00e0cbb44c44d3585c32a7d73662dbcb9ecb"
Sep 09 06:14:15.300654 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:15.300604    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"622ac2ce51711b90c026b4d251de00e0cbb44c44d3585c32a7d73662dbcb9ecb"} err="failed to get container status \"622ac2ce51711b90c026b4d251de00e0cbb44c44d3585c32a7d73662dbcb9ecb\": rpc error: code = NotFound desc = could not find container \"622ac2ce51711b90c026b4d251de00e0cbb44c44d3585c32a7d73662dbcb9ecb\": container with ID starting with 622ac2ce51711b90c026b4d251de00e0cbb44c44d3585c32a7d73662dbcb9ecb not found: ID does not exist"
Sep 09 06:14:15.321907 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:15.321884    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"]
Sep 09 06:14:15.323895 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:15.323878    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-750c68-5b6b6c86-rxpzx"]
Sep 09 06:14:15.469866 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:15.469841    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:15.570396 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:15.570285    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:17.244871 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:17.244837    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9aea6dc-f22e-4a0a-afe0-702cad86d203" path="/var/lib/kubelet/pods/c9aea6dc-f22e-4a0a-afe0-702cad86d203/volumes"
Sep 09 06:14:19.969078 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:19.969037    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:21.395255 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:21.395222    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:21.497320 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:21.497290    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:21.674104 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:21.673990    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:23.677832 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:23.677775    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:28.354343 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.354308    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf" podUID="da8b96bd-91a9-4ace-934c-265acca14b70" containerName="main" containerID="cri-o://3d4d640140a1ca517b1e61a2f0890d17b6aa5d7791a27d37a8d91fd9a8fb18a9" gracePeriod=45
Sep 09 06:14:28.609858 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.609796    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:14:28.742100 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.742072    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-model-cache\") pod \"da8b96bd-91a9-4ace-934c-265acca14b70\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") "
Sep 09 06:14:28.742286 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.742108    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-home\") pod \"da8b96bd-91a9-4ace-934c-265acca14b70\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") "
Sep 09 06:14:28.742286 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.742140    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-dshm\") pod \"da8b96bd-91a9-4ace-934c-265acca14b70\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") "
Sep 09 06:14:28.742286 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.742197    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8b96bd-91a9-4ace-934c-265acca14b70-tls-certs\") pod \"da8b96bd-91a9-4ace-934c-265acca14b70\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") "
Sep 09 06:14:28.742286 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.742224    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4m2jq\" (UniqueName: \"kubernetes.io/projected/da8b96bd-91a9-4ace-934c-265acca14b70-kube-api-access-4m2jq\") pod \"da8b96bd-91a9-4ace-934c-265acca14b70\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") "
Sep 09 06:14:28.742286 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.742258    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-tmp-dir\") pod \"da8b96bd-91a9-4ace-934c-265acca14b70\" (UID: \"da8b96bd-91a9-4ace-934c-265acca14b70\") "
Sep 09 06:14:28.742582 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.742333    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-model-cache" (OuterVolumeSpecName: "model-cache") pod "da8b96bd-91a9-4ace-934c-265acca14b70" (UID: "da8b96bd-91a9-4ace-934c-265acca14b70"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:14:28.742582 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.742365    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-home" (OuterVolumeSpecName: "home") pod "da8b96bd-91a9-4ace-934c-265acca14b70" (UID: "da8b96bd-91a9-4ace-934c-265acca14b70"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:14:28.742582 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.742529    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "da8b96bd-91a9-4ace-934c-265acca14b70" (UID: "da8b96bd-91a9-4ace-934c-265acca14b70"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:14:28.742702 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.742644    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-tmp-dir\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:28.742702 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.742663    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-model-cache\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:28.742702 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.742677    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-home\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:28.744597 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.744574    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-dshm" (OuterVolumeSpecName: "dshm") pod "da8b96bd-91a9-4ace-934c-265acca14b70" (UID: "da8b96bd-91a9-4ace-934c-265acca14b70"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:14:28.744740 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.744719    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da8b96bd-91a9-4ace-934c-265acca14b70-kube-api-access-4m2jq" (OuterVolumeSpecName: "kube-api-access-4m2jq") pod "da8b96bd-91a9-4ace-934c-265acca14b70" (UID: "da8b96bd-91a9-4ace-934c-265acca14b70"). InnerVolumeSpecName "kube-api-access-4m2jq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:14:28.744784 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.744717    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da8b96bd-91a9-4ace-934c-265acca14b70-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "da8b96bd-91a9-4ace-934c-265acca14b70" (UID: "da8b96bd-91a9-4ace-934c-265acca14b70"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 06:14:28.844065 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.844035    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da8b96bd-91a9-4ace-934c-265acca14b70-tls-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:28.844065 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.844064    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4m2jq\" (UniqueName: \"kubernetes.io/projected/da8b96bd-91a9-4ace-934c-265acca14b70-kube-api-access-4m2jq\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:28.844339 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:28.844075    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da8b96bd-91a9-4ace-934c-265acca14b70-dshm\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:14:29.363013 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:29.362978    2583 generic.go:356] "Generic (PLEG): container finished" podID="da8b96bd-91a9-4ace-934c-265acca14b70" containerID="3d4d640140a1ca517b1e61a2f0890d17b6aa5d7791a27d37a8d91fd9a8fb18a9" exitCode=0
Sep 09 06:14:29.363435 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:29.363034    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"
Sep 09 06:14:29.363435 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:29.363065    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf" event={"ID":"da8b96bd-91a9-4ace-934c-265acca14b70","Type":"ContainerDied","Data":"3d4d640140a1ca517b1e61a2f0890d17b6aa5d7791a27d37a8d91fd9a8fb18a9"}
Sep 09 06:14:29.363435 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:29.363111    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf" event={"ID":"da8b96bd-91a9-4ace-934c-265acca14b70","Type":"ContainerDied","Data":"ef60e8054daeddad7f1e219011dc57ef8cc37266bf8e879d261bed9ba3e37b34"}
Sep 09 06:14:29.363435 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:29.363129    2583 scope.go:117] "RemoveContainer" containerID="3d4d640140a1ca517b1e61a2f0890d17b6aa5d7791a27d37a8d91fd9a8fb18a9"
Sep 09 06:14:29.371681 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:29.371549    2583 scope.go:117] "RemoveContainer" containerID="3d4d640140a1ca517b1e61a2f0890d17b6aa5d7791a27d37a8d91fd9a8fb18a9"
Sep 09 06:14:29.371943 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:14:29.371925    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d4d640140a1ca517b1e61a2f0890d17b6aa5d7791a27d37a8d91fd9a8fb18a9\": container with ID starting with 3d4d640140a1ca517b1e61a2f0890d17b6aa5d7791a27d37a8d91fd9a8fb18a9 not found: ID does not exist" containerID="3d4d640140a1ca517b1e61a2f0890d17b6aa5d7791a27d37a8d91fd9a8fb18a9"
Sep 09 06:14:29.372010 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:29.371952    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d4d640140a1ca517b1e61a2f0890d17b6aa5d7791a27d37a8d91fd9a8fb18a9"} err="failed to get container status \"3d4d640140a1ca517b1e61a2f0890d17b6aa5d7791a27d37a8d91fd9a8fb18a9\": rpc error: code = NotFound desc = could not find container \"3d4d640140a1ca517b1e61a2f0890d17b6aa5d7791a27d37a8d91fd9a8fb18a9\": container with ID starting with 3d4d640140a1ca517b1e61a2f0890d17b6aa5d7791a27d37a8d91fd9a8fb18a9 not found: ID does not exist"
Sep 09 06:14:29.381209 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:29.381179    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"]
Sep 09 06:14:29.384849 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:29.384824    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-6b5d89/auth-test-model-6b5d89-kserve-86cb75cfd7-qspxf"]
Sep 09 06:14:31.245157 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:31.245109    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da8b96bd-91a9-4ace-934c-265acca14b70" path="/var/lib/kubelet/pods/da8b96bd-91a9-4ace-934c-265acca14b70/volumes"
Sep 09 06:14:34.367652 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:34.367625    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:14:55.048742 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:14:55.048707    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:15:00.137839 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.137801    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7cf6be-29815575-r5nxv"]
Sep 09 06:15:00.138282 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138221    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efad91d5-7d39-4f6e-8ca1-09a57b2efd7d" containerName="maas-api"
Sep 09 06:15:00.138282 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138232    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="efad91d5-7d39-4f6e-8ca1-09a57b2efd7d" containerName="maas-api"
Sep 09 06:15:00.138282 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138245    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62169d01-3a8a-45f4-99bd-dba0aeb2fcb8" containerName="payload-pre-processing"
Sep 09 06:15:00.138282 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138251    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="62169d01-3a8a-45f4-99bd-dba0aeb2fcb8" containerName="payload-pre-processing"
Sep 09 06:15:00.138282 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138257    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b97e8ea2-b0f8-4c84-9849-d53609a22677" containerName="istio-proxy"
Sep 09 06:15:00.138282 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138263    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b97e8ea2-b0f8-4c84-9849-d53609a22677" containerName="istio-proxy"
Sep 09 06:15:00.138282 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138275    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerName="istio-proxy"
Sep 09 06:15:00.138282 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138280    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerName="istio-proxy"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138289    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="119b5a91-4c98-4529-9844-e01694823a3c" containerName="payload-pre-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138294    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="119b5a91-4c98-4529-9844-e01694823a3c" containerName="payload-pre-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138302    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac756985-7b1f-4973-8eb5-4e4083ff7fac" containerName="payload-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138307    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac756985-7b1f-4973-8eb5-4e4083ff7fac" containerName="payload-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138314    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da8b96bd-91a9-4ace-934c-265acca14b70" containerName="main"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138319    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="da8b96bd-91a9-4ace-934c-265acca14b70" containerName="main"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138328    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b97e8ea2-b0f8-4c84-9849-d53609a22677" containerName="istio-proxy"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138333    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b97e8ea2-b0f8-4c84-9849-d53609a22677" containerName="istio-proxy"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138342    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb759c51-b618-47eb-9419-70846992730f" containerName="payload-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138348    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb759c51-b618-47eb-9419-70846992730f" containerName="payload-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138354    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9aea6dc-f22e-4a0a-afe0-702cad86d203" containerName="payload-pre-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138359    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9aea6dc-f22e-4a0a-afe0-702cad86d203" containerName="payload-pre-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138366    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57be429a-14f7-4682-bd48-8da3232350bd" containerName="payload-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138371    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="57be429a-14f7-4682-bd48-8da3232350bd" containerName="payload-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138440    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerName="istio-proxy"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138446    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb759c51-b618-47eb-9419-70846992730f" containerName="payload-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138451    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac756985-7b1f-4973-8eb5-4e4083ff7fac" containerName="payload-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138458    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="da8b96bd-91a9-4ace-934c-265acca14b70" containerName="main"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138464    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="57be429a-14f7-4682-bd48-8da3232350bd" containerName="payload-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138469    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="efad91d5-7d39-4f6e-8ca1-09a57b2efd7d" containerName="maas-api"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138474    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b97e8ea2-b0f8-4c84-9849-d53609a22677" containerName="istio-proxy"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138481    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="62169d01-3a8a-45f4-99bd-dba0aeb2fcb8" containerName="payload-pre-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138487    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9aea6dc-f22e-4a0a-afe0-702cad86d203" containerName="payload-pre-processing"
Sep 09 06:15:00.138541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.138492    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="119b5a91-4c98-4529-9844-e01694823a3c" containerName="payload-pre-processing"
Sep 09 06:15:00.143206 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.143184    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7cf6be-29815575-r5nxv"
Sep 09 06:15:00.145634 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.145603    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ksjk6\""
Sep 09 06:15:00.150128 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.150100    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7cf6be-29815575-r5nxv"]
Sep 09 06:15:00.156965 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.156941    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7cf6be-29815575-r5nxv"
Sep 09 06:15:00.428862 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.428519    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7cf6be-29815575-r5nxv"]
Sep 09 06:15:00.431597 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:15:00.431567    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125d4524_8a01_4d3d_b3cc_59d4c36a89a1.slice/crio-dd6126963e436f5433c45a56e9651c0ff16696575c9014b5e1aa16e947f680dd WatchSource:0}: Error finding container dd6126963e436f5433c45a56e9651c0ff16696575c9014b5e1aa16e947f680dd: Status 404 returned error can't find the container with id dd6126963e436f5433c45a56e9651c0ff16696575c9014b5e1aa16e947f680dd
Sep 09 06:15:00.433717 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.433698    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 06:15:00.520463 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:00.520432    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7cf6be-29815575-r5nxv" event={"ID":"125d4524-8a01-4d3d-b3cc-59d4c36a89a1","Type":"ContainerStarted","Data":"dd6126963e436f5433c45a56e9651c0ff16696575c9014b5e1aa16e947f680dd"}
Sep 09 06:15:03.547692 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:03.547655    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7cf6be-29815575-r5nxv" event={"ID":"125d4524-8a01-4d3d-b3cc-59d4c36a89a1","Type":"ContainerStarted","Data":"5ae423271ffc6887405d2332e1d27b3c7b2afd49cf51fd1201b61e50288b9cd3"}
Sep 09 06:15:03.563886 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:03.563838    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7cf6be-29815575-r5nxv" podStartSLOduration=1.355448134 podStartE2EDuration="3.563823939s" totalImagesPullingTime="2.208375805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:15:03.562155459 +0000 UTC m=+1524.792652013" watchObservedRunningTime="2026-09-09 06:15:03.563823939 +0000 UTC m=+1524.794320491"
Sep 09 06:15:04.554182 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:04.554141    2583 generic.go:356] "Generic (PLEG): container finished" podID="125d4524-8a01-4d3d-b3cc-59d4c36a89a1" containerID="5ae423271ffc6887405d2332e1d27b3c7b2afd49cf51fd1201b61e50288b9cd3" exitCode=0
Sep 09 06:15:04.554603 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:04.554219    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7cf6be-29815575-r5nxv" event={"ID":"125d4524-8a01-4d3d-b3cc-59d4c36a89a1","Type":"ContainerDied","Data":"5ae423271ffc6887405d2332e1d27b3c7b2afd49cf51fd1201b61e50288b9cd3"}
Sep 09 06:15:05.700228 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:05.700207    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7cf6be-29815575-r5nxv"
Sep 09 06:15:06.565120 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:06.565086    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7cf6be-29815575-r5nxv"
Sep 09 06:15:06.565303 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:06.565118    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7cf6be-29815575-r5nxv" event={"ID":"125d4524-8a01-4d3d-b3cc-59d4c36a89a1","Type":"ContainerDied","Data":"dd6126963e436f5433c45a56e9651c0ff16696575c9014b5e1aa16e947f680dd"}
Sep 09 06:15:06.565303 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:06.565166    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd6126963e436f5433c45a56e9651c0ff16696575c9014b5e1aa16e947f680dd"
Sep 09 06:15:14.579689 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:14.579655    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:15:30.461704 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:30.461672    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:15:31.361172 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:31.361139    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:15:37.361697 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:37.361663    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:15:47.565206 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:15:47.565170    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:16:09.146627 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:09.146588    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:16:45.088096 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:45.088023    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:16:46.136293 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.136263    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:16:46.550261 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.550174    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:16:46.824263 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.824170    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"]
Sep 09 06:16:46.824677 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.824657    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerName="istio-proxy"
Sep 09 06:16:46.824677 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.824678    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerName="istio-proxy"
Sep 09 06:16:46.824837 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.824726    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125d4524-8a01-4d3d-b3cc-59d4c36a89a1" containerName="cleanup"
Sep 09 06:16:46.824837 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.824736    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="125d4524-8a01-4d3d-b3cc-59d4c36a89a1" containerName="cleanup"
Sep 09 06:16:46.824837 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.824834    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="125d4524-8a01-4d3d-b3cc-59d4c36a89a1" containerName="cleanup"
Sep 09 06:16:46.824990 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.824846    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b97e8ea2-b0f8-4c84-9849-d53609a22677" containerName="istio-proxy"
Sep 09 06:16:46.824990 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.824860    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="431656ac-7a14-4ff8-b26b-7f4f8fcc192b" containerName="istio-proxy"
Sep 09 06:16:46.828083 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.828063    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:46.830587 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.830568    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-8a6cf7-openshift-default-dockercfg-cdn9f\""
Sep 09 06:16:46.842108 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.842086    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"]
Sep 09 06:16:46.847418 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.847381    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:16:46.919465 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.919436    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:16:46.920662 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.920643    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-data\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:46.920726 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.920670    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-podinfo\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:46.920726 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.920690    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-workload-certs\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:46.920726 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.920710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-workload-socket\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:46.920844 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.920777    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-credential-socket\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:46.920844 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.920807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-token\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:46.920844 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.920831    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-envoy\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:46.920953 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.920870    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/239fed21-105c-4ea4-9f74-a75ff2ac3598-istiod-ca-cert\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:46.920953 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:46.920929    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc9x7\" (UniqueName: \"kubernetes.io/projected/239fed21-105c-4ea4-9f74-a75ff2ac3598-kube-api-access-bc9x7\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.021689 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.021658    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-credential-socket\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.021892 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.021705    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-token\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.021892 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.021835    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-envoy\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.022017 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.021903    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/239fed21-105c-4ea4-9f74-a75ff2ac3598-istiod-ca-cert\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.022017 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.021961    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc9x7\" (UniqueName: \"kubernetes.io/projected/239fed21-105c-4ea4-9f74-a75ff2ac3598-kube-api-access-bc9x7\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.022017 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.021986    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-data\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.022017 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.022013    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-podinfo\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.022237 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.022043    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-workload-certs\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.022237 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.022074    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-credential-socket\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.022237 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.022079    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-workload-socket\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.022454 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.022430    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-data\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.022613 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.022452    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-workload-certs\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.022613 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.022496    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-workload-socket\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.022827 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.022807    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/239fed21-105c-4ea4-9f74-a75ff2ac3598-istiod-ca-cert\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.024405 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.024380    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-envoy\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.024542 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.024520    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-podinfo\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.030026 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.030005    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-token\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.030176 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.030158    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc9x7\" (UniqueName: \"kubernetes.io/projected/239fed21-105c-4ea4-9f74-a75ff2ac3598-kube-api-access-bc9x7\") pod \"e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") " pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.139510 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.139471    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:47.420349 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.420087    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"]
Sep 09 06:16:47.424949 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:16:47.424923    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239fed21_105c_4ea4_9f74_a75ff2ac3598.slice/crio-a1ddf26c8265789320e4ca6e40f6ff11ea36352d745c1198b6361306430e8a34 WatchSource:0}: Error finding container a1ddf26c8265789320e4ca6e40f6ff11ea36352d745c1198b6361306430e8a34: Status 404 returned error can't find the container with id a1ddf26c8265789320e4ca6e40f6ff11ea36352d745c1198b6361306430e8a34
Sep 09 06:16:47.427420 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.427389    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:16:47.427522 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.427466    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:16:47.427522 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:47.427509    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:16:48.076585 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:48.076517    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp" event={"ID":"239fed21-105c-4ea4-9f74-a75ff2ac3598","Type":"ContainerStarted","Data":"30e2bed0c6f88f5bcd7641e27bf116ffd56d98399544cb87d6cdb560d9d1a786"}
Sep 09 06:16:48.076775 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:48.076608    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp" event={"ID":"239fed21-105c-4ea4-9f74-a75ff2ac3598","Type":"ContainerStarted","Data":"a1ddf26c8265789320e4ca6e40f6ff11ea36352d745c1198b6361306430e8a34"}
Sep 09 06:16:48.096852 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:48.096799    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp" podStartSLOduration=2.09677687 podStartE2EDuration="2.09677687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:16:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:16:48.094338979 +0000 UTC m=+1629.324835532" watchObservedRunningTime="2026-09-09 06:16:48.09677687 +0000 UTC m=+1629.327273413"
Sep 09 06:16:48.140419 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:48.140391    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:48.145608 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:48.145582    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:49.081969 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:49.081933    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:49.082950 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:49.082929    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:16:49.973656 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:49.973609    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:16:50.065337 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:50.065288    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:16:51.321401 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:51.321365    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:16:51.422836 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:51.422797    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:16:51.475130 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:51.475098    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:16:51.781901 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:51.781864    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:16:51.890119 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:51.890088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:16:51.929070 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:51.929037    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"]
Sep 09 06:16:51.933164 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:51.933135    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"
Sep 09 06:16:51.935637 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:51.935617    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-8a6cf7-dockercfg-2hx6j\""
Sep 09 06:16:51.935764 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:51.935639    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-8a6cf7\""
Sep 09 06:16:51.943582 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:51.943534    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"]
Sep 09 06:16:51.971339 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:51.971306    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q8hl\" (UniqueName: \"kubernetes.io/projected/8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0-kube-api-access-9q8hl\") pod \"payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm\" (UID: \"8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"
Sep 09 06:16:51.971476 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:51.971417    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm\" (UID: \"8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"
Sep 09 06:16:52.072380 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:52.072279    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q8hl\" (UniqueName: \"kubernetes.io/projected/8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0-kube-api-access-9q8hl\") pod \"payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm\" (UID: \"8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"
Sep 09 06:16:52.072380 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:52.072340    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm\" (UID: \"8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"
Sep 09 06:16:52.073107 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:52.073085    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm\" (UID: \"8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"
Sep 09 06:16:52.080520 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:52.080490    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q8hl\" (UniqueName: \"kubernetes.io/projected/8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0-kube-api-access-9q8hl\") pod \"payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm\" (UID: \"8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"
Sep 09 06:16:52.244629 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:52.244596    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"
Sep 09 06:16:52.516782 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:52.516759    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"]
Sep 09 06:16:52.518891 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:16:52.518864    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9adb7c_85d8_45ba_9a9f_b7a0cd16e8d0.slice/crio-87e62f9ff25499927e479dfbf5de011ac0f6aa98ce8d66b8a219055cd5062ac5 WatchSource:0}: Error finding container 87e62f9ff25499927e479dfbf5de011ac0f6aa98ce8d66b8a219055cd5062ac5: Status 404 returned error can't find the container with id 87e62f9ff25499927e479dfbf5de011ac0f6aa98ce8d66b8a219055cd5062ac5
Sep 09 06:16:53.105697 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:53.105663    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm" event={"ID":"8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0","Type":"ContainerStarted","Data":"e20c94eb3915c05ac325be279caebbd40c7bbd589e0b3a3bf054540fc8bc85a0"}
Sep 09 06:16:53.105884 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:53.105720    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm" event={"ID":"8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0","Type":"ContainerStarted","Data":"87e62f9ff25499927e479dfbf5de011ac0f6aa98ce8d66b8a219055cd5062ac5"}
Sep 09 06:16:53.105884 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:53.105753    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"
Sep 09 06:16:53.122360 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:16:53.122306    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm" podStartSLOduration=2.122286551 podStartE2EDuration="2.122286551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:16:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:16:53.121105163 +0000 UTC m=+1634.351601726" watchObservedRunningTime="2026-09-09 06:16:53.122286551 +0000 UTC m=+1634.352783105"
Sep 09 06:17:04.083240 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:04.083200    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 09 06:17:04.083626 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:04.083274    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp" podUID="239fed21-105c-4ea4-9f74-a75ff2ac3598" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 09 06:17:04.112694 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:04.112661    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"
Sep 09 06:17:04.165243 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:04.165202    2583 generic.go:356] "Generic (PLEG): container finished" podID="239fed21-105c-4ea4-9f74-a75ff2ac3598" containerID="30e2bed0c6f88f5bcd7641e27bf116ffd56d98399544cb87d6cdb560d9d1a786" exitCode=0
Sep 09 06:17:04.165395 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:04.165264    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp" event={"ID":"239fed21-105c-4ea4-9f74-a75ff2ac3598","Type":"ContainerDied","Data":"30e2bed0c6f88f5bcd7641e27bf116ffd56d98399544cb87d6cdb560d9d1a786"}
Sep 09 06:17:04.165684 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:04.165668    2583 scope.go:117] "RemoveContainer" containerID="30e2bed0c6f88f5bcd7641e27bf116ffd56d98399544cb87d6cdb560d9d1a786"
Sep 09 06:17:04.166733 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:04.166705    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:17:04.166823 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:04.166770    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:17:04.166823 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:04.166804    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 09 06:17:05.172652 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:05.172605    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp" event={"ID":"239fed21-105c-4ea4-9f74-a75ff2ac3598","Type":"ContainerStarted","Data":"0807142a556b923a45dfdaec3cba6d5e5e11654b3143336988c9b90b7cdd778b"}
Sep 09 06:17:06.140700 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:06.140664    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:17:06.140883 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:06.140832    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 09 06:17:06.140929 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:06.140905    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp" podUID="239fed21-105c-4ea4-9f74-a75ff2ac3598" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 09 06:17:07.140670 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:07.140635    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 09 06:17:07.141019 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:07.140699    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp" podUID="239fed21-105c-4ea4-9f74-a75ff2ac3598" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 09 06:17:08.140259 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:08.140222    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 09 06:17:08.140448 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:08.140288    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp" podUID="239fed21-105c-4ea4-9f74-a75ff2ac3598" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 09 06:17:09.140042 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:09.140001    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 09 06:17:09.140423 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:09.140065    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp" podUID="239fed21-105c-4ea4-9f74-a75ff2ac3598" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 09 06:17:10.145534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:10.145497    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:17:10.145966 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:10.145869    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:17:10.146589 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:10.146569    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:17:14.957937 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:14.957904    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:17:15.601439 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:15.601409    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:17:15.892465 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:15.892424    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:17:16.545780 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:16.545735    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:17:18.627761 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:18.627726    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:17:18.726741 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:18.726709    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:17:19.796193 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:19.796162    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:17:19.896915 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:19.896870    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:17:20.001469 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.001434    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:17:20.271587 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.271533    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:17:20.368804 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.368762    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:17:20.398745 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.398681    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"]
Sep 09 06:17:20.401386 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.401360    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"
Sep 09 06:17:20.403931 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.403909    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-32ea4d\""
Sep 09 06:17:20.404033 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.403918    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-32ea4d-dockercfg-cpcjh\""
Sep 09 06:17:20.413123 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.413101    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"]
Sep 09 06:17:20.554539 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.554445    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdzj6\" (UniqueName: \"kubernetes.io/projected/080acac7-3408-43f5-a9f2-9fe606d7570b-kube-api-access-sdzj6\") pod \"payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj\" (UID: \"080acac7-3408-43f5-a9f2-9fe606d7570b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"
Sep 09 06:17:20.554539 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.554499    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/080acac7-3408-43f5-a9f2-9fe606d7570b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj\" (UID: \"080acac7-3408-43f5-a9f2-9fe606d7570b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"
Sep 09 06:17:20.655091 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.655050    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdzj6\" (UniqueName: \"kubernetes.io/projected/080acac7-3408-43f5-a9f2-9fe606d7570b-kube-api-access-sdzj6\") pod \"payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj\" (UID: \"080acac7-3408-43f5-a9f2-9fe606d7570b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"
Sep 09 06:17:20.655259 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.655103    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/080acac7-3408-43f5-a9f2-9fe606d7570b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj\" (UID: \"080acac7-3408-43f5-a9f2-9fe606d7570b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"
Sep 09 06:17:20.656073 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.656047    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/080acac7-3408-43f5-a9f2-9fe606d7570b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj\" (UID: \"080acac7-3408-43f5-a9f2-9fe606d7570b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"
Sep 09 06:17:20.662447 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.662417    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdzj6\" (UniqueName: \"kubernetes.io/projected/080acac7-3408-43f5-a9f2-9fe606d7570b-kube-api-access-sdzj6\") pod \"payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj\" (UID: \"080acac7-3408-43f5-a9f2-9fe606d7570b\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"
Sep 09 06:17:20.714278 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.714249    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"
Sep 09 06:17:20.986513 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:20.986487    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"]
Sep 09 06:17:20.988363 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:17:20.988338    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod080acac7_3408_43f5_a9f2_9fe606d7570b.slice/crio-a3f5f8ba1e63482bd5107c80ea3a78ac467fdc0b5c4f3581500e90eb6687ac81 WatchSource:0}: Error finding container a3f5f8ba1e63482bd5107c80ea3a78ac467fdc0b5c4f3581500e90eb6687ac81: Status 404 returned error can't find the container with id a3f5f8ba1e63482bd5107c80ea3a78ac467fdc0b5c4f3581500e90eb6687ac81
Sep 09 06:17:21.265160 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:21.265084    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj" event={"ID":"080acac7-3408-43f5-a9f2-9fe606d7570b","Type":"ContainerStarted","Data":"99c4b8b8cd110465958bd896718b350bf1023b82cf11c418ca9666c2cf4fe5c7"}
Sep 09 06:17:21.265160 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:21.265135    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj" event={"ID":"080acac7-3408-43f5-a9f2-9fe606d7570b","Type":"ContainerStarted","Data":"a3f5f8ba1e63482bd5107c80ea3a78ac467fdc0b5c4f3581500e90eb6687ac81"}
Sep 09 06:17:21.265348 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:21.265166    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"
Sep 09 06:17:21.282771 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:21.282714    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj" podStartSLOduration=1.282694642 podStartE2EDuration="1.282694642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:17:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:17:21.279921382 +0000 UTC m=+1662.510417935" watchObservedRunningTime="2026-09-09 06:17:21.282694642 +0000 UTC m=+1662.513191195"
Sep 09 06:17:32.272613 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:32.272546    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"
Sep 09 06:17:36.845216 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:36.845184    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:17:43.613378 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:43.613339    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:17:48.524934 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:48.524899    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-db5d6_6a7d70d1-9372-4b20-a1c2-d1042e2d0053/payload-processing/0.log"
Sep 09 06:17:48.639011 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:48.638984    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj_080acac7-3408-43f5-a9f2-9fe606d7570b/payload-processing/0.log"
Sep 09 06:17:57.471919 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:17:57.471885    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:24.364420 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:24.364380    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm_8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0/payload-processing/0.log"
Sep 09 06:18:24.477385 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:24.477346    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-db5d6_6a7d70d1-9372-4b20-a1c2-d1042e2d0053/payload-processing/0.log"
Sep 09 06:18:24.598068 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:24.598039    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj_080acac7-3408-43f5-a9f2-9fe606d7570b/payload-processing/0.log"
Sep 09 06:18:24.860320 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:24.860285    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:25.266512 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:25.266474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:25.566668 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:25.566579    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:28.056494 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:28.056459    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:28.157796 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:28.157760    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:29.183458 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.183424    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:29.284785 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.284745    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:29.430265 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.430233    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:29.647285 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.647252    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:29.747190 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.747160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:29.755422 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.755386    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"]
Sep 09 06:18:29.758174 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.758158    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"
Sep 09 06:18:29.760650 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.760630    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-2e28ff\""
Sep 09 06:18:29.760764 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.760686    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-2e28ff-dockercfg-9lpv2\""
Sep 09 06:18:29.772279 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.772254    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"]
Sep 09 06:18:29.774214 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.774192    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"]
Sep 09 06:18:29.786218 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.786189    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"
Sep 09 06:18:29.792078 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.792051    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"]
Sep 09 06:18:29.923235 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.923144    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7whnk\" (UniqueName: \"kubernetes.io/projected/756f3604-9f87-4d1c-811f-a7f29bde5910-kube-api-access-7whnk\") pod \"payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94\" (UID: \"756f3604-9f87-4d1c-811f-a7f29bde5910\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"
Sep 09 06:18:29.923235 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.923231    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/756f3604-9f87-4d1c-811f-a7f29bde5910-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94\" (UID: \"756f3604-9f87-4d1c-811f-a7f29bde5910\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"
Sep 09 06:18:29.923419 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.923251    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/422f1c34-0d33-4218-9047-07f6fd1044d4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd\" (UID: \"422f1c34-0d33-4218-9047-07f6fd1044d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"
Sep 09 06:18:29.923419 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:29.923345    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhgxc\" (UniqueName: \"kubernetes.io/projected/422f1c34-0d33-4218-9047-07f6fd1044d4-kube-api-access-mhgxc\") pod \"payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd\" (UID: \"422f1c34-0d33-4218-9047-07f6fd1044d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"
Sep 09 06:18:30.024084 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.024047    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/422f1c34-0d33-4218-9047-07f6fd1044d4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd\" (UID: \"422f1c34-0d33-4218-9047-07f6fd1044d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"
Sep 09 06:18:30.024269 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.024158    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhgxc\" (UniqueName: \"kubernetes.io/projected/422f1c34-0d33-4218-9047-07f6fd1044d4-kube-api-access-mhgxc\") pod \"payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd\" (UID: \"422f1c34-0d33-4218-9047-07f6fd1044d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"
Sep 09 06:18:30.024269 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.024190    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7whnk\" (UniqueName: \"kubernetes.io/projected/756f3604-9f87-4d1c-811f-a7f29bde5910-kube-api-access-7whnk\") pod \"payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94\" (UID: \"756f3604-9f87-4d1c-811f-a7f29bde5910\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"
Sep 09 06:18:30.024269 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.024265    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/756f3604-9f87-4d1c-811f-a7f29bde5910-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94\" (UID: \"756f3604-9f87-4d1c-811f-a7f29bde5910\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"
Sep 09 06:18:30.024933 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.024912    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/422f1c34-0d33-4218-9047-07f6fd1044d4-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd\" (UID: \"422f1c34-0d33-4218-9047-07f6fd1044d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"
Sep 09 06:18:30.025009 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.024990    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/756f3604-9f87-4d1c-811f-a7f29bde5910-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94\" (UID: \"756f3604-9f87-4d1c-811f-a7f29bde5910\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"
Sep 09 06:18:30.033842 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.033814    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhgxc\" (UniqueName: \"kubernetes.io/projected/422f1c34-0d33-4218-9047-07f6fd1044d4-kube-api-access-mhgxc\") pod \"payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd\" (UID: \"422f1c34-0d33-4218-9047-07f6fd1044d4\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"
Sep 09 06:18:30.033842 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.033830    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7whnk\" (UniqueName: \"kubernetes.io/projected/756f3604-9f87-4d1c-811f-a7f29bde5910-kube-api-access-7whnk\") pod \"payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94\" (UID: \"756f3604-9f87-4d1c-811f-a7f29bde5910\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"
Sep 09 06:18:30.069749 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.069715    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"
Sep 09 06:18:30.099145 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.099112    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"
Sep 09 06:18:30.345697 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.345670    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"]
Sep 09 06:18:30.348063 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:18:30.348037    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod422f1c34_0d33_4218_9047_07f6fd1044d4.slice/crio-f2f7ecb57329a9919addfca3f691cb72794530d565307c56be54ec00270261fe WatchSource:0}: Error finding container f2f7ecb57329a9919addfca3f691cb72794530d565307c56be54ec00270261fe: Status 404 returned error can't find the container with id f2f7ecb57329a9919addfca3f691cb72794530d565307c56be54ec00270261fe
Sep 09 06:18:30.384154 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.384128    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"]
Sep 09 06:18:30.394718 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:18:30.394694    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod756f3604_9f87_4d1c_811f_a7f29bde5910.slice/crio-4cb007169b13a5d1f3e0369f17bfd5b71458336fdfe55b3d9eb3dbda01735c0a WatchSource:0}: Error finding container 4cb007169b13a5d1f3e0369f17bfd5b71458336fdfe55b3d9eb3dbda01735c0a: Status 404 returned error can't find the container with id 4cb007169b13a5d1f3e0369f17bfd5b71458336fdfe55b3d9eb3dbda01735c0a
Sep 09 06:18:30.627995 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.627962    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd" event={"ID":"422f1c34-0d33-4218-9047-07f6fd1044d4","Type":"ContainerStarted","Data":"534053784ef112040c3bcaa13af4e49b82cbcbb2fcf592816f2ce55b37d54681"}
Sep 09 06:18:30.628148 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.628023    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd" event={"ID":"422f1c34-0d33-4218-9047-07f6fd1044d4","Type":"ContainerStarted","Data":"f2f7ecb57329a9919addfca3f691cb72794530d565307c56be54ec00270261fe"}
Sep 09 06:18:30.628214 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.628174    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"
Sep 09 06:18:30.629799 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.629773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94" event={"ID":"756f3604-9f87-4d1c-811f-a7f29bde5910","Type":"ContainerStarted","Data":"0330c93a136f90b39603e7c665236a9a221d19ed583f0586eca837d44c1208dd"}
Sep 09 06:18:30.629927 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.629816    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94" event={"ID":"756f3604-9f87-4d1c-811f-a7f29bde5910","Type":"ContainerStarted","Data":"4cb007169b13a5d1f3e0369f17bfd5b71458336fdfe55b3d9eb3dbda01735c0a"}
Sep 09 06:18:30.629927 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.629863    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"
Sep 09 06:18:30.643716 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.643673    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd" podStartSLOduration=1.6436595120000002 podStartE2EDuration="1.643659512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:18:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:18:30.642458057 +0000 UTC m=+1731.872954610" watchObservedRunningTime="2026-09-09 06:18:30.643659512 +0000 UTC m=+1731.874156090"
Sep 09 06:18:30.657539 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:30.657492    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94" podStartSLOduration=1.657476286 podStartE2EDuration="1.657476286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:18:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:18:30.657432185 +0000 UTC m=+1731.887928737" watchObservedRunningTime="2026-09-09 06:18:30.657476286 +0000 UTC m=+1731.887972839"
Sep 09 06:18:41.638046 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:41.638013    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"
Sep 09 06:18:41.638490 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:41.638239    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"
Sep 09 06:18:52.970371 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:52.970331    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:59.709738 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:59.709706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:59.782399 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:59.782355    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"]
Sep 09 06:18:59.782653 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:59.782629    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94" podUID="756f3604-9f87-4d1c-811f-a7f29bde5910" containerName="payload-processing" containerID="cri-o://0330c93a136f90b39603e7c665236a9a221d19ed583f0586eca837d44c1208dd" gracePeriod=30
Sep 09 06:18:59.800071 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:59.800043    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"]
Sep 09 06:18:59.800333 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:59.800307    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd" podUID="422f1c34-0d33-4218-9047-07f6fd1044d4" containerName="payload-pre-processing" containerID="cri-o://534053784ef112040c3bcaa13af4e49b82cbcbb2fcf592816f2ce55b37d54681" gracePeriod=30
Sep 09 06:18:59.820486 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:59.820453    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:59.880989 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:59.880959    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:18:59.944448 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:18:59.944335    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:00.003998 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.003942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:00.090040 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.090019    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"
Sep 09 06:19:00.093235 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.093217    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"
Sep 09 06:19:00.219928 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.219827    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/422f1c34-0d33-4218-9047-07f6fd1044d4-plugins-config-volume\") pod \"422f1c34-0d33-4218-9047-07f6fd1044d4\" (UID: \"422f1c34-0d33-4218-9047-07f6fd1044d4\") "
Sep 09 06:19:00.219928 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.219913    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/756f3604-9f87-4d1c-811f-a7f29bde5910-plugins-config-volume\") pod \"756f3604-9f87-4d1c-811f-a7f29bde5910\" (UID: \"756f3604-9f87-4d1c-811f-a7f29bde5910\") "
Sep 09 06:19:00.220177 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.220013    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7whnk\" (UniqueName: \"kubernetes.io/projected/756f3604-9f87-4d1c-811f-a7f29bde5910-kube-api-access-7whnk\") pod \"756f3604-9f87-4d1c-811f-a7f29bde5910\" (UID: \"756f3604-9f87-4d1c-811f-a7f29bde5910\") "
Sep 09 06:19:00.220177 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.220045    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhgxc\" (UniqueName: \"kubernetes.io/projected/422f1c34-0d33-4218-9047-07f6fd1044d4-kube-api-access-mhgxc\") pod \"422f1c34-0d33-4218-9047-07f6fd1044d4\" (UID: \"422f1c34-0d33-4218-9047-07f6fd1044d4\") "
Sep 09 06:19:00.220293 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.220249    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/422f1c34-0d33-4218-9047-07f6fd1044d4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "422f1c34-0d33-4218-9047-07f6fd1044d4" (UID: "422f1c34-0d33-4218-9047-07f6fd1044d4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:19:00.220354 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.220329    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/756f3604-9f87-4d1c-811f-a7f29bde5910-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "756f3604-9f87-4d1c-811f-a7f29bde5910" (UID: "756f3604-9f87-4d1c-811f-a7f29bde5910"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:19:00.220448 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.220431    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/422f1c34-0d33-4218-9047-07f6fd1044d4-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:19:00.220501 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.220455    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/756f3604-9f87-4d1c-811f-a7f29bde5910-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:19:00.222227 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.222202    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/756f3604-9f87-4d1c-811f-a7f29bde5910-kube-api-access-7whnk" (OuterVolumeSpecName: "kube-api-access-7whnk") pod "756f3604-9f87-4d1c-811f-a7f29bde5910" (UID: "756f3604-9f87-4d1c-811f-a7f29bde5910"). InnerVolumeSpecName "kube-api-access-7whnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:19:00.222298 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.222242    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/422f1c34-0d33-4218-9047-07f6fd1044d4-kube-api-access-mhgxc" (OuterVolumeSpecName: "kube-api-access-mhgxc") pod "422f1c34-0d33-4218-9047-07f6fd1044d4" (UID: "422f1c34-0d33-4218-9047-07f6fd1044d4"). InnerVolumeSpecName "kube-api-access-mhgxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:19:00.319707 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.319671    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:00.321915 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.321892    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7whnk\" (UniqueName: \"kubernetes.io/projected/756f3604-9f87-4d1c-811f-a7f29bde5910-kube-api-access-7whnk\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:19:00.321991 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.321920    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhgxc\" (UniqueName: \"kubernetes.io/projected/422f1c34-0d33-4218-9047-07f6fd1044d4-kube-api-access-mhgxc\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:19:00.795468 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.795435    2583 generic.go:356] "Generic (PLEG): container finished" podID="422f1c34-0d33-4218-9047-07f6fd1044d4" containerID="534053784ef112040c3bcaa13af4e49b82cbcbb2fcf592816f2ce55b37d54681" exitCode=0
Sep 09 06:19:00.795956 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.795495    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"
Sep 09 06:19:00.795956 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.795519    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd" event={"ID":"422f1c34-0d33-4218-9047-07f6fd1044d4","Type":"ContainerDied","Data":"534053784ef112040c3bcaa13af4e49b82cbcbb2fcf592816f2ce55b37d54681"}
Sep 09 06:19:00.795956 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.795610    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd" event={"ID":"422f1c34-0d33-4218-9047-07f6fd1044d4","Type":"ContainerDied","Data":"f2f7ecb57329a9919addfca3f691cb72794530d565307c56be54ec00270261fe"}
Sep 09 06:19:00.795956 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.795646    2583 scope.go:117] "RemoveContainer" containerID="534053784ef112040c3bcaa13af4e49b82cbcbb2fcf592816f2ce55b37d54681"
Sep 09 06:19:00.797042 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.797004    2583 generic.go:356] "Generic (PLEG): container finished" podID="756f3604-9f87-4d1c-811f-a7f29bde5910" containerID="0330c93a136f90b39603e7c665236a9a221d19ed583f0586eca837d44c1208dd" exitCode=0
Sep 09 06:19:00.797149 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.797122    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94" event={"ID":"756f3604-9f87-4d1c-811f-a7f29bde5910","Type":"ContainerDied","Data":"0330c93a136f90b39603e7c665236a9a221d19ed583f0586eca837d44c1208dd"}
Sep 09 06:19:00.797149 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.797129    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"
Sep 09 06:19:00.797264 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.797174    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94" event={"ID":"756f3604-9f87-4d1c-811f-a7f29bde5910","Type":"ContainerDied","Data":"4cb007169b13a5d1f3e0369f17bfd5b71458336fdfe55b3d9eb3dbda01735c0a"}
Sep 09 06:19:00.805192 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.805171    2583 scope.go:117] "RemoveContainer" containerID="534053784ef112040c3bcaa13af4e49b82cbcbb2fcf592816f2ce55b37d54681"
Sep 09 06:19:00.805488 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:19:00.805468    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"534053784ef112040c3bcaa13af4e49b82cbcbb2fcf592816f2ce55b37d54681\": container with ID starting with 534053784ef112040c3bcaa13af4e49b82cbcbb2fcf592816f2ce55b37d54681 not found: ID does not exist" containerID="534053784ef112040c3bcaa13af4e49b82cbcbb2fcf592816f2ce55b37d54681"
Sep 09 06:19:00.805610 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.805495    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"534053784ef112040c3bcaa13af4e49b82cbcbb2fcf592816f2ce55b37d54681"} err="failed to get container status \"534053784ef112040c3bcaa13af4e49b82cbcbb2fcf592816f2ce55b37d54681\": rpc error: code = NotFound desc = could not find container \"534053784ef112040c3bcaa13af4e49b82cbcbb2fcf592816f2ce55b37d54681\": container with ID starting with 534053784ef112040c3bcaa13af4e49b82cbcbb2fcf592816f2ce55b37d54681 not found: ID does not exist"
Sep 09 06:19:00.805610 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.805513    2583 scope.go:117] "RemoveContainer" containerID="0330c93a136f90b39603e7c665236a9a221d19ed583f0586eca837d44c1208dd"
Sep 09 06:19:00.814249 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.814232    2583 scope.go:117] "RemoveContainer" containerID="0330c93a136f90b39603e7c665236a9a221d19ed583f0586eca837d44c1208dd"
Sep 09 06:19:00.814496 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:19:00.814480    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0330c93a136f90b39603e7c665236a9a221d19ed583f0586eca837d44c1208dd\": container with ID starting with 0330c93a136f90b39603e7c665236a9a221d19ed583f0586eca837d44c1208dd not found: ID does not exist" containerID="0330c93a136f90b39603e7c665236a9a221d19ed583f0586eca837d44c1208dd"
Sep 09 06:19:00.814546 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.814501    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0330c93a136f90b39603e7c665236a9a221d19ed583f0586eca837d44c1208dd"} err="failed to get container status \"0330c93a136f90b39603e7c665236a9a221d19ed583f0586eca837d44c1208dd\": rpc error: code = NotFound desc = could not find container \"0330c93a136f90b39603e7c665236a9a221d19ed583f0586eca837d44c1208dd\": container with ID starting with 0330c93a136f90b39603e7c665236a9a221d19ed583f0586eca837d44c1208dd not found: ID does not exist"
Sep 09 06:19:00.827051 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.827028    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"]
Sep 09 06:19:00.830890 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.830870    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2e28ff-558bb7b649-j6m94"]
Sep 09 06:19:00.842883 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.842855    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"]
Sep 09 06:19:00.846984 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:00.846965    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-2e28ff-74d59d7df4-crknd"]
Sep 09 06:19:01.245675 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:01.245643    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="422f1c34-0d33-4218-9047-07f6fd1044d4" path="/var/lib/kubelet/pods/422f1c34-0d33-4218-9047-07f6fd1044d4/volumes"
Sep 09 06:19:01.246015 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:01.246002    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="756f3604-9f87-4d1c-811f-a7f29bde5910" path="/var/lib/kubelet/pods/756f3604-9f87-4d1c-811f-a7f29bde5910/volumes"
Sep 09 06:19:06.205918 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:06.205885    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:06.309150 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:06.309115    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:06.480913 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:06.480819    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:07.406452 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:07.406406    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:10.258099 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:10.258061    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:24.436930 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:24.436897    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:25.550506 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.550470    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:25.587717 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.587682    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"]
Sep 09 06:19:25.587967 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.587940    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm" podUID="8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0" containerName="payload-processing" containerID="cri-o://e20c94eb3915c05ac325be279caebbd40c7bbd589e0b3a3bf054540fc8bc85a0" gracePeriod=30
Sep 09 06:19:25.620283 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.620256    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:25.681210 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.681174    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:25.782004 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.781942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:25.854902 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.854876    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"
Sep 09 06:19:25.866178 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.866160    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0-plugins-config-volume\") pod \"8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0\" (UID: \"8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0\") "
Sep 09 06:19:25.866259 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.866194    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9q8hl\" (UniqueName: \"kubernetes.io/projected/8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0-kube-api-access-9q8hl\") pod \"8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0\" (UID: \"8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0\") "
Sep 09 06:19:25.866598 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.866544    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0" (UID: "8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:19:25.868332 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.868310    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0-kube-api-access-9q8hl" (OuterVolumeSpecName: "kube-api-access-9q8hl") pod "8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0" (UID: "8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0"). InnerVolumeSpecName "kube-api-access-9q8hl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:19:25.891065 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.891040    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:25.933534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.933497    2583 generic.go:356] "Generic (PLEG): container finished" podID="8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0" containerID="e20c94eb3915c05ac325be279caebbd40c7bbd589e0b3a3bf054540fc8bc85a0" exitCode=0
Sep 09 06:19:25.933872 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.933575    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"
Sep 09 06:19:25.933872 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.933579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm" event={"ID":"8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0","Type":"ContainerDied","Data":"e20c94eb3915c05ac325be279caebbd40c7bbd589e0b3a3bf054540fc8bc85a0"}
Sep 09 06:19:25.933872 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.933682    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm" event={"ID":"8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0","Type":"ContainerDied","Data":"87e62f9ff25499927e479dfbf5de011ac0f6aa98ce8d66b8a219055cd5062ac5"}
Sep 09 06:19:25.933872 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.933763    2583 scope.go:117] "RemoveContainer" containerID="e20c94eb3915c05ac325be279caebbd40c7bbd589e0b3a3bf054540fc8bc85a0"
Sep 09 06:19:25.944693 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.944624    2583 scope.go:117] "RemoveContainer" containerID="e20c94eb3915c05ac325be279caebbd40c7bbd589e0b3a3bf054540fc8bc85a0"
Sep 09 06:19:25.945071 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:19:25.945045    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e20c94eb3915c05ac325be279caebbd40c7bbd589e0b3a3bf054540fc8bc85a0\": container with ID starting with e20c94eb3915c05ac325be279caebbd40c7bbd589e0b3a3bf054540fc8bc85a0 not found: ID does not exist" containerID="e20c94eb3915c05ac325be279caebbd40c7bbd589e0b3a3bf054540fc8bc85a0"
Sep 09 06:19:25.945183 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.945081    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e20c94eb3915c05ac325be279caebbd40c7bbd589e0b3a3bf054540fc8bc85a0"} err="failed to get container status \"e20c94eb3915c05ac325be279caebbd40c7bbd589e0b3a3bf054540fc8bc85a0\": rpc error: code = NotFound desc = could not find container \"e20c94eb3915c05ac325be279caebbd40c7bbd589e0b3a3bf054540fc8bc85a0\": container with ID starting with e20c94eb3915c05ac325be279caebbd40c7bbd589e0b3a3bf054540fc8bc85a0 not found: ID does not exist"
Sep 09 06:19:25.964755 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.964718    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"]
Sep 09 06:19:25.967152 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.967129    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:19:25.967152 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.967152    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9q8hl\" (UniqueName: \"kubernetes.io/projected/8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0-kube-api-access-9q8hl\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:19:25.970110 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:25.970082    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-8a6cf7-69689f8675-jbzsm"]
Sep 09 06:19:26.146103 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:26.146072    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:27.245371 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:27.245342    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0" path="/var/lib/kubelet/pods/8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0/volumes"
Sep 09 06:19:31.206642 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:31.206523    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:35.046003 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:35.045965    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:57.150796 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:57.150760    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:19:57.265094 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:19:57.265032    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:07.487655 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:07.487623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:08.244809 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:08.244747    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:13.677461 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:13.677425    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:13.767804 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:13.767771    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:13.941848 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:13.941749    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"]
Sep 09 06:20:13.942054 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:13.942024    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp" podUID="239fed21-105c-4ea4-9f74-a75ff2ac3598" containerName="istio-proxy" containerID="cri-o://0807142a556b923a45dfdaec3cba6d5e5e11654b3143336988c9b90b7cdd778b" gracePeriod=30
Sep 09 06:20:13.966746 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:13.966703    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:14.425055 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:14.425022    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:19.205975 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.205912    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:20:19.211697 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.211673    2583 generic.go:356] "Generic (PLEG): container finished" podID="239fed21-105c-4ea4-9f74-a75ff2ac3598" containerID="0807142a556b923a45dfdaec3cba6d5e5e11654b3143336988c9b90b7cdd778b" exitCode=0
Sep 09 06:20:19.211809 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.211710    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"
Sep 09 06:20:19.211809 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.211717    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp" event={"ID":"239fed21-105c-4ea4-9f74-a75ff2ac3598","Type":"ContainerDied","Data":"0807142a556b923a45dfdaec3cba6d5e5e11654b3143336988c9b90b7cdd778b"}
Sep 09 06:20:19.211809 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.211765    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp" event={"ID":"239fed21-105c-4ea4-9f74-a75ff2ac3598","Type":"ContainerDied","Data":"a1ddf26c8265789320e4ca6e40f6ff11ea36352d745c1198b6361306430e8a34"}
Sep 09 06:20:19.211809 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.211788    2583 scope.go:117] "RemoveContainer" containerID="0807142a556b923a45dfdaec3cba6d5e5e11654b3143336988c9b90b7cdd778b"
Sep 09 06:20:19.220439 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.220417    2583 scope.go:117] "RemoveContainer" containerID="30e2bed0c6f88f5bcd7641e27bf116ffd56d98399544cb87d6cdb560d9d1a786"
Sep 09 06:20:19.230317 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.230243    2583 scope.go:117] "RemoveContainer" containerID="0807142a556b923a45dfdaec3cba6d5e5e11654b3143336988c9b90b7cdd778b"
Sep 09 06:20:19.230686 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:20:19.230663    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0807142a556b923a45dfdaec3cba6d5e5e11654b3143336988c9b90b7cdd778b\": container with ID starting with 0807142a556b923a45dfdaec3cba6d5e5e11654b3143336988c9b90b7cdd778b not found: ID does not exist" containerID="0807142a556b923a45dfdaec3cba6d5e5e11654b3143336988c9b90b7cdd778b"
Sep 09 06:20:19.230774 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.230693    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0807142a556b923a45dfdaec3cba6d5e5e11654b3143336988c9b90b7cdd778b"} err="failed to get container status \"0807142a556b923a45dfdaec3cba6d5e5e11654b3143336988c9b90b7cdd778b\": rpc error: code = NotFound desc = could not find container \"0807142a556b923a45dfdaec3cba6d5e5e11654b3143336988c9b90b7cdd778b\": container with ID starting with 0807142a556b923a45dfdaec3cba6d5e5e11654b3143336988c9b90b7cdd778b not found: ID does not exist"
Sep 09 06:20:19.230774 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.230709    2583 scope.go:117] "RemoveContainer" containerID="30e2bed0c6f88f5bcd7641e27bf116ffd56d98399544cb87d6cdb560d9d1a786"
Sep 09 06:20:19.231003 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:20:19.230985    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30e2bed0c6f88f5bcd7641e27bf116ffd56d98399544cb87d6cdb560d9d1a786\": container with ID starting with 30e2bed0c6f88f5bcd7641e27bf116ffd56d98399544cb87d6cdb560d9d1a786 not found: ID does not exist" containerID="30e2bed0c6f88f5bcd7641e27bf116ffd56d98399544cb87d6cdb560d9d1a786"
Sep 09 06:20:19.231081 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.231008    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30e2bed0c6f88f5bcd7641e27bf116ffd56d98399544cb87d6cdb560d9d1a786"} err="failed to get container status \"30e2bed0c6f88f5bcd7641e27bf116ffd56d98399544cb87d6cdb560d9d1a786\": rpc error: code = NotFound desc = could not find container \"30e2bed0c6f88f5bcd7641e27bf116ffd56d98399544cb87d6cdb560d9d1a786\": container with ID starting with 30e2bed0c6f88f5bcd7641e27bf116ffd56d98399544cb87d6cdb560d9d1a786 not found: ID does not exist"
Sep 09 06:20:19.256082 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.256053    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-envoy\") pod \"239fed21-105c-4ea4-9f74-a75ff2ac3598\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") "
Sep 09 06:20:19.256221 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.256096    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc9x7\" (UniqueName: \"kubernetes.io/projected/239fed21-105c-4ea4-9f74-a75ff2ac3598-kube-api-access-bc9x7\") pod \"239fed21-105c-4ea4-9f74-a75ff2ac3598\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") "
Sep 09 06:20:19.256221 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.256172    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-podinfo\") pod \"239fed21-105c-4ea4-9f74-a75ff2ac3598\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") "
Sep 09 06:20:19.256352 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.256227    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-data\") pod \"239fed21-105c-4ea4-9f74-a75ff2ac3598\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") "
Sep 09 06:20:19.256352 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.256263    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-token\") pod \"239fed21-105c-4ea4-9f74-a75ff2ac3598\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") "
Sep 09 06:20:19.256352 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.256303    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/239fed21-105c-4ea4-9f74-a75ff2ac3598-istiod-ca-cert\") pod \"239fed21-105c-4ea4-9f74-a75ff2ac3598\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") "
Sep 09 06:20:19.256523 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.256456    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-workload-certs\") pod \"239fed21-105c-4ea4-9f74-a75ff2ac3598\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") "
Sep 09 06:20:19.256523 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.256494    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-credential-socket\") pod \"239fed21-105c-4ea4-9f74-a75ff2ac3598\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") "
Sep 09 06:20:19.256665 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.256526    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-workload-socket\") pod \"239fed21-105c-4ea4-9f74-a75ff2ac3598\" (UID: \"239fed21-105c-4ea4-9f74-a75ff2ac3598\") "
Sep 09 06:20:19.256665 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.256645    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-data" (OuterVolumeSpecName: "istio-data") pod "239fed21-105c-4ea4-9f74-a75ff2ac3598" (UID: "239fed21-105c-4ea4-9f74-a75ff2ac3598"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:20:19.257270 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.257122    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:19.257270 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.257171    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "239fed21-105c-4ea4-9f74-a75ff2ac3598" (UID: "239fed21-105c-4ea4-9f74-a75ff2ac3598"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:20:19.257270 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.257234    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/239fed21-105c-4ea4-9f74-a75ff2ac3598-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "239fed21-105c-4ea4-9f74-a75ff2ac3598" (UID: "239fed21-105c-4ea4-9f74-a75ff2ac3598"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:20:19.257270 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.257257    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "239fed21-105c-4ea4-9f74-a75ff2ac3598" (UID: "239fed21-105c-4ea4-9f74-a75ff2ac3598"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:20:19.257675 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.257355    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "239fed21-105c-4ea4-9f74-a75ff2ac3598" (UID: "239fed21-105c-4ea4-9f74-a75ff2ac3598"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:20:19.258672 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.258624    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/239fed21-105c-4ea4-9f74-a75ff2ac3598-kube-api-access-bc9x7" (OuterVolumeSpecName: "kube-api-access-bc9x7") pod "239fed21-105c-4ea4-9f74-a75ff2ac3598" (UID: "239fed21-105c-4ea4-9f74-a75ff2ac3598"). InnerVolumeSpecName "kube-api-access-bc9x7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:20:19.258770 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.258690    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-token" (OuterVolumeSpecName: "istio-token") pod "239fed21-105c-4ea4-9f74-a75ff2ac3598" (UID: "239fed21-105c-4ea4-9f74-a75ff2ac3598"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:20:19.258907 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.258878    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "239fed21-105c-4ea4-9f74-a75ff2ac3598" (UID: "239fed21-105c-4ea4-9f74-a75ff2ac3598"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:20:19.258907 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.258898    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "239fed21-105c-4ea4-9f74-a75ff2ac3598" (UID: "239fed21-105c-4ea4-9f74-a75ff2ac3598"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 06:20:19.358509 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.358475    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-podinfo\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:19.358509 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.358503    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-token\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:19.358509 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.358512    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/239fed21-105c-4ea4-9f74-a75ff2ac3598-istiod-ca-cert\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:19.358509 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.358519    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-workload-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:19.358798 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.358527    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-credential-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:19.358798 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.358537    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-workload-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:19.358798 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.358545    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/239fed21-105c-4ea4-9f74-a75ff2ac3598-istio-envoy\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:19.358798 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.358572    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc9x7\" (UniqueName: \"kubernetes.io/projected/239fed21-105c-4ea4-9f74-a75ff2ac3598-kube-api-access-bc9x7\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:19.535387 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.535357    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"]
Sep 09 06:20:19.539114 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:19.539087    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-8a6cf7-openshift-default-c99fd787b-8gwqp"]
Sep 09 06:20:21.244982 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:21.244947    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="239fed21-105c-4ea4-9f74-a75ff2ac3598" path="/var/lib/kubelet/pods/239fed21-105c-4ea4-9f74-a75ff2ac3598/volumes"
Sep 09 06:20:24.999127 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:24.999093    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:25.033347 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:25.033302    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"]
Sep 09 06:20:25.033610 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:25.033582    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj" podUID="080acac7-3408-43f5-a9f2-9fe606d7570b" containerName="payload-processing" containerID="cri-o://99c4b8b8cd110465958bd896718b350bf1023b82cf11c418ca9666c2cf4fe5c7" gracePeriod=30
Sep 09 06:20:25.246395 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:25.246365    2583 generic.go:356] "Generic (PLEG): container finished" podID="080acac7-3408-43f5-a9f2-9fe606d7570b" containerID="99c4b8b8cd110465958bd896718b350bf1023b82cf11c418ca9666c2cf4fe5c7" exitCode=0
Sep 09 06:20:25.247253 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:25.247223    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj" event={"ID":"080acac7-3408-43f5-a9f2-9fe606d7570b","Type":"ContainerDied","Data":"99c4b8b8cd110465958bd896718b350bf1023b82cf11c418ca9666c2cf4fe5c7"}
Sep 09 06:20:25.290405 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:25.290378    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"
Sep 09 06:20:25.414034 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:25.414000    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdzj6\" (UniqueName: \"kubernetes.io/projected/080acac7-3408-43f5-a9f2-9fe606d7570b-kube-api-access-sdzj6\") pod \"080acac7-3408-43f5-a9f2-9fe606d7570b\" (UID: \"080acac7-3408-43f5-a9f2-9fe606d7570b\") "
Sep 09 06:20:25.414200 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:25.414088    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/080acac7-3408-43f5-a9f2-9fe606d7570b-plugins-config-volume\") pod \"080acac7-3408-43f5-a9f2-9fe606d7570b\" (UID: \"080acac7-3408-43f5-a9f2-9fe606d7570b\") "
Sep 09 06:20:25.414455 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:25.414436    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/080acac7-3408-43f5-a9f2-9fe606d7570b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "080acac7-3408-43f5-a9f2-9fe606d7570b" (UID: "080acac7-3408-43f5-a9f2-9fe606d7570b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:20:25.416257 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:25.416232    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/080acac7-3408-43f5-a9f2-9fe606d7570b-kube-api-access-sdzj6" (OuterVolumeSpecName: "kube-api-access-sdzj6") pod "080acac7-3408-43f5-a9f2-9fe606d7570b" (UID: "080acac7-3408-43f5-a9f2-9fe606d7570b"). InnerVolumeSpecName "kube-api-access-sdzj6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:20:25.515807 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:25.515768    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdzj6\" (UniqueName: \"kubernetes.io/projected/080acac7-3408-43f5-a9f2-9fe606d7570b-kube-api-access-sdzj6\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:25.515807 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:25.515797    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/080acac7-3408-43f5-a9f2-9fe606d7570b-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:26.253820 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:26.253779    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj" event={"ID":"080acac7-3408-43f5-a9f2-9fe606d7570b","Type":"ContainerDied","Data":"a3f5f8ba1e63482bd5107c80ea3a78ac467fdc0b5c4f3581500e90eb6687ac81"}
Sep 09 06:20:26.254291 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:26.253848    2583 scope.go:117] "RemoveContainer" containerID="99c4b8b8cd110465958bd896718b350bf1023b82cf11c418ca9666c2cf4fe5c7"
Sep 09 06:20:26.254291 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:26.253798    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"
Sep 09 06:20:26.254544 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:26.254512    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:26.277444 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:26.277417    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"]
Sep 09 06:20:26.281511 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:26.281487    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-32ea4d-69858dc589-lnsnj"]
Sep 09 06:20:27.243953 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:27.243920    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="080acac7-3408-43f5-a9f2-9fe606d7570b" path="/var/lib/kubelet/pods/080acac7-3408-43f5-a9f2-9fe606d7570b/volumes"
Sep 09 06:20:31.418892 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:31.418859    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:31.487340 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:31.487311    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:31.722206 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:31.722125    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:32.246142 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:32.246103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:42.618479 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:42.618441    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:42.643254 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:42.643213    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"]
Sep 09 06:20:42.643496 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:42.643466    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf" podUID="62555542-12e9-447e-a7f3-ab2bf5c1ffa0" containerName="payload-processing" containerID="cri-o://d054dfef3469d2b4a9c97e410993359f07ff8af512108335a92ec23fc69c2dae" gracePeriod=30
Sep 09 06:20:42.650670 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:42.650630    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"]
Sep 09 06:20:42.650939 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:42.650894    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn" podUID="799bb589-c072-4ec7-8a37-7658055fc9c8" containerName="payload-pre-processing" containerID="cri-o://0bac06ec24c0df9da4ffb76ae359cb3b8876e90bdc7c10b78c4f0f09c3b2a7d2" gracePeriod=30
Sep 09 06:20:42.725545 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:42.725509    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:42.928500 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:42.928474    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"
Sep 09 06:20:42.931171 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:42.931154    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"
Sep 09 06:20:42.959192 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:42.959163    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:43.026818 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.026783    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:43.083659 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.083625    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2jdz\" (UniqueName: \"kubernetes.io/projected/799bb589-c072-4ec7-8a37-7658055fc9c8-kube-api-access-z2jdz\") pod \"799bb589-c072-4ec7-8a37-7658055fc9c8\" (UID: \"799bb589-c072-4ec7-8a37-7658055fc9c8\") "
Sep 09 06:20:43.083818 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.083671    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/799bb589-c072-4ec7-8a37-7658055fc9c8-plugins-config-volume\") pod \"799bb589-c072-4ec7-8a37-7658055fc9c8\" (UID: \"799bb589-c072-4ec7-8a37-7658055fc9c8\") "
Sep 09 06:20:43.083818 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.083713    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7s8x\" (UniqueName: \"kubernetes.io/projected/62555542-12e9-447e-a7f3-ab2bf5c1ffa0-kube-api-access-p7s8x\") pod \"62555542-12e9-447e-a7f3-ab2bf5c1ffa0\" (UID: \"62555542-12e9-447e-a7f3-ab2bf5c1ffa0\") "
Sep 09 06:20:43.083899 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.083811    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62555542-12e9-447e-a7f3-ab2bf5c1ffa0-plugins-config-volume\") pod \"62555542-12e9-447e-a7f3-ab2bf5c1ffa0\" (UID: \"62555542-12e9-447e-a7f3-ab2bf5c1ffa0\") "
Sep 09 06:20:43.084123 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.084094    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/799bb589-c072-4ec7-8a37-7658055fc9c8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "799bb589-c072-4ec7-8a37-7658055fc9c8" (UID: "799bb589-c072-4ec7-8a37-7658055fc9c8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:20:43.084256 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.084150    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62555542-12e9-447e-a7f3-ab2bf5c1ffa0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "62555542-12e9-447e-a7f3-ab2bf5c1ffa0" (UID: "62555542-12e9-447e-a7f3-ab2bf5c1ffa0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:20:43.084256 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.084222    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/799bb589-c072-4ec7-8a37-7658055fc9c8-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:43.084256 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.084239    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/62555542-12e9-447e-a7f3-ab2bf5c1ffa0-plugins-config-volume\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:43.085982 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.085965    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/799bb589-c072-4ec7-8a37-7658055fc9c8-kube-api-access-z2jdz" (OuterVolumeSpecName: "kube-api-access-z2jdz") pod "799bb589-c072-4ec7-8a37-7658055fc9c8" (UID: "799bb589-c072-4ec7-8a37-7658055fc9c8"). InnerVolumeSpecName "kube-api-access-z2jdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:20:43.086123 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.086103    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62555542-12e9-447e-a7f3-ab2bf5c1ffa0-kube-api-access-p7s8x" (OuterVolumeSpecName: "kube-api-access-p7s8x") pod "62555542-12e9-447e-a7f3-ab2bf5c1ffa0" (UID: "62555542-12e9-447e-a7f3-ab2bf5c1ffa0"). InnerVolumeSpecName "kube-api-access-p7s8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:20:43.185534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.185444    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2jdz\" (UniqueName: \"kubernetes.io/projected/799bb589-c072-4ec7-8a37-7658055fc9c8-kube-api-access-z2jdz\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:43.185534 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.185479    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7s8x\" (UniqueName: \"kubernetes.io/projected/62555542-12e9-447e-a7f3-ab2bf5c1ffa0-kube-api-access-p7s8x\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:20:43.341710 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.341673    2583 generic.go:356] "Generic (PLEG): container finished" podID="62555542-12e9-447e-a7f3-ab2bf5c1ffa0" containerID="d054dfef3469d2b4a9c97e410993359f07ff8af512108335a92ec23fc69c2dae" exitCode=0
Sep 09 06:20:43.341903 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.341757    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf" event={"ID":"62555542-12e9-447e-a7f3-ab2bf5c1ffa0","Type":"ContainerDied","Data":"d054dfef3469d2b4a9c97e410993359f07ff8af512108335a92ec23fc69c2dae"}
Sep 09 06:20:43.341903 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.341781    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"
Sep 09 06:20:43.341903 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.341801    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf" event={"ID":"62555542-12e9-447e-a7f3-ab2bf5c1ffa0","Type":"ContainerDied","Data":"d12896e44b2684e642894eada193b63409533d52f534015e4f935679edf87bdf"}
Sep 09 06:20:43.341903 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.341825    2583 scope.go:117] "RemoveContainer" containerID="d054dfef3469d2b4a9c97e410993359f07ff8af512108335a92ec23fc69c2dae"
Sep 09 06:20:43.343340 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.343311    2583 generic.go:356] "Generic (PLEG): container finished" podID="799bb589-c072-4ec7-8a37-7658055fc9c8" containerID="0bac06ec24c0df9da4ffb76ae359cb3b8876e90bdc7c10b78c4f0f09c3b2a7d2" exitCode=0
Sep 09 06:20:43.343475 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.343349    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"
Sep 09 06:20:43.343475 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.343387    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn" event={"ID":"799bb589-c072-4ec7-8a37-7658055fc9c8","Type":"ContainerDied","Data":"0bac06ec24c0df9da4ffb76ae359cb3b8876e90bdc7c10b78c4f0f09c3b2a7d2"}
Sep 09 06:20:43.343475 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.343444    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn" event={"ID":"799bb589-c072-4ec7-8a37-7658055fc9c8","Type":"ContainerDied","Data":"0f4db4f5fb471259d28feb187ee5f3b7040bff43b0ef607d70b75b1e6e9d449b"}
Sep 09 06:20:43.353366 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.353339    2583 scope.go:117] "RemoveContainer" containerID="d054dfef3469d2b4a9c97e410993359f07ff8af512108335a92ec23fc69c2dae"
Sep 09 06:20:43.353791 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:20:43.353760    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d054dfef3469d2b4a9c97e410993359f07ff8af512108335a92ec23fc69c2dae\": container with ID starting with d054dfef3469d2b4a9c97e410993359f07ff8af512108335a92ec23fc69c2dae not found: ID does not exist" containerID="d054dfef3469d2b4a9c97e410993359f07ff8af512108335a92ec23fc69c2dae"
Sep 09 06:20:43.358681 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.354406    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d054dfef3469d2b4a9c97e410993359f07ff8af512108335a92ec23fc69c2dae"} err="failed to get container status \"d054dfef3469d2b4a9c97e410993359f07ff8af512108335a92ec23fc69c2dae\": rpc error: code = NotFound desc = could not find container \"d054dfef3469d2b4a9c97e410993359f07ff8af512108335a92ec23fc69c2dae\": container with ID starting with d054dfef3469d2b4a9c97e410993359f07ff8af512108335a92ec23fc69c2dae not found: ID does not exist"
Sep 09 06:20:43.358681 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.354440    2583 scope.go:117] "RemoveContainer" containerID="0bac06ec24c0df9da4ffb76ae359cb3b8876e90bdc7c10b78c4f0f09c3b2a7d2"
Sep 09 06:20:43.363017 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.362991    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"]
Sep 09 06:20:43.365627 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.365604    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-6b5d89-c557585b6-jmbcn"]
Sep 09 06:20:43.367680 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.367657    2583 scope.go:117] "RemoveContainer" containerID="0bac06ec24c0df9da4ffb76ae359cb3b8876e90bdc7c10b78c4f0f09c3b2a7d2"
Sep 09 06:20:43.368019 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:20:43.367997    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bac06ec24c0df9da4ffb76ae359cb3b8876e90bdc7c10b78c4f0f09c3b2a7d2\": container with ID starting with 0bac06ec24c0df9da4ffb76ae359cb3b8876e90bdc7c10b78c4f0f09c3b2a7d2 not found: ID does not exist" containerID="0bac06ec24c0df9da4ffb76ae359cb3b8876e90bdc7c10b78c4f0f09c3b2a7d2"
Sep 09 06:20:43.368100 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.368025    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bac06ec24c0df9da4ffb76ae359cb3b8876e90bdc7c10b78c4f0f09c3b2a7d2"} err="failed to get container status \"0bac06ec24c0df9da4ffb76ae359cb3b8876e90bdc7c10b78c4f0f09c3b2a7d2\": rpc error: code = NotFound desc = could not find container \"0bac06ec24c0df9da4ffb76ae359cb3b8876e90bdc7c10b78c4f0f09c3b2a7d2\": container with ID starting with 0bac06ec24c0df9da4ffb76ae359cb3b8876e90bdc7c10b78c4f0f09c3b2a7d2 not found: ID does not exist"
Sep 09 06:20:43.375855 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.375834    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"]
Sep 09 06:20:43.379748 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.379728    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-6b5d89-8ddfb7567-zwmcf"]
Sep 09 06:20:43.394126 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:43.394102    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:45.249429 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:45.249397    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62555542-12e9-447e-a7f3-ab2bf5c1ffa0" path="/var/lib/kubelet/pods/62555542-12e9-447e-a7f3-ab2bf5c1ffa0/volumes"
Sep 09 06:20:45.249816 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:45.249755    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="799bb589-c072-4ec7-8a37-7658055fc9c8" path="/var/lib/kubelet/pods/799bb589-c072-4ec7-8a37-7658055fc9c8/volumes"
Sep 09 06:20:45.658734 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:45.658702    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:45.760029 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:45.759988    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:49.077721 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:49.077683    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:49.145131 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:49.145090    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:49.352433 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:49.352325    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:20:49.803653 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:20:49.803622    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:21:00.141762 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:00.141724    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7cf6be-29815575-r5nxv"]
Sep 09 06:21:00.142239 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:00.142031    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:21:00.143371 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:00.143350    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-7cf6be-29815575-r5nxv"]
Sep 09 06:21:00.208619 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:00.208583    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:21:00.275484 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:00.275439    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:21:00.341350 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:00.341273    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:21:00.398622 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:00.398513    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:21:00.755757 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:00.755641    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:21:01.244931 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:01.244897    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="125d4524-8a01-4d3d-b3cc-59d4c36a89a1" path="/var/lib/kubelet/pods/125d4524-8a01-4d3d-b3cc-59d4c36a89a1/volumes"
Sep 09 06:21:06.742919 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:06.742881    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:21:06.810394 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:06.810369    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:21:06.997808 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:06.997722    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"]
Sep 09 06:21:06.998019 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:06.997978    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerName="istio-proxy" containerID="cri-o://8b176248d173f92e74752bd991cb6f5db436218cd6e1b2e199a74d7d1b348b35" gracePeriod=30
Sep 09 06:21:07.021331 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:07.021305    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:21:07.932297 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:07.932255    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 09 06:21:07.932678 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:07.932324    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 09 06:21:12.259541 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.259515    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:21:12.350070 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.349984    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-podinfo\") pod \"ecd60c99-3d95-46b0-b739-2dea29198d46\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") "
Sep 09 06:21:12.350070 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350030    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecd60c99-3d95-46b0-b739-2dea29198d46-istiod-ca-cert\") pod \"ecd60c99-3d95-46b0-b739-2dea29198d46\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") "
Sep 09 06:21:12.350070 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350071    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-credential-socket\") pod \"ecd60c99-3d95-46b0-b739-2dea29198d46\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") "
Sep 09 06:21:12.350347 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350107    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-workload-certs\") pod \"ecd60c99-3d95-46b0-b739-2dea29198d46\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") "
Sep 09 06:21:12.350347 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350143    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzjhv\" (UniqueName: \"kubernetes.io/projected/ecd60c99-3d95-46b0-b739-2dea29198d46-kube-api-access-tzjhv\") pod \"ecd60c99-3d95-46b0-b739-2dea29198d46\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") "
Sep 09 06:21:12.350347 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350171    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-workload-socket\") pod \"ecd60c99-3d95-46b0-b739-2dea29198d46\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") "
Sep 09 06:21:12.350347 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350192    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-envoy\") pod \"ecd60c99-3d95-46b0-b739-2dea29198d46\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") "
Sep 09 06:21:12.350347 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350229    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-data\") pod \"ecd60c99-3d95-46b0-b739-2dea29198d46\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") "
Sep 09 06:21:12.350347 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350273    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-token\") pod \"ecd60c99-3d95-46b0-b739-2dea29198d46\" (UID: \"ecd60c99-3d95-46b0-b739-2dea29198d46\") "
Sep 09 06:21:12.350679 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350426    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ecd60c99-3d95-46b0-b739-2dea29198d46" (UID: "ecd60c99-3d95-46b0-b739-2dea29198d46"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:21:12.350679 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350601    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ecd60c99-3d95-46b0-b739-2dea29198d46" (UID: "ecd60c99-3d95-46b0-b739-2dea29198d46"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:21:12.350679 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350620    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecd60c99-3d95-46b0-b739-2dea29198d46-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ecd60c99-3d95-46b0-b739-2dea29198d46" (UID: "ecd60c99-3d95-46b0-b739-2dea29198d46"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:21:12.350846 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350827    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-workload-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:21:12.350902 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350848    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecd60c99-3d95-46b0-b739-2dea29198d46-istiod-ca-cert\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:21:12.350902 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350863    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-credential-socket\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:21:12.351017 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.350939    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ecd60c99-3d95-46b0-b739-2dea29198d46" (UID: "ecd60c99-3d95-46b0-b739-2dea29198d46"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:21:12.351235 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.351210    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-data" (OuterVolumeSpecName: "istio-data") pod "ecd60c99-3d95-46b0-b739-2dea29198d46" (UID: "ecd60c99-3d95-46b0-b739-2dea29198d46"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:21:12.353090 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.353060    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ecd60c99-3d95-46b0-b739-2dea29198d46" (UID: "ecd60c99-3d95-46b0-b739-2dea29198d46"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 09 06:21:12.353229 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.353106    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ecd60c99-3d95-46b0-b739-2dea29198d46" (UID: "ecd60c99-3d95-46b0-b739-2dea29198d46"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 09 06:21:12.353484 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.353457    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-token" (OuterVolumeSpecName: "istio-token") pod "ecd60c99-3d95-46b0-b739-2dea29198d46" (UID: "ecd60c99-3d95-46b0-b739-2dea29198d46"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:21:12.353617 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.353581    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecd60c99-3d95-46b0-b739-2dea29198d46-kube-api-access-tzjhv" (OuterVolumeSpecName: "kube-api-access-tzjhv") pod "ecd60c99-3d95-46b0-b739-2dea29198d46" (UID: "ecd60c99-3d95-46b0-b739-2dea29198d46"). InnerVolumeSpecName "kube-api-access-tzjhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:21:12.451762 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.451730    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-workload-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:21:12.451762 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.451755    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzjhv\" (UniqueName: \"kubernetes.io/projected/ecd60c99-3d95-46b0-b739-2dea29198d46-kube-api-access-tzjhv\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:21:12.451762 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.451765    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-envoy\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:21:12.451965 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.451773    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:21:12.451965 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.451780    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-token\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:21:12.451965 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.451788    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecd60c99-3d95-46b0-b739-2dea29198d46-istio-podinfo\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:21:12.493250 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.493224    2583 generic.go:356] "Generic (PLEG): container finished" podID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerID="8b176248d173f92e74752bd991cb6f5db436218cd6e1b2e199a74d7d1b348b35" exitCode=0
Sep 09 06:21:12.493436 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.493284    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" event={"ID":"ecd60c99-3d95-46b0-b739-2dea29198d46","Type":"ContainerDied","Data":"8b176248d173f92e74752bd991cb6f5db436218cd6e1b2e199a74d7d1b348b35"}
Sep 09 06:21:12.493436 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.493333    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6" event={"ID":"ecd60c99-3d95-46b0-b739-2dea29198d46","Type":"ContainerDied","Data":"cabd7ee29f9be30617d8e25001eb2d6e530e2e6855b0514c777308ec0d68a4d5"}
Sep 09 06:21:12.493436 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.493355    2583 scope.go:117] "RemoveContainer" containerID="8b176248d173f92e74752bd991cb6f5db436218cd6e1b2e199a74d7d1b348b35"
Sep 09 06:21:12.493436 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.493289    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"
Sep 09 06:21:12.503501 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.503478    2583 scope.go:117] "RemoveContainer" containerID="750fe01b67f2309e4eaf92cf459d1b81c9eb835fcdfa8d161388ee66f79eb274"
Sep 09 06:21:12.511709 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.511685    2583 scope.go:117] "RemoveContainer" containerID="8b176248d173f92e74752bd991cb6f5db436218cd6e1b2e199a74d7d1b348b35"
Sep 09 06:21:12.511985 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:21:12.511959    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b176248d173f92e74752bd991cb6f5db436218cd6e1b2e199a74d7d1b348b35\": container with ID starting with 8b176248d173f92e74752bd991cb6f5db436218cd6e1b2e199a74d7d1b348b35 not found: ID does not exist" containerID="8b176248d173f92e74752bd991cb6f5db436218cd6e1b2e199a74d7d1b348b35"
Sep 09 06:21:12.512045 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.512000    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b176248d173f92e74752bd991cb6f5db436218cd6e1b2e199a74d7d1b348b35"} err="failed to get container status \"8b176248d173f92e74752bd991cb6f5db436218cd6e1b2e199a74d7d1b348b35\": rpc error: code = NotFound desc = could not find container \"8b176248d173f92e74752bd991cb6f5db436218cd6e1b2e199a74d7d1b348b35\": container with ID starting with 8b176248d173f92e74752bd991cb6f5db436218cd6e1b2e199a74d7d1b348b35 not found: ID does not exist"
Sep 09 06:21:12.512045 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.512026    2583 scope.go:117] "RemoveContainer" containerID="750fe01b67f2309e4eaf92cf459d1b81c9eb835fcdfa8d161388ee66f79eb274"
Sep 09 06:21:12.512303 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:21:12.512285    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"750fe01b67f2309e4eaf92cf459d1b81c9eb835fcdfa8d161388ee66f79eb274\": container with ID starting with 750fe01b67f2309e4eaf92cf459d1b81c9eb835fcdfa8d161388ee66f79eb274 not found: ID does not exist" containerID="750fe01b67f2309e4eaf92cf459d1b81c9eb835fcdfa8d161388ee66f79eb274"
Sep 09 06:21:12.512364 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.512309    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750fe01b67f2309e4eaf92cf459d1b81c9eb835fcdfa8d161388ee66f79eb274"} err="failed to get container status \"750fe01b67f2309e4eaf92cf459d1b81c9eb835fcdfa8d161388ee66f79eb274\": rpc error: code = NotFound desc = could not find container \"750fe01b67f2309e4eaf92cf459d1b81c9eb835fcdfa8d161388ee66f79eb274\": container with ID starting with 750fe01b67f2309e4eaf92cf459d1b81c9eb835fcdfa8d161388ee66f79eb274 not found: ID does not exist"
Sep 09 06:21:12.516505 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.516481    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"]
Sep 09 06:21:12.519954 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:12.519934    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-7cf6be-openshift-default-76d8888876-5bnh6"]
Sep 09 06:21:13.252123 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:13.252083    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" path="/var/lib/kubelet/pods/ecd60c99-3d95-46b0-b739-2dea29198d46/volumes"
Sep 09 06:21:39.508415 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:39.508380    2583 scope.go:117] "RemoveContainer" containerID="5ae423271ffc6887405d2332e1d27b3c7b2afd49cf51fd1201b61e50288b9cd3"
Sep 09 06:21:44.120992 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:21:44.120958    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:22:32.431807 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:22:32.431704    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:22:33.376328 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:22:33.376296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:22:34.952992 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:22:34.952956    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:22:45.363933 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:22:45.363900    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:22:45.472721 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:22:45.472659    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:24:23.735264 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:24:23.735225    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:24:36.101429 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:24:36.101394    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:25:26.937405 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:25:26.937368    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:25:28.516860 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:25:28.516818    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:25:31.249184 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:25:31.249134    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:25:34.264257 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:25:34.264221    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:25:59.751573 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:25:59.751523    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:26:01.579767 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:01.579735    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:26:24.935299 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.935263    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"]
Sep 09 06:26:24.935962 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.935939    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="799bb589-c072-4ec7-8a37-7658055fc9c8" containerName="payload-pre-processing"
Sep 09 06:26:24.936022 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.935967    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="799bb589-c072-4ec7-8a37-7658055fc9c8" containerName="payload-pre-processing"
Sep 09 06:26:24.936022 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.935980    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="239fed21-105c-4ea4-9f74-a75ff2ac3598" containerName="istio-proxy"
Sep 09 06:26:24.936022 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.935989    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="239fed21-105c-4ea4-9f74-a75ff2ac3598" containerName="istio-proxy"
Sep 09 06:26:24.936022 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936005    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="080acac7-3408-43f5-a9f2-9fe606d7570b" containerName="payload-processing"
Sep 09 06:26:24.936022 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936014    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="080acac7-3408-43f5-a9f2-9fe606d7570b" containerName="payload-processing"
Sep 09 06:26:24.936196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936024    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0" containerName="payload-processing"
Sep 09 06:26:24.936196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936032    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0" containerName="payload-processing"
Sep 09 06:26:24.936196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936044    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62555542-12e9-447e-a7f3-ab2bf5c1ffa0" containerName="payload-processing"
Sep 09 06:26:24.936196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936052    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="62555542-12e9-447e-a7f3-ab2bf5c1ffa0" containerName="payload-processing"
Sep 09 06:26:24.936196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936062    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerName="istio-proxy"
Sep 09 06:26:24.936196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936069    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerName="istio-proxy"
Sep 09 06:26:24.936196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936077    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="239fed21-105c-4ea4-9f74-a75ff2ac3598" containerName="istio-proxy"
Sep 09 06:26:24.936196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936085    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="239fed21-105c-4ea4-9f74-a75ff2ac3598" containerName="istio-proxy"
Sep 09 06:26:24.936196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936101    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="422f1c34-0d33-4218-9047-07f6fd1044d4" containerName="payload-pre-processing"
Sep 09 06:26:24.936196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936108    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="422f1c34-0d33-4218-9047-07f6fd1044d4" containerName="payload-pre-processing"
Sep 09 06:26:24.936196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936118    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerName="istio-proxy"
Sep 09 06:26:24.936196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936126    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerName="istio-proxy"
Sep 09 06:26:24.936196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936136    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="756f3604-9f87-4d1c-811f-a7f29bde5910" containerName="payload-processing"
Sep 09 06:26:24.936196 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936143    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="756f3604-9f87-4d1c-811f-a7f29bde5910" containerName="payload-processing"
Sep 09 06:26:24.936686 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936231    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="239fed21-105c-4ea4-9f74-a75ff2ac3598" containerName="istio-proxy"
Sep 09 06:26:24.936686 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936244    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerName="istio-proxy"
Sep 09 06:26:24.936686 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936253    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecd60c99-3d95-46b0-b739-2dea29198d46" containerName="istio-proxy"
Sep 09 06:26:24.936686 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936262    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="239fed21-105c-4ea4-9f74-a75ff2ac3598" containerName="istio-proxy"
Sep 09 06:26:24.936686 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936271    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="080acac7-3408-43f5-a9f2-9fe606d7570b" containerName="payload-processing"
Sep 09 06:26:24.936686 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936280    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="62555542-12e9-447e-a7f3-ab2bf5c1ffa0" containerName="payload-processing"
Sep 09 06:26:24.936686 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936289    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a9adb7c-85d8-45ba-9a9f-b7a0cd16e8d0" containerName="payload-processing"
Sep 09 06:26:24.936686 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936299    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="756f3604-9f87-4d1c-811f-a7f29bde5910" containerName="payload-processing"
Sep 09 06:26:24.936686 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936308    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="422f1c34-0d33-4218-9047-07f6fd1044d4" containerName="payload-pre-processing"
Sep 09 06:26:24.936686 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.936317    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="799bb589-c072-4ec7-8a37-7658055fc9c8" containerName="payload-pre-processing"
Sep 09 06:26:24.939911 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.939883    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:24.948149 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:24.948121    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"]
Sep 09 06:26:25.051673 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.051641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2wqd\" (UniqueName: \"kubernetes.io/projected/4aa14ccf-8d73-44dd-86e0-38d33cc58d53-kube-api-access-p2wqd\") pod \"maas-api-6489fd66cd-8qf22\" (UID: \"4aa14ccf-8d73-44dd-86e0-38d33cc58d53\") " pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:25.051857 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.051698    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4aa14ccf-8d73-44dd-86e0-38d33cc58d53-openshift-service-ca\") pod \"maas-api-6489fd66cd-8qf22\" (UID: \"4aa14ccf-8d73-44dd-86e0-38d33cc58d53\") " pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:25.051857 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.051768    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4aa14ccf-8d73-44dd-86e0-38d33cc58d53-metrics-certs\") pod \"maas-api-6489fd66cd-8qf22\" (UID: \"4aa14ccf-8d73-44dd-86e0-38d33cc58d53\") " pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:25.051956 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.051856    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4aa14ccf-8d73-44dd-86e0-38d33cc58d53-maas-api-tls\") pod \"maas-api-6489fd66cd-8qf22\" (UID: \"4aa14ccf-8d73-44dd-86e0-38d33cc58d53\") " pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:25.153115 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.153082    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4aa14ccf-8d73-44dd-86e0-38d33cc58d53-openshift-service-ca\") pod \"maas-api-6489fd66cd-8qf22\" (UID: \"4aa14ccf-8d73-44dd-86e0-38d33cc58d53\") " pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:25.153291 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.153129    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4aa14ccf-8d73-44dd-86e0-38d33cc58d53-metrics-certs\") pod \"maas-api-6489fd66cd-8qf22\" (UID: \"4aa14ccf-8d73-44dd-86e0-38d33cc58d53\") " pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:25.153291 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.153192    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4aa14ccf-8d73-44dd-86e0-38d33cc58d53-maas-api-tls\") pod \"maas-api-6489fd66cd-8qf22\" (UID: \"4aa14ccf-8d73-44dd-86e0-38d33cc58d53\") " pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:25.153291 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.153239    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2wqd\" (UniqueName: \"kubernetes.io/projected/4aa14ccf-8d73-44dd-86e0-38d33cc58d53-kube-api-access-p2wqd\") pod \"maas-api-6489fd66cd-8qf22\" (UID: \"4aa14ccf-8d73-44dd-86e0-38d33cc58d53\") " pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:25.153748 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.153722    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4aa14ccf-8d73-44dd-86e0-38d33cc58d53-openshift-service-ca\") pod \"maas-api-6489fd66cd-8qf22\" (UID: \"4aa14ccf-8d73-44dd-86e0-38d33cc58d53\") " pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:25.155807 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.155786    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4aa14ccf-8d73-44dd-86e0-38d33cc58d53-maas-api-tls\") pod \"maas-api-6489fd66cd-8qf22\" (UID: \"4aa14ccf-8d73-44dd-86e0-38d33cc58d53\") " pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:25.155893 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.155846    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4aa14ccf-8d73-44dd-86e0-38d33cc58d53-metrics-certs\") pod \"maas-api-6489fd66cd-8qf22\" (UID: \"4aa14ccf-8d73-44dd-86e0-38d33cc58d53\") " pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:25.160449 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.160431    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2wqd\" (UniqueName: \"kubernetes.io/projected/4aa14ccf-8d73-44dd-86e0-38d33cc58d53-kube-api-access-p2wqd\") pod \"maas-api-6489fd66cd-8qf22\" (UID: \"4aa14ccf-8d73-44dd-86e0-38d33cc58d53\") " pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:25.254817 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.254746    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:25.527384 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.527359    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"]
Sep 09 06:26:25.529295 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:26:25.529265    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa14ccf_8d73_44dd_86e0_38d33cc58d53.slice/crio-a560351eda9a10bc0f63eb34ef234fa1e0f38dc489a62a5bd5d0c899afb7a146 WatchSource:0}: Error finding container a560351eda9a10bc0f63eb34ef234fa1e0f38dc489a62a5bd5d0c899afb7a146: Status 404 returned error can't find the container with id a560351eda9a10bc0f63eb34ef234fa1e0f38dc489a62a5bd5d0c899afb7a146
Sep 09 06:26:25.530661 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:25.530643    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 09 06:26:26.003689 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:26.003649    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22" event={"ID":"4aa14ccf-8d73-44dd-86e0-38d33cc58d53","Type":"ContainerStarted","Data":"a560351eda9a10bc0f63eb34ef234fa1e0f38dc489a62a5bd5d0c899afb7a146"}
Sep 09 06:26:27.009320 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:27.009283    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22" event={"ID":"4aa14ccf-8d73-44dd-86e0-38d33cc58d53","Type":"ContainerStarted","Data":"0bd4663e470456e57a71011097dbf84c9071206733350eff5c1454480488b4cf"}
Sep 09 06:26:27.009738 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:27.009419    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:27.026963 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:27.026915    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22" podStartSLOduration=2.498898026 podStartE2EDuration="3.026901382s" totalImagesPullingTime="528.003356ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 06:26:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:26:27.0253235 +0000 UTC m=+2208.255820053" watchObservedRunningTime="2026-09-09 06:26:27.026901382 +0000 UTC m=+2208.257397987"
Sep 09 06:26:33.019306 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:33.019275    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6489fd66cd-8qf22"
Sep 09 06:26:33.067980 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:33.067943    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"]
Sep 09 06:26:33.068289 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:33.068263    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst" podUID="daef917a-bae4-4185-9f82-c0d9572714ab" containerName="maas-api" containerID="cri-o://76952c49b0c6535dee255f1281d5ddeb3454fc66e106a4f2cab03901e8825555" gracePeriod=30
Sep 09 06:26:34.315386 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:34.315358    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 06:26:34.443676 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:34.443587    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qsk7g\" (UniqueName: \"kubernetes.io/projected/daef917a-bae4-4185-9f82-c0d9572714ab-kube-api-access-qsk7g\") pod \"daef917a-bae4-4185-9f82-c0d9572714ab\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") "
Sep 09 06:26:34.443844 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:34.443682    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-metrics-certs\") pod \"daef917a-bae4-4185-9f82-c0d9572714ab\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") "
Sep 09 06:26:34.443844 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:34.443710    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-maas-api-tls\") pod \"daef917a-bae4-4185-9f82-c0d9572714ab\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") "
Sep 09 06:26:34.443844 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:34.443782    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daef917a-bae4-4185-9f82-c0d9572714ab-openshift-service-ca\") pod \"daef917a-bae4-4185-9f82-c0d9572714ab\" (UID: \"daef917a-bae4-4185-9f82-c0d9572714ab\") "
Sep 09 06:26:34.444217 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:34.444187    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daef917a-bae4-4185-9f82-c0d9572714ab-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "daef917a-bae4-4185-9f82-c0d9572714ab" (UID: "daef917a-bae4-4185-9f82-c0d9572714ab"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 09 06:26:34.445972 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:34.445947    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "daef917a-bae4-4185-9f82-c0d9572714ab" (UID: "daef917a-bae4-4185-9f82-c0d9572714ab"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 06:26:34.446089 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:34.446004    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "daef917a-bae4-4185-9f82-c0d9572714ab" (UID: "daef917a-bae4-4185-9f82-c0d9572714ab"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 09 06:26:34.446089 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:34.446026    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daef917a-bae4-4185-9f82-c0d9572714ab-kube-api-access-qsk7g" (OuterVolumeSpecName: "kube-api-access-qsk7g") pod "daef917a-bae4-4185-9f82-c0d9572714ab" (UID: "daef917a-bae4-4185-9f82-c0d9572714ab"). InnerVolumeSpecName "kube-api-access-qsk7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 09 06:26:34.545306 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:34.545277    2583 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-metrics-certs\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:26:34.545306 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:34.545305    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/daef917a-bae4-4185-9f82-c0d9572714ab-maas-api-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:26:34.545500 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:34.545317    2583 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/daef917a-bae4-4185-9f82-c0d9572714ab-openshift-service-ca\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:26:34.545500 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:34.545329    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qsk7g\" (UniqueName: \"kubernetes.io/projected/daef917a-bae4-4185-9f82-c0d9572714ab-kube-api-access-qsk7g\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\""
Sep 09 06:26:35.049486 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:35.049445    2583 generic.go:356] "Generic (PLEG): container finished" podID="daef917a-bae4-4185-9f82-c0d9572714ab" containerID="76952c49b0c6535dee255f1281d5ddeb3454fc66e106a4f2cab03901e8825555" exitCode=0
Sep 09 06:26:35.049725 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:35.049491    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"
Sep 09 06:26:35.049725 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:35.049533    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst" event={"ID":"daef917a-bae4-4185-9f82-c0d9572714ab","Type":"ContainerDied","Data":"76952c49b0c6535dee255f1281d5ddeb3454fc66e106a4f2cab03901e8825555"}
Sep 09 06:26:35.049725 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:35.049640    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst" event={"ID":"daef917a-bae4-4185-9f82-c0d9572714ab","Type":"ContainerDied","Data":"599fa279374888c0ed7f29c3aa8b25a9e9a015238cdf9c31e88408df14ff544d"}
Sep 09 06:26:35.049725 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:35.049673    2583 scope.go:117] "RemoveContainer" containerID="76952c49b0c6535dee255f1281d5ddeb3454fc66e106a4f2cab03901e8825555"
Sep 09 06:26:35.060782 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:35.060767    2583 scope.go:117] "RemoveContainer" containerID="76952c49b0c6535dee255f1281d5ddeb3454fc66e106a4f2cab03901e8825555"
Sep 09 06:26:35.061325 ip-10-0-138-92 kubenswrapper[2583]: E0909 06:26:35.061300    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76952c49b0c6535dee255f1281d5ddeb3454fc66e106a4f2cab03901e8825555\": container with ID starting with 76952c49b0c6535dee255f1281d5ddeb3454fc66e106a4f2cab03901e8825555 not found: ID does not exist" containerID="76952c49b0c6535dee255f1281d5ddeb3454fc66e106a4f2cab03901e8825555"
Sep 09 06:26:35.061425 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:35.061333    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76952c49b0c6535dee255f1281d5ddeb3454fc66e106a4f2cab03901e8825555"} err="failed to get container status \"76952c49b0c6535dee255f1281d5ddeb3454fc66e106a4f2cab03901e8825555\": rpc error: code = NotFound desc = could not find container \"76952c49b0c6535dee255f1281d5ddeb3454fc66e106a4f2cab03901e8825555\": container with ID starting with 76952c49b0c6535dee255f1281d5ddeb3454fc66e106a4f2cab03901e8825555 not found: ID does not exist"
Sep 09 06:26:35.070976 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:35.070951    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"]
Sep 09 06:26:35.074758 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:35.074733    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-75c5f7dfb6-7kvst"]
Sep 09 06:26:35.244119 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:35.244091    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daef917a-bae4-4185-9f82-c0d9572714ab" path="/var/lib/kubelet/pods/daef917a-bae4-4185-9f82-c0d9572714ab/volumes"
Sep 09 06:26:59.523727 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:59.523698    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-d6ctg_8bb4a39c-2202-44d4-891a-7f9fa327147b/manager/0.log"
Sep 09 06:26:59.638142 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:59.638115    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kt2fb_1402266c-f0cf-46a2-97a3-57397f8c6571/manager/0.log"
Sep 09 06:26:59.875337 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:26:59.875312    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-74vf8_6376d560-5033-40ae-83f4-ac49af8b44a1/server/0.log"
Sep 09 06:27:00.098993 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:00.098964    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76b47fccc7-7s9fj_908b7ec4-5401-4db5-b267-e310f344741c/manager/0.log"
Sep 09 06:27:00.107997 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:00.107980    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76b47fccc7-7s9fj_908b7ec4-5401-4db5-b267-e310f344741c/copy-manifests/0.log"
Sep 09 06:27:00.807519 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:00.807483    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6489fd66cd-8qf22_4aa14ccf-8d73-44dd-86e0-38d33cc58d53/maas-api/0.log"
Sep 09 06:27:01.125795 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:01.125767    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-hvkz4_97bde255-64ed-4dd3-8e7f-535335d353a0/postgres/0.log"
Sep 09 06:27:02.576540 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:02.576504    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-jh7fx_00e26224-80c2-4c2c-a6b4-560a1f144aab/manager/0.log"
Sep 09 06:27:03.350533 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:03.350498    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-frjnr_c7f5c484-5318-4221-837e-e88218a305cf/istio-proxy/1.log"
Sep 09 06:27:03.580673 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:03.580645    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-db5d6_6a7d70d1-9372-4b20-a1c2-d1042e2d0053/payload-processing/0.log"
Sep 09 06:27:04.245334 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:04.245299    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-4wzt7_d66c8ef6-dfad-4ff9-a0c4-328c94c1027e/main/0.log"
Sep 09 06:27:04.459863 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:04.459828    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd5xvw_28562a41-ce6e-4056-8534-1c2f91edaa4a/main/0.log"
Sep 09 06:27:09.694656 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:09.694619    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:27:10.012649 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:10.012565    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log" limit=1024
Sep 09 06:27:12.705792 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:12.705760    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vrjtc_520a7d10-525f-4833-82e4-af34cfb43113/global-pull-secret-syncer/0.log"
Sep 09 06:27:12.753031 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:12.753007    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c4d7g_9a1ae559-6c27-4b42-8340-426579c69ea3/konnectivity-agent/0.log"
Sep 09 06:27:12.876236 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:12.876207    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-92.ec2.internal_b9e63e8088430f44e6db524784e88a1e/haproxy/0.log"
Sep 09 06:27:17.605117 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:17.605076    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-jh7fx_00e26224-80c2-4c2c-a6b4-560a1f144aab/manager/0.log"
Sep 09 06:27:19.207367 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.207335    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-2w7rs_b31f3fd3-5b7c-4582-9ad8-a6c440717758/kube-state-metrics/0.log"
Sep 09 06:27:19.224831 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.224811    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-2w7rs_b31f3fd3-5b7c-4582-9ad8-a6c440717758/kube-rbac-proxy-main/0.log"
Sep 09 06:27:19.245920 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.245893    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-2w7rs_b31f3fd3-5b7c-4582-9ad8-a6c440717758/kube-rbac-proxy-self/0.log"
Sep 09 06:27:19.300181 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.300158    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-ssps6_0a0d8715-c5cb-4a55-b295-72050d5c4695/monitoring-plugin/0.log"
Sep 09 06:27:19.396153 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.396131    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gwx6k_54b83360-5bed-4dfb-9f95-8208ef55e0f1/node-exporter/0.log"
Sep 09 06:27:19.415942 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.415919    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gwx6k_54b83360-5bed-4dfb-9f95-8208ef55e0f1/kube-rbac-proxy/0.log"
Sep 09 06:27:19.435988 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.435970    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gwx6k_54b83360-5bed-4dfb-9f95-8208ef55e0f1/init-textfile/0.log"
Sep 09 06:27:19.666143 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.666122    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0cb0e7f7-1756-4556-9f20-902926f20faf/prometheus/0.log"
Sep 09 06:27:19.692887 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.692862    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0cb0e7f7-1756-4556-9f20-902926f20faf/config-reloader/0.log"
Sep 09 06:27:19.722289 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.722259    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0cb0e7f7-1756-4556-9f20-902926f20faf/thanos-sidecar/0.log"
Sep 09 06:27:19.744357 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.744330    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0cb0e7f7-1756-4556-9f20-902926f20faf/kube-rbac-proxy-web/0.log"
Sep 09 06:27:19.772923 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.772907    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0cb0e7f7-1756-4556-9f20-902926f20faf/kube-rbac-proxy/0.log"
Sep 09 06:27:19.798284 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.798257    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0cb0e7f7-1756-4556-9f20-902926f20faf/kube-rbac-proxy-thanos/0.log"
Sep 09 06:27:19.822731 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.822712    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0cb0e7f7-1756-4556-9f20-902926f20faf/init-config-reloader/0.log"
Sep 09 06:27:19.854244 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.854223    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-wxp9h_a1ac7c29-c4ac-4300-bdf0-20427eb22527/prometheus-operator/0.log"
Sep 09 06:27:19.878306 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.878289    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-wxp9h_a1ac7c29-c4ac-4300-bdf0-20427eb22527/kube-rbac-proxy/0.log"
Sep 09 06:27:19.903988 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:19.903933    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-qnh8q_460dfc87-2707-4102-8548-8eafe480adf7/prometheus-operator-admission-webhook/0.log"
Sep 09 06:27:20.014477 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:20.014443    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576c466d8b-ml26v_444d4bc4-e456-4c44-9e47-aeccaacc7de6/thanos-query/0.log"
Sep 09 06:27:20.040980 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:20.040961    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576c466d8b-ml26v_444d4bc4-e456-4c44-9e47-aeccaacc7de6/kube-rbac-proxy-web/0.log"
Sep 09 06:27:20.063474 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:20.063455    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576c466d8b-ml26v_444d4bc4-e456-4c44-9e47-aeccaacc7de6/kube-rbac-proxy/0.log"
Sep 09 06:27:20.086419 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:20.086396    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576c466d8b-ml26v_444d4bc4-e456-4c44-9e47-aeccaacc7de6/prom-label-proxy/0.log"
Sep 09 06:27:20.107442 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:20.107423    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576c466d8b-ml26v_444d4bc4-e456-4c44-9e47-aeccaacc7de6/kube-rbac-proxy-rules/0.log"
Sep 09 06:27:20.132408 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:20.132362    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576c466d8b-ml26v_444d4bc4-e456-4c44-9e47-aeccaacc7de6/kube-rbac-proxy-metrics/0.log"
Sep 09 06:27:22.819091 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.819057    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"]
Sep 09 06:27:22.821438 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.819509    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daef917a-bae4-4185-9f82-c0d9572714ab" containerName="maas-api"
Sep 09 06:27:22.821438 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.819527    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="daef917a-bae4-4185-9f82-c0d9572714ab" containerName="maas-api"
Sep 09 06:27:22.821438 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.819667    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="daef917a-bae4-4185-9f82-c0d9572714ab" containerName="maas-api"
Sep 09 06:27:22.822577 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.822546    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:22.824835 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.824813    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kn2d7\"/\"kube-root-ca.crt\""
Sep 09 06:27:22.824960 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.824833    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kn2d7\"/\"default-dockercfg-z6lpm\""
Sep 09 06:27:22.824960 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.824930    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kn2d7\"/\"openshift-service-ca.crt\""
Sep 09 06:27:22.831637 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.831617    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"]
Sep 09 06:27:22.926646 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.926620    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-p2q5w_6d37742e-f304-4942-b1fd-84b1ca8aac5a/download-server/0.log"
Sep 09 06:27:22.976448 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.976417    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7859a004-530f-4c3a-a206-3fd1a3398c22-sys\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:22.976631 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.976454    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7859a004-530f-4c3a-a206-3fd1a3398c22-lib-modules\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:22.976631 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.976475    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8qzk\" (UniqueName: \"kubernetes.io/projected/7859a004-530f-4c3a-a206-3fd1a3398c22-kube-api-access-g8qzk\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:22.976631 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.976583    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7859a004-530f-4c3a-a206-3fd1a3398c22-proc\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:22.976631 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:22.976609    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7859a004-530f-4c3a-a206-3fd1a3398c22-podres\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:23.077598 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:23.077514    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7859a004-530f-4c3a-a206-3fd1a3398c22-sys\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:23.077598 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:23.077547    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7859a004-530f-4c3a-a206-3fd1a3398c22-lib-modules\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:23.077754 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:23.077600    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8qzk\" (UniqueName: \"kubernetes.io/projected/7859a004-530f-4c3a-a206-3fd1a3398c22-kube-api-access-g8qzk\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:23.077754 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:23.077639    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7859a004-530f-4c3a-a206-3fd1a3398c22-sys\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:23.077754 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:23.077653    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7859a004-530f-4c3a-a206-3fd1a3398c22-proc\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:23.077754 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:23.077701    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7859a004-530f-4c3a-a206-3fd1a3398c22-proc\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:23.077883 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:23.077766    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7859a004-530f-4c3a-a206-3fd1a3398c22-lib-modules\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:23.077883 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:23.077802    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7859a004-530f-4c3a-a206-3fd1a3398c22-podres\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:23.077958 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:23.077930    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7859a004-530f-4c3a-a206-3fd1a3398c22-podres\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:23.086460 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:23.086438    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8qzk\" (UniqueName: \"kubernetes.io/projected/7859a004-530f-4c3a-a206-3fd1a3398c22-kube-api-access-g8qzk\") pod \"perf-node-gather-daemonset-2ss68\" (UID: \"7859a004-530f-4c3a-a206-3fd1a3398c22\") " pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:23.133017 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:23.132996    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:23.401764 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:23.401738    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"]
Sep 09 06:27:23.403859 ip-10-0-138-92 kubenswrapper[2583]: W0909 06:27:23.403834    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7859a004_530f_4c3a_a206_3fd1a3398c22.slice/crio-0398a1db56e8c9b4dec5b33c0a80bb3b31f221543dcf955354d04e3a7601d1dd WatchSource:0}: Error finding container 0398a1db56e8c9b4dec5b33c0a80bb3b31f221543dcf955354d04e3a7601d1dd: Status 404 returned error can't find the container with id 0398a1db56e8c9b4dec5b33c0a80bb3b31f221543dcf955354d04e3a7601d1dd
Sep 09 06:27:24.286880 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:24.286845    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68" event={"ID":"7859a004-530f-4c3a-a206-3fd1a3398c22","Type":"ContainerStarted","Data":"6a0ad6a8b7f32363982220edc8a5b9aad226ac4f67d6367a5198a42804bb7b43"}
Sep 09 06:27:24.287277 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:24.286900    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68" event={"ID":"7859a004-530f-4c3a-a206-3fd1a3398c22","Type":"ContainerStarted","Data":"0398a1db56e8c9b4dec5b33c0a80bb3b31f221543dcf955354d04e3a7601d1dd"}
Sep 09 06:27:24.287277 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:24.286981    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:24.303042 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:24.302994    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68" podStartSLOduration=2.302979461 podStartE2EDuration="2.302979461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 06:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 06:27:24.301518911 +0000 UTC m=+2265.532015463" watchObservedRunningTime="2026-09-09 06:27:24.302979461 +0000 UTC m=+2265.533476013"
Sep 09 06:27:24.708727 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:24.708689    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bhz8k_92f78221-304b-4f78-8bd4-e5cce75dc050/dns/0.log"
Sep 09 06:27:24.729549 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:24.729528    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bhz8k_92f78221-304b-4f78-8bd4-e5cce75dc050/kube-rbac-proxy/0.log"
Sep 09 06:27:24.881817 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:24.881791    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rw6xb_65baeca2-3753-4a1a-8fbe-59ad7bb331ef/dns-node-resolver/0.log"
Sep 09 06:27:25.473062 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:25.473020    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7947bd4866-2jlwv_634c8c44-a831-4eb6-8a08-f8d4a4dc5f89/registry/0.log"
Sep 09 06:27:25.495046 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:25.495020    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8ffll_9838eb73-668a-4167-8daa-1c5c4db99b05/node-ca/0.log"
Sep 09 06:27:26.783303 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:26.783259    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-frjnr_c7f5c484-5318-4221-837e-e88218a305cf/istio-proxy/0.log"
Sep 09 06:27:26.792546 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:26.792522    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-frjnr_c7f5c484-5318-4221-837e-e88218a305cf/istio-proxy/1.log"
Sep 09 06:27:26.859430 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:26.859401    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-db5d6_6a7d70d1-9372-4b20-a1c2-d1042e2d0053/payload-processing/0.log"
Sep 09 06:27:27.741741 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:27.741710    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qphbh_bcb0044b-a0cc-4cfe-bff9-b03a025cddc7/serve-healthcheck-canary/0.log"
Sep 09 06:27:28.336012 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:28.335980    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w64nm_cdd27137-ac0c-40b6-b325-9964f25e4408/kube-rbac-proxy/0.log"
Sep 09 06:27:28.355305 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:28.355282    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w64nm_cdd27137-ac0c-40b6-b325-9964f25e4408/exporter/0.log"
Sep 09 06:27:28.375551 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:28.375529    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-w64nm_cdd27137-ac0c-40b6-b325-9964f25e4408/extractor/0.log"
Sep 09 06:27:30.301533 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:30.301499    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kn2d7/perf-node-gather-daemonset-2ss68"
Sep 09 06:27:30.414236 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:30.414207    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-d6ctg_8bb4a39c-2202-44d4-891a-7f9fa327147b/manager/0.log"
Sep 09 06:27:30.628808 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:30.628779    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kt2fb_1402266c-f0cf-46a2-97a3-57397f8c6571/manager/0.log"
Sep 09 06:27:30.695426 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:30.695402    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-74vf8_6376d560-5033-40ae-83f4-ac49af8b44a1/server/0.log"
Sep 09 06:27:30.797001 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:30.796972    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76b47fccc7-7s9fj_908b7ec4-5401-4db5-b267-e310f344741c/manager/0.log"
Sep 09 06:27:30.822402 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:30.822383    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-76b47fccc7-7s9fj_908b7ec4-5401-4db5-b267-e310f344741c/copy-manifests/0.log"
Sep 09 06:27:32.405485 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:32.405451    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58b7d76c47-scszn_fc072d9e-a9cc-4d31-90a2-ac6d923ea8c4/manager/0.log"
Sep 09 06:27:33.247362 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:33.247329    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-frjnr_c7f5c484-5318-4221-837e-e88218a305cf/istio-proxy/0.log"
Sep 09 06:27:33.253612 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:33.253577    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-frjnr_c7f5c484-5318-4221-837e-e88218a305cf/istio-proxy/1.log"
Sep 09 06:27:33.301401 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:33.301370    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-db5d6_6a7d70d1-9372-4b20-a1c2-d1042e2d0053/payload-processing/0.log"
Sep 09 06:27:35.119498 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:35.119466    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-frjnr_c7f5c484-5318-4221-837e-e88218a305cf/istio-proxy/0.log"
Sep 09 06:27:35.125944 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:35.125924    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-frjnr_c7f5c484-5318-4221-837e-e88218a305cf/istio-proxy/1.log"
Sep 09 06:27:35.180472 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:35.180446    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-db5d6_6a7d70d1-9372-4b20-a1c2-d1042e2d0053/payload-processing/0.log"
Sep 09 06:27:37.510781 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:37.510754    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-58pqj_c7e68f07-fb31-40d3-ad09-e7e7fe100bc1/migrator/0.log"
Sep 09 06:27:37.530456 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:37.530434    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-58pqj_c7e68f07-fb31-40d3-ad09-e7e7fe100bc1/graceful-termination/0.log"
Sep 09 06:27:38.946994 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:38.946969    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhzcv_e6726e06-34b8-4f2e-a7c6-8c44d438ec95/kube-multus-additional-cni-plugins/0.log"
Sep 09 06:27:38.972837 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:38.972806    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhzcv_e6726e06-34b8-4f2e-a7c6-8c44d438ec95/egress-router-binary-copy/0.log"
Sep 09 06:27:38.997453 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:38.997427    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhzcv_e6726e06-34b8-4f2e-a7c6-8c44d438ec95/cni-plugins/0.log"
Sep 09 06:27:39.021352 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:39.021328    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhzcv_e6726e06-34b8-4f2e-a7c6-8c44d438ec95/bond-cni-plugin/0.log"
Sep 09 06:27:39.046704 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:39.046681    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhzcv_e6726e06-34b8-4f2e-a7c6-8c44d438ec95/routeoverride-cni/0.log"
Sep 09 06:27:39.066546 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:39.066521    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhzcv_e6726e06-34b8-4f2e-a7c6-8c44d438ec95/whereabouts-cni-bincopy/0.log"
Sep 09 06:27:39.088509 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:39.088490    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bhzcv_e6726e06-34b8-4f2e-a7c6-8c44d438ec95/whereabouts-cni/0.log"
Sep 09 06:27:39.421342 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:39.421308    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-c6khh_947af4fe-d70e-4ead-ab39-5e74d11099b9/kube-multus/0.log"
Sep 09 06:27:39.578706 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:39.578678    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xk8g9_3d5ac5a4-7dcf-404a-a23a-a6700b982b7f/network-metrics-daemon/0.log"
Sep 09 06:27:39.595975 ip-10-0-138-92 kubenswrapper[2583]: I0909 06:27:39.595952    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xk8g9_3d5ac5a4-7dcf-404a-a23a-a6700b982b7f/kube-rbac-proxy/0.log"