Sep 18 19:39:16.202379 ip-10-0-135-240 systemd[1]: Starting Kubernetes Kubelet...
Sep 18 19:39:19.574459 ip-10-0-135-240 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 19:39:19.574459 ip-10-0-135-240 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 18 19:39:19.574459 ip-10-0-135-240 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 19:39:19.574459 ip-10-0-135-240 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 18 19:39:19.574459 ip-10-0-135-240 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 18 19:39:19.575265 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.574575    2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 18 19:39:19.579640 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579624    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:39:19.579640 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579639    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579643    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579646    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579649    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579653    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579656    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579659    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579662    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579665    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579667    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579670    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579672    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579682    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579685    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579688    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579691    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579693    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579697    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579699    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579702    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:39:19.579705 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579704    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579707    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579710    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579713    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579716    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579719    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579721    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579724    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579727    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579731    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579735    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579738    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579741    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579744    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579746    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579749    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579751    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579754    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579756    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:39:19.580212 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579759    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579761    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579764    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579766    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579769    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579771    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579774    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579777    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579779    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579781    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579784    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579786    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579789    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579791    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579794    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579800    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579803    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579805    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579808    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579811    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:39:19.580692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579813    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579816    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579819    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579822    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579824    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579827    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579829    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579832    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579834    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579837    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579839    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579842    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579844    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579847    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579849    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579852    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579855    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579858    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579860    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579863    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:39:19.581193 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579865    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579868    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579870    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579873    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579875    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579878    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579881    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579886    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579890    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579894    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579896    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579900    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579903    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579905    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579908    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579911    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579913    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579916    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.579919    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:39:19.581713 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580634    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580640    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580644    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580648    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580650    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580653    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580656    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580659    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580662    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580666    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580669    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580672    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580675    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580678    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580681    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580683    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580686    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580689    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580692    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580695    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:39:19.582203 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580698    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580700    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580703    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580706    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580709    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580712    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580714    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580717    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580720    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580723    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580726    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580728    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580731    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580733    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580736    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580738    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580741    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580743    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580746    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580749    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:39:19.582729 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580752    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580754    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580758    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580760    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580764    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580766    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580769    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580772    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580775    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580777    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580780    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580783    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580785    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580789    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580793    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580796    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580800    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580803    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580806    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:39:19.583241 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580810    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580813    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580816    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580818    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580821    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580824    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580827    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580829    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580832    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580834    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580837    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580839    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580842    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580844    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580847    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580850    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580853    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580856    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580859    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580862    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:39:19.583711 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580865    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580867    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580870    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580873    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580875    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580878    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580880    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580883    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580885    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580888    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580890    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580893    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580896    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580898    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580901    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580903    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580906    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580908    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580911    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:39:19.584219 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.580915    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581300    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581306    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581314    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581318    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581321    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581324    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581327    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581329    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581333    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581337    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581340    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581342    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581345    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581348    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581350    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581353    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581355    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581358    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581361    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:39:19.584720 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581363    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581366    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581369    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581371    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581374    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581376    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581379    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581382    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581384    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581386    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581389    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581392    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581396    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581399    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581402    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581407    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581409    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581412    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581415    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:39:19.585232 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581417    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581419    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581422    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581426    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581429    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581431    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581434    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581437    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581439    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581442    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581445    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581448    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581450    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581453    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581456    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581458    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581461    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581463    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581466    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:39:19.585692 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581469    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581471    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581474    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581477    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581479    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581483    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581485    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581488    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581490    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581494    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581497    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581499    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581502    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581505    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581507    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581509    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581513    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581516    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581519    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581521    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:39:19.586200 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581524    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581526    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581529    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581532    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581534    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581537    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581539    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581542    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581544    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581547    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581549    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581552    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581554    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581556    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581559    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581562    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581564    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581567    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581569    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581571    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:39:19.586676 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581574    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.581578    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581655    2583 flags.go:64] FLAG: --address="0.0.0.0"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581687    2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581693    2583 flags.go:64] FLAG: --anonymous-auth="true"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581698    2583 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581702    2583 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581705    2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581710    2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581715    2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581719    2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581723    2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581727    2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581730    2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581733    2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581736    2583 flags.go:64] FLAG: --cgroup-root=""
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581739    2583 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581742    2583 flags.go:64] FLAG: --client-ca-file=""
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581744    2583 flags.go:64] FLAG: --cloud-provider="external"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581747    2583 flags.go:64] FLAG: --cluster-dns="[]"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581752    2583 flags.go:64] FLAG: --cluster-domain=""
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581755    2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581758    2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581761    2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 18 19:39:19.587178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581764    2583 flags.go:64] FLAG: --container-log-max-files="5"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581768    2583 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581771    2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581774    2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581777    2583 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581780    2583 flags.go:64] FLAG: --contention-profiling="false"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581783    2583 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581786    2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581790    2583 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581796    2583 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581800    2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581803    2583 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581806    2583 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581809    2583 flags.go:64] FLAG: --enable-load-reader="false"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581813    2583 flags.go:64] FLAG: --enable-server="true"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581815    2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581820    2583 flags.go:64] FLAG: --event-burst="100"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581823    2583 flags.go:64] FLAG: --event-qps="50"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581826    2583 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581830    2583 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581833    2583 flags.go:64] FLAG: --eviction-hard=""
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581837    2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581839    2583 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581843    2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581853    2583 flags.go:64] FLAG: --eviction-soft=""
Sep 18 19:39:19.587782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581857    2583 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581860    2583 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581863    2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581866    2583 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581869    2583 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581872    2583 flags.go:64] FLAG: --fail-swap-on="true"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581875    2583 flags.go:64] FLAG: --feature-gates=""
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581879    2583 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581882    2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581885    2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581888    2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581891    2583 flags.go:64] FLAG: --healthz-port="10248"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581894    2583 flags.go:64] FLAG: --help="false"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581897    2583 flags.go:64] FLAG: --hostname-override="ip-10-0-135-240.ec2.internal"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581900    2583 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581903    2583 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581908    2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581911    2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581915    2583 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581918    2583 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581921    2583 flags.go:64] FLAG: --image-service-endpoint=""
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581923    2583 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581926    2583 flags.go:64] FLAG: --kube-api-burst="100"
Sep 18 19:39:19.588391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581929    2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581932    2583 flags.go:64] FLAG: --kube-api-qps="50"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581935    2583 flags.go:64] FLAG: --kube-reserved=""
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581938    2583 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581942    2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581946    2583 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581949    2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581952    2583 flags.go:64] FLAG: --lock-file=""
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581955    2583 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581958    2583 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581961    2583 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581966    2583 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581969    2583 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581972    2583 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581975    2583 flags.go:64] FLAG: --logging-format="text"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581978    2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581981    2583 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581984    2583 flags.go:64] FLAG: --manifest-url=""
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581987    2583 flags.go:64] FLAG: --manifest-url-header=""
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581992    2583 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581995    2583 flags.go:64] FLAG: --max-open-files="1000000"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.581999    2583 flags.go:64] FLAG: --max-pods="110"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582002    2583 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582005    2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582008    2583 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 18 19:39:19.588979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582013    2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582016    2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582019    2583 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582022    2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582029    2583 flags.go:64] FLAG: --node-status-max-images="50"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582032    2583 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582048    2583 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582051    2583 flags.go:64] FLAG: --pod-cidr=""
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582054    2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582059    2583 flags.go:64] FLAG: --pod-manifest-path=""
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582062    2583 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582065    2583 flags.go:64] FLAG: --pods-per-core="0"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582069    2583 flags.go:64] FLAG: --port="10250"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582072    2583 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582075    2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0467fd743262dd151"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582078    2583 flags.go:64] FLAG: --qos-reserved=""
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582081    2583 flags.go:64] FLAG: --read-only-port="10255"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582084    2583 flags.go:64] FLAG: --register-node="true"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582087    2583 flags.go:64] FLAG: --register-with-taints=""
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582091    2583 flags.go:64] FLAG: --registry-burst="10"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582094    2583 flags.go:64] FLAG: --registry-qps="5"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582096    2583 flags.go:64] FLAG: --reserved-cpus=""
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582100    2583 flags.go:64] FLAG: --reserved-memory=""
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582103    2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582106    2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 18 19:39:19.589654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582109    2583 flags.go:64] FLAG: --rotate-certificates="false"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582112    2583 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582115    2583 flags.go:64] FLAG: --runonce="false"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582117    2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582120    2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582124    2583 flags.go:64] FLAG: --seccomp-default="false"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582127    2583 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582129    2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582134    2583 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582137    2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582139    2583 flags.go:64] FLAG: --storage-driver-password="root"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582142    2583 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582145    2583 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582148    2583 flags.go:64] FLAG: --storage-driver-user="root"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582151    2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582154    2583 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582157    2583 flags.go:64] FLAG: --system-cgroups=""
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582160    2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582165    2583 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582168    2583 flags.go:64] FLAG: --tls-cert-file=""
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582171    2583 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582175    2583 flags.go:64] FLAG: --tls-min-version=""
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582178    2583 flags.go:64] FLAG: --tls-private-key-file=""
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582181    2583 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582184    2583 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 18 19:39:19.590297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582187    2583 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582189    2583 flags.go:64] FLAG: --v="2"
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582193    2583 flags.go:64] FLAG: --version="false"
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582197    2583 flags.go:64] FLAG: --vmodule=""
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582200    2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.582205    2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582320    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582324    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582327    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582329    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582332    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582335    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582337    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582341    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582343    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582347    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582350    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582353    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582355    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582358    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582361    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:39:19.590896 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582363    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582366    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582369    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582372    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582375    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582377    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582380    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582386    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582388    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582391    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582394    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582396    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582399    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582401    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582404    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582407    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582410    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582415    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582419    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:39:19.591460 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582422    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582425    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582427    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582430    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582432    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582435    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582438    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582443    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582446    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582448    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582451    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582455    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582459    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582462    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582465    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582468    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582470    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582473    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582476    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:39:19.591922 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582479    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582482    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582485    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582487    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582490    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582492    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582495    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582498    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582500    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582503    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582507    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582510    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582512    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582515    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582517    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582520    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582522    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582525    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582528    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582530    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:39:19.592404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582534    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582537    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582540    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582542    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582545    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582547    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582550    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582553    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582556    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582568    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582571    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582574    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582577    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582580    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582583    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582586    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582588    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582591    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582593    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582596    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:39:19.592899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582599    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582601    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582605    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582608    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582610    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.582613    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.583233    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.590475    2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.590491    2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.590512    2583 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.590518    2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590579    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590584    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590587    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590591    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:39:19.593449 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590594    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590597    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590601    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590604    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590606    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590609    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590612    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590614    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590617    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590620    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590622    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590625    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590628    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590631    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590633    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590636    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590638    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590641    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590644    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590646    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:39:19.593822 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590650    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590654    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590657    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590659    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590662    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590673    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590676    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590678    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590681    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590684    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590686    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590689    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590692    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590695    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590697    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590700    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590703    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590705    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590708    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590711    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:39:19.594323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590714    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590717    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590720    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590722    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590725    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590727    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590730    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590732    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590735    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590738    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590740    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590743    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590746    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590748    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590751    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590753    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590756    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590759    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590768    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590771    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:39:19.594934 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590773    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590776    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590779    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590781    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590784    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590787    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590790    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590792    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590795    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590797    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590800    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590802    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590805    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590808    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590810    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590813    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590815    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590818    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590820    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:39:19.595500 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590823    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590827    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590831    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590834    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590838    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590842    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590845    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590848    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590851    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590854    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590857    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590859    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590868    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590871    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590873    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:39:19.595960 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.590876    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:39:19.596423 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.590881    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 19:39:19.596423 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591029    2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 18 19:39:19.596423 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591034    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 18 19:39:19.596423 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591051    2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 18 19:39:19.596423 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591054    2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 18 19:39:19.596423 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591057    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 18 19:39:19.596423 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591059    2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 18 19:39:19.596423 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591062    2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 18 19:39:19.596423 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591065    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 18 19:39:19.596423 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591067    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 18 19:39:19.596423 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591071    2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 18 19:39:19.596423 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591074    2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 18 19:39:19.596423 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591077    2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 18 19:39:19.596423 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591079    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591082    2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591084    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591088    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591090    2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591093    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591096    2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591098    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591101    2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591104    2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591106    2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591109    2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591112    2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591114    2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591117    2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591120    2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591129    2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591132    2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591134    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591137    2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 18 19:39:19.596768 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591140    2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591142    2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591145    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591147    2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591150    2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591152    2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591155    2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591158    2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591160    2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591163    2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591165    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591168    2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591171    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591173    2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591175    2583 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591179    2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591181    2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591184    2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591186    2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591189    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 18 19:39:19.597278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591192    2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591194    2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591197    2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591199    2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591202    2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591204    2583 feature_gate.go:328] unrecognized feature gate: Example2
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591207    2583 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591210    2583 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591212    2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591221    2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591224    2583 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591226    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591229    2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591231    2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591234    2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591237    2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591239    2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591242    2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591244    2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591247    2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591250    2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 18 19:39:19.597760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591252    2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591255    2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591257    2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591260    2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591262    2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591265    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591267    2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591270    2583 feature_gate.go:328] unrecognized feature gate: Example
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591273    2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591276    2583 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591279    2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591283    2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591286    2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591289    2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591292    2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591294    2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591297    2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591301    2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 18 19:39:19.598323 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591304    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 18 19:39:19.598756 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591308    2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 18 19:39:19.598756 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591312    2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 18 19:39:19.598756 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591321    2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 18 19:39:19.598756 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591324    2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 18 19:39:19.598756 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591327    2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 18 19:39:19.598756 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591329    2583 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 18 19:39:19.598756 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:19.591332    2583 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 18 19:39:19.598756 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.591338    2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 18 19:39:19.598756 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.591494    2583 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 18 19:39:19.598756 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.593642    2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 18 19:39:19.598756 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.594617    2583 server.go:1019] "Starting client certificate rotation"
Sep 18 19:39:19.598756 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.594797    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 19:39:19.598756 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.595486    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 18 19:39:19.599139 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.597963    2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 19:39:19.599139 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.599063    2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 18 19:39:19.603870 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.603853    2583 log.go:25] "Validated CRI v1 runtime API"
Sep 18 19:39:19.606295 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.606279    2583 log.go:25] "Validated CRI v1 image API"
Sep 18 19:39:19.607117 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.607101    2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 18 19:39:19.609880 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.609861    2583 fs.go:135] Filesystem UUIDs: map[2e0ffd7a-a9a6-46bb-ad92-0a2d90cc6835:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9efa4823-facf-41d7-a83e-7f0911d3f013:/dev/nvme0n1p3]
Sep 18 19:39:19.609948 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.609878    2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 18 19:39:19.614397 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.614280    2583 manager.go:216] Machine: {Timestamp:2026-09-18 19:39:19.613747704 +0000 UTC m=+1.940841459 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098917 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ee4ba5f74a06063c1a8d2e61c4d76 SystemUUID:ec2ee4ba-5f74-a060-63c1-a8d2e61c4d76 BootID:72cbd94c-0944-4dcc-8d04-2b8a68b4c7d7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:cf:4d:20:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:cf:4d:20:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:f0:a9:2b:9b:b3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 18 19:39:19.614397 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.614390    2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 18 19:39:19.614517 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.614460    2583 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 18 19:39:19.616453 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.616429    2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 18 19:39:19.616677 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.616457    2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-240.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 18 19:39:19.617286 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.617273    2583 topology_manager.go:138] "Creating topology manager with none policy"
Sep 18 19:39:19.617338 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.617293    2583 container_manager_linux.go:309] "Creating device plugin manager"
Sep 18 19:39:19.617338 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.617304    2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 19:39:19.617338 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.617320    2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 18 19:39:19.617454 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.617411    2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 18 19:39:19.620053 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.620027    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 19:39:19.620204 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.620193    2583 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 18 19:39:19.620272 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.620236    2583 kubelet.go:486] "Attempting to sync node with API server"
Sep 18 19:39:19.620272 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.620251    2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 18 19:39:19.620360 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.620295    2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 18 19:39:19.620360 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.620312    2583 kubelet.go:398] "Adding apiserver pod source"
Sep 18 19:39:19.620360 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.620328    2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 18 19:39:19.620764 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.620750    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 19:39:19.620829 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.620773    2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 18 19:39:19.623349 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.623329    2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 18 19:39:19.626577 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.626541    2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 18 19:39:19.626653 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.626609    2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 18 19:39:19.627969 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.627949    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 18 19:39:19.628063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.627975    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 18 19:39:19.628063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.627983    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 18 19:39:19.628063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.627988    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 18 19:39:19.628063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.627997    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 18 19:39:19.628063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.628004    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 18 19:39:19.628063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.628019    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 18 19:39:19.628063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.628024    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 18 19:39:19.628063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.628031    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 18 19:39:19.628063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.628051    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 18 19:39:19.628063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.628067    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 18 19:39:19.628350 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.628073    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 18 19:39:19.628350 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.628098    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 18 19:39:19.628350 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.628106    2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 18 19:39:19.630553 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.630533    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 19:39:19.632049 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.632026    2583 server.go:1268] "Started kubelet"
Sep 18 19:39:19.632182 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.632132    2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 18 19:39:19.632182 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.632146    2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 18 19:39:19.632319 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.632199    2583 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 18 19:39:19.632958 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.632937    2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-240.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 18 19:39:19.632958 ip-10-0-135-240 systemd[1]: Started Kubernetes Kubelet.
Sep 18 19:39:19.633638 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.633277    2583 server.go:310] "Adding debug handlers to kubelet server"
Sep 18 19:39:19.633638 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.633293    2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 18 19:39:19.633638 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.633347    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 18 19:39:19.633638 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.633354    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 18 19:39:19.636501 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.636474    2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 18 19:39:19.638878 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.638862    2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 18 19:39:19.638950 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.638876    2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 18 19:39:19.638950 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.638940    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Sep 18 19:39:19.639683 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.639661    2583 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 18 19:39:19.639683 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.639685    2583 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 18 19:39:19.639802 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.639705    2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 18 19:39:19.639802 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.639752    2583 factory.go:55] Registering systemd factory
Sep 18 19:39:19.639802 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.639767    2583 factory.go:223] Registration of the systemd container factory successfully
Sep 18 19:39:19.639943 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.639825    2583 reconstruct.go:97] "Volume reconstruction finished"
Sep 18 19:39:19.639943 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.639834    2583 reconciler.go:29] "Reconciler: start to sync state"
Sep 18 19:39:19.640024 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.639995    2583 factory.go:153] Registering CRI-O factory
Sep 18 19:39:19.640024 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.640005    2583 factory.go:223] Registration of the crio container factory successfully
Sep 18 19:39:19.640176 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.640062    2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 18 19:39:19.640176 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.640084    2583 factory.go:103] Registering Raw factory
Sep 18 19:39:19.640176 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.640100    2583 manager.go:1196] Started watching for new ooms in manager
Sep 18 19:39:19.640528 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.640514    2583 manager.go:349] Starting recovery of all containers
Sep 18 19:39:19.642231 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.642205    2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 18 19:39:19.642430 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.642402    2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 18 19:39:19.672820 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.672656    2583 manager.go:354] Recovery completed
Sep 18 19:39:19.677879 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.677865    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:39:19.678348 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.678333    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c88vz"
Sep 18 19:39:19.681696 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.681679    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:39:19.681751 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.681709    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:39:19.681751 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.681723    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:39:19.682349 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.682329    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:39:19.682448 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.682335    2583 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 18 19:39:19.682448 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.682372    2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 18 19:39:19.682448 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.682396    2583 state_mem.go:36] "Initialized new in-memory state store"
Sep 18 19:39:19.683081 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.683064    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:39:19.683174 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.683091    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:39:19.683174 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.683101    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:39:19.683476 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.682417    2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-240.ec2.internal.18d6819084f0ca7a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-240.ec2.internal,UID:ip-10-0-135-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-240.ec2.internal,},FirstTimestamp:2026-09-18 19:39:19.631997562 +0000 UTC m=+1.959091316,LastTimestamp:2026-09-18 19:39:19.631997562 +0000 UTC m=+1.959091316,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-240.ec2.internal,}"
Sep 18 19:39:19.683476 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.683475    2583 policy_none.go:49] "None policy: Start"
Sep 18 19:39:19.683593 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.683488    2583 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 18 19:39:19.683593 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.683498    2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 18 19:39:19.684389 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.684376    2583 policy_none.go:47] "Start"
Sep 18 19:39:19.686524 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.686506    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c88vz"
Sep 18 19:39:19.716696 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.716677    2583 manager.go:337] "Starting Device Plugin manager"
Sep 18 19:39:19.728636 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.716731    2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 18 19:39:19.728636 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.716745    2583 server.go:87] "Starting device plugin registration server"
Sep 18 19:39:19.728636 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.717004    2583 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 18 19:39:19.728636 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.717025    2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 18 19:39:19.728636 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.717148    2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 18 19:39:19.728636 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.717238    2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 18 19:39:19.728636 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.717247    2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 18 19:39:19.728636 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.717828    2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 18 19:39:19.728636 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.717879    2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-240.ec2.internal\" not found"
Sep 18 19:39:19.803153 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.803115    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 18 19:39:19.804374 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.804359    2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 18 19:39:19.804427 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.804412    2583 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 18 19:39:19.804469 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.804437    2583 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 18 19:39:19.804511 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.804483    2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 18 19:39:19.807448 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.807429    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:39:19.818087 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.818069    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:39:19.819160 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.819142    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:39:19.819275 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.819173    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:39:19.819275 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.819189    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:39:19.819275 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.819210    2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-240.ec2.internal"
Sep 18 19:39:19.829074 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.829018    2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-240.ec2.internal"
Sep 18 19:39:19.829074 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.829058    2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-240.ec2.internal\": node \"ip-10-0-135-240.ec2.internal\" not found"
Sep 18 19:39:19.857305 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.857285    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Sep 18 19:39:19.905155 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.905124    2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"]
Sep 18 19:39:19.905306 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.905252    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:39:19.906288 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.906273    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:39:19.906388 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.906316    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:39:19.906388 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.906332    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:39:19.907613 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.907595    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:39:19.907728 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.907714    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:19.907775 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.907742    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:39:19.908466 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.908451    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:39:19.908466 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.908460    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:39:19.908598 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.908483    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:39:19.908598 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.908499    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:39:19.908689 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.908484    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:39:19.908689 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.908628    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:39:19.909713 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.909695    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:19.909790 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.909727    2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 18 19:39:19.910504 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.910488    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory"
Sep 18 19:39:19.910589 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.910514    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure"
Sep 18 19:39:19.910589 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.910530    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID"
Sep 18 19:39:19.938917 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.938887    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-240.ec2.internal\" not found" node="ip-10-0-135-240.ec2.internal"
Sep 18 19:39:19.940966 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.940947    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/507a24b2ffe92f3b87cfca5c4f26c0f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"507a24b2ffe92f3b87cfca5c4f26c0f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:19.941034 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.940973    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/507a24b2ffe92f3b87cfca5c4f26c0f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"507a24b2ffe92f3b87cfca5c4f26c0f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:19.941034 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:19.940993    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04ddfa7d8805c056a864c45acb85b2eb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-240.ec2.internal\" (UID: \"04ddfa7d8805c056a864c45acb85b2eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:19.942407 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.942387    2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-240.ec2.internal\" not found" node="ip-10-0-135-240.ec2.internal"
Sep 18 19:39:19.958075 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:19.958033    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Sep 18 19:39:20.041711 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.041681    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/507a24b2ffe92f3b87cfca5c4f26c0f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"507a24b2ffe92f3b87cfca5c4f26c0f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:20.041711 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.041713    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/507a24b2ffe92f3b87cfca5c4f26c0f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"507a24b2ffe92f3b87cfca5c4f26c0f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:20.041834 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.041731    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04ddfa7d8805c056a864c45acb85b2eb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-240.ec2.internal\" (UID: \"04ddfa7d8805c056a864c45acb85b2eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:20.041834 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.041776    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/507a24b2ffe92f3b87cfca5c4f26c0f5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"507a24b2ffe92f3b87cfca5c4f26c0f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:20.041904 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.041830    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/507a24b2ffe92f3b87cfca5c4f26c0f5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"507a24b2ffe92f3b87cfca5c4f26c0f5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:20.041904 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.041861    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/04ddfa7d8805c056a864c45acb85b2eb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-240.ec2.internal\" (UID: \"04ddfa7d8805c056a864c45acb85b2eb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:20.058824 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.058786    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Sep 18 19:39:20.159661 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.159619    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Sep 18 19:39:20.243005 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.242976    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:20.245625 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.245606    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:20.260541 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.260503    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Sep 18 19:39:20.361113 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.361072    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Sep 18 19:39:20.461703 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.461618    2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found"
Sep 18 19:39:20.548730 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.548702    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:39:20.595150 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.595116    2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 18 19:39:20.595742 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.595255    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 19:39:20.595742 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.595306    2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 18 19:39:20.621468 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.621440    2583 apiserver.go:52] "Watching apiserver"
Sep 18 19:39:20.639786 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.639749    2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 18 19:39:20.639786 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.639754    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:20.643978 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.643324    2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 18 19:39:20.644577 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.644554    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ntbrb","kube-system/konnectivity-agent-7vlhj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw","openshift-cluster-node-tuning-operator/tuned-7m7bm","openshift-multus/multus-additional-cni-plugins-hv4r5","openshift-multus/network-metrics-daemon-qqfbz","openshift-network-diagnostics/network-check-target-mjnpd","openshift-ovn-kubernetes/ovnkube-node-zggbw","openshift-dns/node-resolver-dbv6f","openshift-image-registry/node-ca-zqk5q","openshift-multus/multus-v955m","openshift-network-operator/iptables-alerter-q7lp5"]
Sep 18 19:39:20.646285 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.646268    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.647368 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.647343    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:20.647450 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.647411    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:20.648405 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.648389    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 18 19:39:20.648494 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.648404    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 18 19:39:20.648494 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.648427    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-92kf7\""
Sep 18 19:39:20.648494 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.648463    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:20.648607 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.648524    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:20.648607 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.648519    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 18 19:39:20.649377 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.649363    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dbv6f"
Sep 18 19:39:20.649425 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.649412    2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 18 19:39:20.650317 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.650302    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zqk5q"
Sep 18 19:39:20.651481 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.651465    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 18 19:39:20.651571 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.651556    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 18 19:39:20.651690 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.651676    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.652094 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.652079    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dlrjv\""
Sep 18 19:39:20.652197 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.652179    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 18 19:39:20.652554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.652539    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 18 19:39:20.652613 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.652595    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cvmz8\""
Sep 18 19:39:20.652695 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.652683    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 18 19:39:20.652984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.652968    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:20.653070 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.653053    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:20.653555 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.653542    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 18 19:39:20.653695 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.653684    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 18 19:39:20.653866 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.653853    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 18 19:39:20.654167 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.654155    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7vlhj"
Sep 18 19:39:20.654833 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.654777    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 19:39:20.654833 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.654817    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 18 19:39:20.654833 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.654832    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gmtbw\""
Sep 18 19:39:20.655016 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.654855    2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"
Sep 18 19:39:20.655984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.655968    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.656332 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.656319    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 18 19:39:20.656399 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.656388    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 18 19:39:20.656508 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.656494    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nh8kh\""
Sep 18 19:39:20.657422 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.657408    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.658052 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.658026    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 18 19:39:20.658139 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.658126    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 18 19:39:20.658200 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.658192    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hblpp\""
Sep 18 19:39:20.658769 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.658757    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.659648 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.659632    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 18 19:39:20.659741 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.659638    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m7nqj\""
Sep 18 19:39:20.659815 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.659797    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 18 19:39:20.659916 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.659833    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"]
Sep 18 19:39:20.659973 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.659915    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q7lp5"
Sep 18 19:39:20.660807 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.660790    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 18 19:39:20.661975 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.661951    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 18 19:39:20.662094 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.662078    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qkpgr\""
Sep 18 19:39:20.662169 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.662107    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 18 19:39:20.662169 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.662126    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 18 19:39:20.662308 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.662210    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 18 19:39:20.662308 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.662261    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 18 19:39:20.662428 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.662366    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 18 19:39:20.662482 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.662446    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 18 19:39:20.662618 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.662600    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 18 19:39:20.663153 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.663134    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5l25g\""
Sep 18 19:39:20.663451 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.663435    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"]
Sep 18 19:39:20.663543 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.663454    2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 18 19:39:20.672493 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.672474    2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m7xtw"
Sep 18 19:39:20.680491 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.680472    2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m7xtw"
Sep 18 19:39:20.685556 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.685533    2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:39:20.690867 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.690825    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-17 19:34:19 +0000 UTC" deadline="2028-03-17 09:35:07.73030357 +0000 UTC"
Sep 18 19:39:20.690867 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.690863    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13093h55m47.039442842s"
Sep 18 19:39:20.741055 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.741024    2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 18 19:39:20.746029 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746005    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-var-lib-kubelet\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.746153 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746033    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f0786db-0fd7-4113-ab68-7fc1a4048560-kubelet-config\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:20.746153 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746096    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-log-socket\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.746153 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746115    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-node-log\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.746153 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746131    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53867202-24a8-425c-b9c5-ada8d6cc631e-env-overrides\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.746300 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746154    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b5106ce-c269-414c-b49b-cd669145501f-iptables-alerter-script\") pod \"iptables-alerter-q7lp5\" (UID: \"6b5106ce-c269-414c-b49b-cd669145501f\") " pod="openshift-network-operator/iptables-alerter-q7lp5"
Sep 18 19:39:20.746300 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746188    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kbx7\" (UniqueName: \"kubernetes.io/projected/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-kube-api-access-6kbx7\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.746300 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746221    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc8gv\" (UniqueName: \"kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv\") pod \"network-check-target-mjnpd\" (UID: \"21ec5095-12ad-49d8-96d2-f0c7179768a4\") " pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:20.746300 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746237    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhvtm\" (UniqueName: \"kubernetes.io/projected/7502ed14-3896-469a-b1e2-8e58bf1433a1-kube-api-access-dhvtm\") pod \"node-resolver-dbv6f\" (UID: \"7502ed14-3896-469a-b1e2-8e58bf1433a1\") " pod="openshift-dns/node-resolver-dbv6f"
Sep 18 19:39:20.746300 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746267    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19f67046-5187-4f84-b4ad-1ef94c8a8e27-serviceca\") pod \"node-ca-zqk5q\" (UID: \"19f67046-5187-4f84-b4ad-1ef94c8a8e27\") " pod="openshift-image-registry/node-ca-zqk5q"
Sep 18 19:39:20.746300 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746287    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-run-k8s-cni-cncf-io\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.746554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746316    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-etc-openvswitch\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.746554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746334    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53867202-24a8-425c-b9c5-ada8d6cc631e-ovnkube-config\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.746554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746378    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b83ca37a-46bd-4d22-9fa2-f9d3517200e6-agent-certs\") pod \"konnectivity-agent-7vlhj\" (UID: \"b83ca37a-46bd-4d22-9fa2-f9d3517200e6\") " pod="kube-system/konnectivity-agent-7vlhj"
Sep 18 19:39:20.746554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746410    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f0786db-0fd7-4113-ab68-7fc1a4048560-dbus\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:20.746554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-sysctl-conf\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.746554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746458    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-registration-dir\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.746554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746481    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-sys-fs\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.746554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746502    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-kubelet\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.746554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746517    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-systemd-units\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.746554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746532    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-var-lib-openvswitch\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.746554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746553    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-systemd\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746572    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-run\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746587    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7502ed14-3896-469a-b1e2-8e58bf1433a1-hosts-file\") pod \"node-resolver-dbv6f\" (UID: \"7502ed14-3896-469a-b1e2-8e58bf1433a1\") " pod="openshift-dns/node-resolver-dbv6f"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746600    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-multus-cni-dir\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746615    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746639    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746659    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19f67046-5187-4f84-b4ad-1ef94c8a8e27-host\") pod \"node-ca-zqk5q\" (UID: \"19f67046-5187-4f84-b4ad-1ef94c8a8e27\") " pod="openshift-image-registry/node-ca-zqk5q"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746689    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s97kq\" (UniqueName: \"kubernetes.io/projected/19f67046-5187-4f84-b4ad-1ef94c8a8e27-kube-api-access-s97kq\") pod \"node-ca-zqk5q\" (UID: \"19f67046-5187-4f84-b4ad-1ef94c8a8e27\") " pod="openshift-image-registry/node-ca-zqk5q"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746714    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/743090bb-ae20-420a-82b1-2a9157f6d299-cni-binary-copy\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746736    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-hostroot\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746758    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/743090bb-ae20-420a-82b1-2a9157f6d299-multus-daemon-config\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746783    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlg5s\" (UniqueName: \"kubernetes.io/projected/743090bb-ae20-420a-82b1-2a9157f6d299-kube-api-access-mlg5s\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746808    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-sysconfig\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746832    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-host\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746857    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746881    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-var-lib-cni-bin\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746904    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-multus-conf-dir\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.746999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746926    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-modprobe-d\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746953    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-run-netns\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746975    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-var-lib-kubelet\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.746998    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747018    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747032    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-system-cni-dir\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747077    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-cnibin\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747102    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747134    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-tuned\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747153    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-system-cni-dir\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747167    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-slash\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747181    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-run-openvswitch\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747195    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-run-ovn\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747215    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-cni-bin\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747238    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-socket-dir\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747260    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b83ca37a-46bd-4d22-9fa2-f9d3517200e6-konnectivity-ca\") pod \"konnectivity-agent-7vlhj\" (UID: \"b83ca37a-46bd-4d22-9fa2-f9d3517200e6\") " pod="kube-system/konnectivity-agent-7vlhj"
Sep 18 19:39:20.747661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747284    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-tmp\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747303    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747319    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747336    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-device-dir\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747350    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-run-multus-certs\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747368    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-run-systemd\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747383    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53867202-24a8-425c-b9c5-ada8d6cc631e-ovn-node-metrics-cert\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747397    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c2k8\" (UniqueName: \"kubernetes.io/projected/6b5106ce-c269-414c-b49b-cd669145501f-kube-api-access-7c2k8\") pod \"iptables-alerter-q7lp5\" (UID: \"6b5106ce-c269-414c-b49b-cd669145501f\") " pod="openshift-network-operator/iptables-alerter-q7lp5"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swv6r\" (UniqueName: \"kubernetes.io/projected/f4839d65-2531-49a9-b4fb-0a752464b27e-kube-api-access-swv6r\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747429    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-kubernetes\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747452    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-sysctl-d\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747469    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-lib-modules\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747496    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-cnibin\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-cni-netd\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747555    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53867202-24a8-425c-b9c5-ada8d6cc631e-ovnkube-script-lib\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747585    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b5106ce-c269-414c-b49b-cd669145501f-host-slash\") pod \"iptables-alerter-q7lp5\" (UID: \"6b5106ce-c269-414c-b49b-cd669145501f\") " pod="openshift-network-operator/iptables-alerter-q7lp5"
Sep 18 19:39:20.748235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747609    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-cni-binary-copy\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.748723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747628    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.748723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747657    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-multus-socket-dir-parent\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.748723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747693    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-var-lib-cni-multus\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.748723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747726    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-etc-kubernetes\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.748723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747748    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-sys\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.748723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747780    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgdlr\" (UniqueName: \"kubernetes.io/projected/b1f37600-119a-43f1-9bca-846a323869cb-kube-api-access-pgdlr\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.748723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747814    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7502ed14-3896-469a-b1e2-8e58bf1433a1-tmp-dir\") pod \"node-resolver-dbv6f\" (UID: \"7502ed14-3896-469a-b1e2-8e58bf1433a1\") " pod="openshift-dns/node-resolver-dbv6f"
Sep 18 19:39:20.748723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747838    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-run-netns\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.748723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747865    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg59v\" (UniqueName: \"kubernetes.io/projected/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-kube-api-access-gg59v\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.748723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.747890    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnjb2\" (UniqueName: \"kubernetes.io/projected/53867202-24a8-425c-b9c5-ada8d6cc631e-kube-api-access-mnjb2\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.804481 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.804456    2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:39:20.831547 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.831525    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 19:39:20.848613 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848584    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b5106ce-c269-414c-b49b-cd669145501f-iptables-alerter-script\") pod \"iptables-alerter-q7lp5\" (UID: \"6b5106ce-c269-414c-b49b-cd669145501f\") " pod="openshift-network-operator/iptables-alerter-q7lp5"
Sep 18 19:39:20.848613 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848613    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kbx7\" (UniqueName: \"kubernetes.io/projected/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-kube-api-access-6kbx7\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.848839 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848629    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc8gv\" (UniqueName: \"kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv\") pod \"network-check-target-mjnpd\" (UID: \"21ec5095-12ad-49d8-96d2-f0c7179768a4\") " pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:20.848839 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848650    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhvtm\" (UniqueName: \"kubernetes.io/projected/7502ed14-3896-469a-b1e2-8e58bf1433a1-kube-api-access-dhvtm\") pod \"node-resolver-dbv6f\" (UID: \"7502ed14-3896-469a-b1e2-8e58bf1433a1\") " pod="openshift-dns/node-resolver-dbv6f"
Sep 18 19:39:20.848839 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848666    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19f67046-5187-4f84-b4ad-1ef94c8a8e27-serviceca\") pod \"node-ca-zqk5q\" (UID: \"19f67046-5187-4f84-b4ad-1ef94c8a8e27\") " pod="openshift-image-registry/node-ca-zqk5q"
Sep 18 19:39:20.848839 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848680    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-run-k8s-cni-cncf-io\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.848839 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848701    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-etc-openvswitch\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.848839 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848724    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53867202-24a8-425c-b9c5-ada8d6cc631e-ovnkube-config\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.848839 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848743    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-run-k8s-cni-cncf-io\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.848839 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848750    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b83ca37a-46bd-4d22-9fa2-f9d3517200e6-agent-certs\") pod \"konnectivity-agent-7vlhj\" (UID: \"b83ca37a-46bd-4d22-9fa2-f9d3517200e6\") " pod="kube-system/konnectivity-agent-7vlhj"
Sep 18 19:39:20.848839 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848786    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f0786db-0fd7-4113-ab68-7fc1a4048560-dbus\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:20.848839 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848806    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-etc-openvswitch\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848934    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f0786db-0fd7-4113-ab68-7fc1a4048560-dbus\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848947    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-sysctl-conf\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848814    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-sysctl-conf\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.848990    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-registration-dir\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849016    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-sys-fs\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849072    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-kubelet\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849097    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-systemd-units\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849104    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-registration-dir\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849117    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-var-lib-openvswitch\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849159    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-var-lib-openvswitch\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849160    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-systemd\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849205    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-run\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849211    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-kubelet\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849218    2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7502ed14-3896-469a-b1e2-8e58bf1433a1-hosts-file\") pod \"node-resolver-dbv6f\" (UID: \"7502ed14-3896-469a-b1e2-8e58bf1433a1\") " pod="openshift-dns/node-resolver-dbv6f"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849250    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-systemd-units\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849270    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-multus-cni-dir\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.849344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849295    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-run\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849298    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849332    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849358    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19f67046-5187-4f84-b4ad-1ef94c8a8e27-host\") pod \"node-ca-zqk5q\" (UID: \"19f67046-5187-4f84-b4ad-1ef94c8a8e27\") " pod="openshift-image-registry/node-ca-zqk5q"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s97kq\" (UniqueName: \"kubernetes.io/projected/19f67046-5187-4f84-b4ad-1ef94c8a8e27-kube-api-access-s97kq\") pod \"node-ca-zqk5q\" (UID: \"19f67046-5187-4f84-b4ad-1ef94c8a8e27\") " pod="openshift-image-registry/node-ca-zqk5q"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/743090bb-ae20-420a-82b1-2a9157f6d299-cni-binary-copy\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849430    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7502ed14-3896-469a-b1e2-8e58bf1433a1-hosts-file\") pod \"node-resolver-dbv6f\" (UID: \"7502ed14-3896-469a-b1e2-8e58bf1433a1\") " pod="openshift-dns/node-resolver-dbv6f"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849436    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-hostroot\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.849462    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849466    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/53867202-24a8-425c-b9c5-ada8d6cc631e-ovnkube-config\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849482    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-hostroot\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849486    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-multus-cni-dir\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849361    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/19f67046-5187-4f84-b4ad-1ef94c8a8e27-serviceca\") pod \"node-ca-zqk5q\" (UID: \"19f67046-5187-4f84-b4ad-1ef94c8a8e27\") " pod="openshift-image-registry/node-ca-zqk5q"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849501    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19f67046-5187-4f84-b4ad-1ef94c8a8e27-host\") pod \"node-ca-zqk5q\" (UID: \"19f67046-5187-4f84-b4ad-1ef94c8a8e27\") " pod="openshift-image-registry/node-ca-zqk5q"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849515    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/743090bb-ae20-420a-82b1-2a9157f6d299-multus-daemon-config\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.849550    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret podName:8f0786db-0fd7-4113-ab68-7fc1a4048560 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:21.349529505 +0000 UTC m=+3.676623270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret") pod "global-pull-secret-syncer-ntbrb" (UID: "8f0786db-0fd7-4113-ab68-7fc1a4048560") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849587    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlg5s\" (UniqueName: \"kubernetes.io/projected/743090bb-ae20-420a-82b1-2a9157f6d299-kube-api-access-mlg5s\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.850217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849617    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-sysconfig\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849657    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-host\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849680    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849706    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-var-lib-cni-bin\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849747    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-multus-conf-dir\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849457    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6b5106ce-c269-414c-b49b-cd669145501f-iptables-alerter-script\") pod \"iptables-alerter-q7lp5\" (UID: \"6b5106ce-c269-414c-b49b-cd669145501f\") " pod="openshift-network-operator/iptables-alerter-q7lp5"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849771    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-modprobe-d\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849812    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-host\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849818    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-run-netns\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849858    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-var-lib-kubelet\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849873    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-modprobe-d\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849130    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-sys-fs\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849899    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-var-lib-cni-bin\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849916    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-multus-conf-dir\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849548    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-systemd\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849894    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849933    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.851186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849860    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-run-netns\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849960    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849984    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-system-cni-dir\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.849983    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/743090bb-ae20-420a-82b1-2a9157f6d299-cni-binary-copy\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850008    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-sysconfig\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850024    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-etc-selinux\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850049    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-cnibin\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850069    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850078    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850084    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-system-cni-dir\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850093    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-tuned\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850093    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-cnibin\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850095    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-var-lib-kubelet\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850121    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-system-cni-dir\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850154    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-slash\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.850163    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850179    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-run-openvswitch\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.851984 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.850213    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs podName:f4839d65-2531-49a9-b4fb-0a752464b27e nodeName:}" failed. No retries permitted until 2026-09-18 19:39:21.350196806 +0000 UTC m=+3.677290573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs") pod "network-metrics-daemon-qqfbz" (UID: "f4839d65-2531-49a9-b4fb-0a752464b27e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850218    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-slash\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850229    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-run-openvswitch\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850232    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-system-cni-dir\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850247    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-run-ovn\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850272    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-cni-bin\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850305    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-socket-dir\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850328    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-run-ovn\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850333    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-cni-bin\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850330    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b83ca37a-46bd-4d22-9fa2-f9d3517200e6-konnectivity-ca\") pod \"konnectivity-agent-7vlhj\" (UID: \"b83ca37a-46bd-4d22-9fa2-f9d3517200e6\") " pod="kube-system/konnectivity-agent-7vlhj"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-tmp\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850390    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850408    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850432    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-device-dir\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850456    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-run-multus-certs\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850481    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-run-systemd\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850502    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53867202-24a8-425c-b9c5-ada8d6cc631e-ovn-node-metrics-cert\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.852716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850511    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/743090bb-ae20-420a-82b1-2a9157f6d299-multus-daemon-config\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850525    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c2k8\" (UniqueName: \"kubernetes.io/projected/6b5106ce-c269-414c-b49b-cd669145501f-kube-api-access-7c2k8\") pod \"iptables-alerter-q7lp5\" (UID: \"6b5106ce-c269-414c-b49b-cd669145501f\") " pod="openshift-network-operator/iptables-alerter-q7lp5"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850438    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-socket-dir\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850553    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swv6r\" (UniqueName: \"kubernetes.io/projected/f4839d65-2531-49a9-b4fb-0a752464b27e-kube-api-access-swv6r\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850576    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-kubernetes\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850584    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b1f37600-119a-43f1-9bca-846a323869cb-device-dir\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850599    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-sysctl-d\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850623    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-lib-modules\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850628    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-run-multus-certs\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850646    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-cnibin\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850692    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-cni-netd\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850706    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-kubernetes\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850717    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53867202-24a8-425c-b9c5-ada8d6cc631e-ovnkube-script-lib\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b5106ce-c269-414c-b49b-cd669145501f-host-slash\") pod \"iptables-alerter-q7lp5\" (UID: \"6b5106ce-c269-414c-b49b-cd669145501f\") " pod="openshift-network-operator/iptables-alerter-q7lp5"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850757    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-run-systemd\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850766    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-cni-binary-copy\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850791    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.853224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850826    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b83ca37a-46bd-4d22-9fa2-f9d3517200e6-konnectivity-ca\") pod \"konnectivity-agent-7vlhj\" (UID: \"b83ca37a-46bd-4d22-9fa2-f9d3517200e6\") " pod="kube-system/konnectivity-agent-7vlhj"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850849    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-cnibin\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850946    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-lib-modules\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.850932    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-sysctl-d\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851008    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b5106ce-c269-414c-b49b-cd669145501f-host-slash\") pod \"iptables-alerter-q7lp5\" (UID: \"6b5106ce-c269-414c-b49b-cd669145501f\") " pod="openshift-network-operator/iptables-alerter-q7lp5"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-host-cni-netd\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851151    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851161    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851181    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-multus-socket-dir-parent\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851210    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-var-lib-cni-multus\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851236    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-etc-kubernetes\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851274    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-sys\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851297    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgdlr\" (UniqueName: \"kubernetes.io/projected/b1f37600-119a-43f1-9bca-846a323869cb-kube-api-access-pgdlr\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851321    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7502ed14-3896-469a-b1e2-8e58bf1433a1-tmp-dir\") pod \"node-resolver-dbv6f\" (UID: \"7502ed14-3896-469a-b1e2-8e58bf1433a1\") " pod="openshift-dns/node-resolver-dbv6f"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-run-netns\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851398    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg59v\" (UniqueName: \"kubernetes.io/projected/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-kube-api-access-gg59v\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851422    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnjb2\" (UniqueName: \"kubernetes.io/projected/53867202-24a8-425c-b9c5-ada8d6cc631e-kube-api-access-mnjb2\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.853684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851465    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-var-lib-kubelet\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851489    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f0786db-0fd7-4113-ab68-7fc1a4048560-kubelet-config\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851514    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-log-socket\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851533    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/53867202-24a8-425c-b9c5-ada8d6cc631e-ovnkube-script-lib\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851539    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-node-log\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851564    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53867202-24a8-425c-b9c5-ada8d6cc631e-env-overrides\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851571    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-cni-binary-copy\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851615    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851640    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-etc-kubernetes\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851643    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-run-netns\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851700    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-host-var-lib-cni-multus\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851755    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/743090bb-ae20-420a-82b1-2a9157f6d299-multus-socket-dir-parent\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851783    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7502ed14-3896-469a-b1e2-8e58bf1433a1-tmp-dir\") pod \"node-resolver-dbv6f\" (UID: \"7502ed14-3896-469a-b1e2-8e58bf1433a1\") " pod="openshift-dns/node-resolver-dbv6f"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851856    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f0786db-0fd7-4113-ab68-7fc1a4048560-kubelet-config\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851888    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-node-log\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851906    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-sys\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851933    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/53867202-24a8-425c-b9c5-ada8d6cc631e-log-socket\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.851955    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-var-lib-kubelet\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.854242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.852142    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/53867202-24a8-425c-b9c5-ada8d6cc631e-env-overrides\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.854772 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.852768    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-etc-tuned\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.854772 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.852799    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b83ca37a-46bd-4d22-9fa2-f9d3517200e6-agent-certs\") pod \"konnectivity-agent-7vlhj\" (UID: \"b83ca37a-46bd-4d22-9fa2-f9d3517200e6\") " pod="kube-system/konnectivity-agent-7vlhj"
Sep 18 19:39:20.854772 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.852972    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/53867202-24a8-425c-b9c5-ada8d6cc631e-ovn-node-metrics-cert\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.854772 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.853559    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-tmp\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.862021 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.862001    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:39:20.862131 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.862028    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:39:20.862131 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.862060    2583 projected.go:196] Error preparing data for projected volume kube-api-access-pc8gv for pod openshift-network-diagnostics/network-check-target-mjnpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:20.862131 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:20.862111    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv podName:21ec5095-12ad-49d8-96d2-f0c7179768a4 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:21.362095067 +0000 UTC m=+3.689188826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pc8gv" (UniqueName: "kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv") pod "network-check-target-mjnpd" (UID: "21ec5095-12ad-49d8-96d2-f0c7179768a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:20.863632 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.863613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlg5s\" (UniqueName: \"kubernetes.io/projected/743090bb-ae20-420a-82b1-2a9157f6d299-kube-api-access-mlg5s\") pod \"multus-v955m\" (UID: \"743090bb-ae20-420a-82b1-2a9157f6d299\") " pod="openshift-multus/multus-v955m"
Sep 18 19:39:20.863715 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.863654    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s97kq\" (UniqueName: \"kubernetes.io/projected/19f67046-5187-4f84-b4ad-1ef94c8a8e27-kube-api-access-s97kq\") pod \"node-ca-zqk5q\" (UID: \"19f67046-5187-4f84-b4ad-1ef94c8a8e27\") " pod="openshift-image-registry/node-ca-zqk5q"
Sep 18 19:39:20.863715 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.863667    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhvtm\" (UniqueName: \"kubernetes.io/projected/7502ed14-3896-469a-b1e2-8e58bf1433a1-kube-api-access-dhvtm\") pod \"node-resolver-dbv6f\" (UID: \"7502ed14-3896-469a-b1e2-8e58bf1433a1\") " pod="openshift-dns/node-resolver-dbv6f"
Sep 18 19:39:20.864237 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.864223    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kbx7\" (UniqueName: \"kubernetes.io/projected/b1401fc5-e30e-4a75-a88d-6fddf0053f0f-kube-api-access-6kbx7\") pod \"tuned-7m7bm\" (UID: \"b1401fc5-e30e-4a75-a88d-6fddf0053f0f\") " pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:20.866115 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.866095    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swv6r\" (UniqueName: \"kubernetes.io/projected/f4839d65-2531-49a9-b4fb-0a752464b27e-kube-api-access-swv6r\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:20.867299 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.867282    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c2k8\" (UniqueName: \"kubernetes.io/projected/6b5106ce-c269-414c-b49b-cd669145501f-kube-api-access-7c2k8\") pod \"iptables-alerter-q7lp5\" (UID: \"6b5106ce-c269-414c-b49b-cd669145501f\") " pod="openshift-network-operator/iptables-alerter-q7lp5"
Sep 18 19:39:20.867594 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.867574    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg59v\" (UniqueName: \"kubernetes.io/projected/56f66ac8-8aa6-4fbb-b20a-5f89e15fa483-kube-api-access-gg59v\") pod \"multus-additional-cni-plugins-hv4r5\" (UID: \"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483\") " pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:20.867806 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.867791    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnjb2\" (UniqueName: \"kubernetes.io/projected/53867202-24a8-425c-b9c5-ada8d6cc631e-kube-api-access-mnjb2\") pod \"ovnkube-node-zggbw\" (UID: \"53867202-24a8-425c-b9c5-ada8d6cc631e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:20.867912 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.867897    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgdlr\" (UniqueName: \"kubernetes.io/projected/b1f37600-119a-43f1-9bca-846a323869cb-kube-api-access-pgdlr\") pod \"aws-ebs-csi-driver-node-8zxnw\" (UID: \"b1f37600-119a-43f1-9bca-846a323869cb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.984572 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:20.984497    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw"
Sep 18 19:39:20.992947 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:20.992906    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f37600_119a_43f1_9bca_846a323869cb.slice/crio-1d2fe203c377a034f1876d8415d9de5aa586ae570b51fbcbb2547786bad9b11b WatchSource:0}: Error finding container 1d2fe203c377a034f1876d8415d9de5aa586ae570b51fbcbb2547786bad9b11b: Status 404 returned error can't find the container with id 1d2fe203c377a034f1876d8415d9de5aa586ae570b51fbcbb2547786bad9b11b
Sep 18 19:39:21.000665 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.000645    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dbv6f"
Sep 18 19:39:21.007711 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.007687    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zqk5q"
Sep 18 19:39:21.007815 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:21.007787    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7502ed14_3896_469a_b1e2_8e58bf1433a1.slice/crio-86d7f13bc697a899de1a991bf89165d98b1991e1e9e63287782730d4b0420f63 WatchSource:0}: Error finding container 86d7f13bc697a899de1a991bf89165d98b1991e1e9e63287782730d4b0420f63: Status 404 returned error can't find the container with id 86d7f13bc697a899de1a991bf89165d98b1991e1e9e63287782730d4b0420f63
Sep 18 19:39:21.016053 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:21.016014    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f67046_5187_4f84_b4ad_1ef94c8a8e27.slice/crio-e6e363a1f88ec563dcc7cabd89a991bdbfdf79bfa9662030b1b3ea07b62fb4eb WatchSource:0}: Error finding container e6e363a1f88ec563dcc7cabd89a991bdbfdf79bfa9662030b1b3ea07b62fb4eb: Status 404 returned error can't find the container with id e6e363a1f88ec563dcc7cabd89a991bdbfdf79bfa9662030b1b3ea07b62fb4eb
Sep 18 19:39:21.034415 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.034394    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v955m"
Sep 18 19:39:21.040181 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.040159    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7vlhj"
Sep 18 19:39:21.041899 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:21.041873    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743090bb_ae20_420a_82b1_2a9157f6d299.slice/crio-a699525548507a5fb618da1407565a4feff74f8633587fb53c70b3165781c16a WatchSource:0}: Error finding container a699525548507a5fb618da1407565a4feff74f8633587fb53c70b3165781c16a: Status 404 returned error can't find the container with id a699525548507a5fb618da1407565a4feff74f8633587fb53c70b3165781c16a
Sep 18 19:39:21.048075 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:21.048032    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83ca37a_46bd_4d22_9fa2_f9d3517200e6.slice/crio-a296a86810deede90389bbb069e9c1250ba51bf634cf0305d15bcdb8d9cc19c5 WatchSource:0}: Error finding container a296a86810deede90389bbb069e9c1250ba51bf634cf0305d15bcdb8d9cc19c5: Status 404 returned error can't find the container with id a296a86810deede90389bbb069e9c1250ba51bf634cf0305d15bcdb8d9cc19c5
Sep 18 19:39:21.059626 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.059600    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7m7bm"
Sep 18 19:39:21.066687 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:21.066662    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1401fc5_e30e_4a75_a88d_6fddf0053f0f.slice/crio-c283b3cac77b424d7934b9e4f9c7dcfcfe703e277ab7ed20b2a420c4dc19d1a1 WatchSource:0}: Error finding container c283b3cac77b424d7934b9e4f9c7dcfcfe703e277ab7ed20b2a420c4dc19d1a1: Status 404 returned error can't find the container with id c283b3cac77b424d7934b9e4f9c7dcfcfe703e277ab7ed20b2a420c4dc19d1a1
Sep 18 19:39:21.088852 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.088823    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hv4r5"
Sep 18 19:39:21.096455 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:21.096431    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56f66ac8_8aa6_4fbb_b20a_5f89e15fa483.slice/crio-8fffa189d358b82f70ce7599814f358cee1f6b186e00ec14e327dbd471624332 WatchSource:0}: Error finding container 8fffa189d358b82f70ce7599814f358cee1f6b186e00ec14e327dbd471624332: Status 404 returned error can't find the container with id 8fffa189d358b82f70ce7599814f358cee1f6b186e00ec14e327dbd471624332
Sep 18 19:39:21.107734 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.107712    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:21.111875 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.111858    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-q7lp5"
Sep 18 19:39:21.115879 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:21.115860    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53867202_24a8_425c_b9c5_ada8d6cc631e.slice/crio-832c5f3dc3ad56065286c289057dd0979ee51c85f8bb01577df504d8e9722813 WatchSource:0}: Error finding container 832c5f3dc3ad56065286c289057dd0979ee51c85f8bb01577df504d8e9722813: Status 404 returned error can't find the container with id 832c5f3dc3ad56065286c289057dd0979ee51c85f8bb01577df504d8e9722813
Sep 18 19:39:21.119770 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:21.119750    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b5106ce_c269_414c_b49b_cd669145501f.slice/crio-8f75039fe08386e27aba34eda4661aef08f5c89fa705e87d3ecdd42f131de998 WatchSource:0}: Error finding container 8f75039fe08386e27aba34eda4661aef08f5c89fa705e87d3ecdd42f131de998: Status 404 returned error can't find the container with id 8f75039fe08386e27aba34eda4661aef08f5c89fa705e87d3ecdd42f131de998
Sep 18 19:39:21.355149 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.355105    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:21.355330 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.355167    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:21.355330 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:21.355276    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:21.355447 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:21.355346    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret podName:8f0786db-0fd7-4113-ab68-7fc1a4048560 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:22.355325088 +0000 UTC m=+4.682418831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret") pod "global-pull-secret-syncer-ntbrb" (UID: "8f0786db-0fd7-4113-ab68-7fc1a4048560") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:21.355447 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:21.355284    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:21.355447 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:21.355398    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs podName:f4839d65-2531-49a9-b4fb-0a752464b27e nodeName:}" failed. No retries permitted until 2026-09-18 19:39:22.355385973 +0000 UTC m=+4.682479725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs") pod "network-metrics-daemon-qqfbz" (UID: "f4839d65-2531-49a9-b4fb-0a752464b27e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:21.456203 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.456164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc8gv\" (UniqueName: \"kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv\") pod \"network-check-target-mjnpd\" (UID: \"21ec5095-12ad-49d8-96d2-f0c7179768a4\") " pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:21.456382 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:21.456349    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:39:21.456382 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:21.456371    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:39:21.456382 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:21.456383    2583 projected.go:196] Error preparing data for projected volume kube-api-access-pc8gv for pod openshift-network-diagnostics/network-check-target-mjnpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:21.456557 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:21.456444    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv podName:21ec5095-12ad-49d8-96d2-f0c7179768a4 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:22.456426148 +0000 UTC m=+4.783519901 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pc8gv" (UniqueName: "kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv") pod "network-check-target-mjnpd" (UID: "21ec5095-12ad-49d8-96d2-f0c7179768a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:21.682602 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.682485    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 19:34:20 +0000 UTC" deadline="2028-04-09 04:51:26.013230226 +0000 UTC"
Sep 18 19:39:21.682602 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.682553    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13641h12m4.33068137s"
Sep 18 19:39:21.750726 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.750626    2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:39:21.804850 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.804823    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:21.805024 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:21.804950    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:21.815733 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.815677    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw" event={"ID":"53867202-24a8-425c-b9c5-ada8d6cc631e","Type":"ContainerStarted","Data":"832c5f3dc3ad56065286c289057dd0979ee51c85f8bb01577df504d8e9722813"}
Sep 18 19:39:21.833397 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.833284    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hv4r5" event={"ID":"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483","Type":"ContainerStarted","Data":"8fffa189d358b82f70ce7599814f358cee1f6b186e00ec14e327dbd471624332"}
Sep 18 19:39:21.841568 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.841525    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7m7bm" event={"ID":"b1401fc5-e30e-4a75-a88d-6fddf0053f0f","Type":"ContainerStarted","Data":"c283b3cac77b424d7934b9e4f9c7dcfcfe703e277ab7ed20b2a420c4dc19d1a1"}
Sep 18 19:39:21.853128 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.853088    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7vlhj" event={"ID":"b83ca37a-46bd-4d22-9fa2-f9d3517200e6","Type":"ContainerStarted","Data":"a296a86810deede90389bbb069e9c1250ba51bf634cf0305d15bcdb8d9cc19c5"}
Sep 18 19:39:21.867358 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.867311    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v955m" event={"ID":"743090bb-ae20-420a-82b1-2a9157f6d299","Type":"ContainerStarted","Data":"a699525548507a5fb618da1407565a4feff74f8633587fb53c70b3165781c16a"}
Sep 18 19:39:21.876315 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.876278    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zqk5q" event={"ID":"19f67046-5187-4f84-b4ad-1ef94c8a8e27","Type":"ContainerStarted","Data":"e6e363a1f88ec563dcc7cabd89a991bdbfdf79bfa9662030b1b3ea07b62fb4eb"}
Sep 18 19:39:21.890215 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.890173    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" event={"ID":"507a24b2ffe92f3b87cfca5c4f26c0f5","Type":"ContainerStarted","Data":"8bbbbd37369e5928c32687e4e99b7cb27a173a277c282e0a0aa6ee596a4aa2db"}
Sep 18 19:39:21.903263 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.903210    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q7lp5" event={"ID":"6b5106ce-c269-414c-b49b-cd669145501f","Type":"ContainerStarted","Data":"8f75039fe08386e27aba34eda4661aef08f5c89fa705e87d3ecdd42f131de998"}
Sep 18 19:39:21.911300 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.911265    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dbv6f" event={"ID":"7502ed14-3896-469a-b1e2-8e58bf1433a1","Type":"ContainerStarted","Data":"86d7f13bc697a899de1a991bf89165d98b1991e1e9e63287782730d4b0420f63"}
Sep 18 19:39:21.923277 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.923242    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw" event={"ID":"b1f37600-119a-43f1-9bca-846a323869cb","Type":"ContainerStarted","Data":"1d2fe203c377a034f1876d8415d9de5aa586ae570b51fbcbb2547786bad9b11b"}
Sep 18 19:39:21.942568 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:21.942284    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" event={"ID":"04ddfa7d8805c056a864c45acb85b2eb","Type":"ContainerStarted","Data":"8761856f75edf11a837638527bfe4de15fc5348b6a6ec551a3969b659b0ebcd1"}
Sep 18 19:39:22.364590 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:22.364552    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:22.364766 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:22.364608    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:22.364766 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:22.364724    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:22.364880 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:22.364783    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs podName:f4839d65-2531-49a9-b4fb-0a752464b27e nodeName:}" failed. No retries permitted until 2026-09-18 19:39:24.36476635 +0000 UTC m=+6.691860109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs") pod "network-metrics-daemon-qqfbz" (UID: "f4839d65-2531-49a9-b4fb-0a752464b27e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:22.365222 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:22.365200    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:22.365339 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:22.365258    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret podName:8f0786db-0fd7-4113-ab68-7fc1a4048560 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:24.365243322 +0000 UTC m=+6.692337079 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret") pod "global-pull-secret-syncer-ntbrb" (UID: "8f0786db-0fd7-4113-ab68-7fc1a4048560") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:22.465354 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:22.465317    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc8gv\" (UniqueName: \"kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv\") pod \"network-check-target-mjnpd\" (UID: \"21ec5095-12ad-49d8-96d2-f0c7179768a4\") " pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:22.465543 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:22.465526    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:39:22.465605 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:22.465545    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:39:22.465605 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:22.465560    2583 projected.go:196] Error preparing data for projected volume kube-api-access-pc8gv for pod openshift-network-diagnostics/network-check-target-mjnpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:22.465714 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:22.465627    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv podName:21ec5095-12ad-49d8-96d2-f0c7179768a4 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:24.465599453 +0000 UTC m=+6.792693201 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pc8gv" (UniqueName: "kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv") pod "network-check-target-mjnpd" (UID: "21ec5095-12ad-49d8-96d2-f0c7179768a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:22.682761 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:22.682672    2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-17 19:34:20 +0000 UTC" deadline="2028-06-01 10:03:58.45212428 +0000 UTC"
Sep 18 19:39:22.682761 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:22.682712    2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14918h24m35.769417673s"
Sep 18 19:39:22.804792 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:22.804761    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:22.804990 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:22.804909    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:22.805290 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:22.804761    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:22.805365 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:22.805346    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:23.645304 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:23.645273    2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 18 19:39:23.807023 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:23.806993    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:23.807481 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:23.807142    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:24.382396 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:24.382354    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:24.382572 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:24.382410    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:24.382572 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:24.382541    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:24.382693 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:24.382610    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs podName:f4839d65-2531-49a9-b4fb-0a752464b27e nodeName:}" failed. No retries permitted until 2026-09-18 19:39:28.382582519 +0000 UTC m=+10.709676260 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs") pod "network-metrics-daemon-qqfbz" (UID: "f4839d65-2531-49a9-b4fb-0a752464b27e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:24.383027 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:24.383006    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:24.383166 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:24.383075    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret podName:8f0786db-0fd7-4113-ab68-7fc1a4048560 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:28.383060341 +0000 UTC m=+10.710154097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret") pod "global-pull-secret-syncer-ntbrb" (UID: "8f0786db-0fd7-4113-ab68-7fc1a4048560") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:24.483437 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:24.483392    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc8gv\" (UniqueName: \"kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv\") pod \"network-check-target-mjnpd\" (UID: \"21ec5095-12ad-49d8-96d2-f0c7179768a4\") " pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:24.483611 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:24.483587    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:39:24.483680 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:24.483612    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:39:24.483680 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:24.483626    2583 projected.go:196] Error preparing data for projected volume kube-api-access-pc8gv for pod openshift-network-diagnostics/network-check-target-mjnpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:24.483780 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:24.483691    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv podName:21ec5095-12ad-49d8-96d2-f0c7179768a4 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:28.483672592 +0000 UTC m=+10.810766351 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pc8gv" (UniqueName: "kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv") pod "network-check-target-mjnpd" (UID: "21ec5095-12ad-49d8-96d2-f0c7179768a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:24.805666 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:24.805585    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:24.805826 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:24.805746    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:24.805826 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:24.805811    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:24.805960 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:24.805938    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:25.806503 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:25.805964    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:25.806503 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:25.806118    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:26.805298 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:26.805259    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:26.805298 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:26.805296    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:26.805530 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:26.805408    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:26.805607 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:26.805574    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:27.806692 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:27.806421    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:27.806692 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:27.806559    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:28.420796 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:28.420746    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:28.420796 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:28.420807    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:28.421076 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:28.420948    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:28.421076 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:28.421013    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs podName:f4839d65-2531-49a9-b4fb-0a752464b27e nodeName:}" failed. No retries permitted until 2026-09-18 19:39:36.420993026 +0000 UTC m=+18.748086788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs") pod "network-metrics-daemon-qqfbz" (UID: "f4839d65-2531-49a9-b4fb-0a752464b27e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:28.421507 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:28.421421    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:28.421507 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:28.421475    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret podName:8f0786db-0fd7-4113-ab68-7fc1a4048560 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:36.421458907 +0000 UTC m=+18.748552664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret") pod "global-pull-secret-syncer-ntbrb" (UID: "8f0786db-0fd7-4113-ab68-7fc1a4048560") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:28.521481 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:28.521443    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc8gv\" (UniqueName: \"kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv\") pod \"network-check-target-mjnpd\" (UID: \"21ec5095-12ad-49d8-96d2-f0c7179768a4\") " pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:28.521653 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:28.521624    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:39:28.521653 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:28.521647    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:39:28.521742 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:28.521657    2583 projected.go:196] Error preparing data for projected volume kube-api-access-pc8gv for pod openshift-network-diagnostics/network-check-target-mjnpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:28.521742 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:28.521716    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv podName:21ec5095-12ad-49d8-96d2-f0c7179768a4 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:36.521700506 +0000 UTC m=+18.848794271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pc8gv" (UniqueName: "kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv") pod "network-check-target-mjnpd" (UID: "21ec5095-12ad-49d8-96d2-f0c7179768a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:28.805105 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:28.805010    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:28.805105 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:28.805028    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:28.805388 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:28.805173    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:28.805388 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:28.805283    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:29.806646 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:29.806147    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:29.806646 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:29.806276    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:30.805033 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:30.804993    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:30.805218 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:30.805000    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:30.805218 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:30.805154    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:30.805347 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:30.805238    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:31.805668 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:31.805629    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:31.806154 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:31.805784    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:32.805250 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:32.805207    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:32.805250 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:32.805251    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:32.805591 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:32.805342    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:32.805591 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:32.805496    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:33.805074 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:33.805025    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:33.805492 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:33.805175    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:34.805135 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:34.805096    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:34.805135 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:34.805137    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:34.805643 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:34.805243    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:34.805643 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:34.805363    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:35.805243 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:35.805216    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:35.805589 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:35.805313    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:36.482477 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:36.482429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:36.482477 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:36.482476    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:36.482752 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:36.482589    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:36.482752 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:36.482591    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:36.482752 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:36.482642    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs podName:f4839d65-2531-49a9-b4fb-0a752464b27e nodeName:}" failed. No retries permitted until 2026-09-18 19:39:52.482628405 +0000 UTC m=+34.809722152 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs") pod "network-metrics-daemon-qqfbz" (UID: "f4839d65-2531-49a9-b4fb-0a752464b27e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:36.482752 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:36.482659    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret podName:8f0786db-0fd7-4113-ab68-7fc1a4048560 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:52.48264927 +0000 UTC m=+34.809743017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret") pod "global-pull-secret-syncer-ntbrb" (UID: "8f0786db-0fd7-4113-ab68-7fc1a4048560") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:36.582819 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:36.582780    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc8gv\" (UniqueName: \"kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv\") pod \"network-check-target-mjnpd\" (UID: \"21ec5095-12ad-49d8-96d2-f0c7179768a4\") " pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:36.583023 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:36.582941    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:39:36.583023 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:36.582972    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:39:36.583023 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:36.582982    2583 projected.go:196] Error preparing data for projected volume kube-api-access-pc8gv for pod openshift-network-diagnostics/network-check-target-mjnpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:36.583184 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:36.583048    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv podName:21ec5095-12ad-49d8-96d2-f0c7179768a4 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:52.583022323 +0000 UTC m=+34.910116065 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pc8gv" (UniqueName: "kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv") pod "network-check-target-mjnpd" (UID: "21ec5095-12ad-49d8-96d2-f0c7179768a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:36.804924 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:36.804834    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:36.805154 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:36.804843    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:36.805154 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:36.804972    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:36.805154 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:36.805065    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:37.805513 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:37.805473    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:37.805992 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:37.805616    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:38.805501 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:38.805464    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:38.805695 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:38.805473    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:38.805695 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:38.805582    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:38.806092 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:38.805694    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:39.805607 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:39.805535    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:39.805752 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:39.805630    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:39.984375 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:39.984343    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw" event={"ID":"53867202-24a8-425c-b9c5-ada8d6cc631e","Type":"ContainerStarted","Data":"9d31dd02f79ae02dbb3369659be837d9252f3b1e544d5cfd3250f03b0a4fd4c0"}
Sep 18 19:39:39.989347 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:39.989281    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7m7bm" event={"ID":"b1401fc5-e30e-4a75-a88d-6fddf0053f0f","Type":"ContainerStarted","Data":"fff238bfea6d3f5f9eea413943f63b044f318d737727c0bbfa228c82ec37f04f"}
Sep 18 19:39:39.990772 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:39.990750    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" event={"ID":"04ddfa7d8805c056a864c45acb85b2eb","Type":"ContainerStarted","Data":"ded2c75deaf0f26492fc1852dbe036de9722c93df7605ddfeb428faa8c304975"}
Sep 18 19:39:40.005831 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:40.005773    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7m7bm" podStartSLOduration=1.546566553 podStartE2EDuration="20.005757356s" totalImagesPullingTime="18.459190803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:40.005613192 +0000 UTC m=+22.332706957" watchObservedRunningTime="2026-09-18 19:39:40.005757356 +0000 UTC m=+22.332851321"
Sep 18 19:39:40.019551 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:40.019497    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" podStartSLOduration=20.019479184 podStartE2EDuration="20.019479184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:40.0192023 +0000 UTC m=+22.346296064" watchObservedRunningTime="2026-09-18 19:39:40.019479184 +0000 UTC m=+22.346572949"
Sep 18 19:39:40.805217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:40.805023    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:40.805395 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:40.805067    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:40.805395 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:40.805313    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:40.805514 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:40.805401    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:40.995844 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:40.995816    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 19:39:40.996610 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:40.996225    2583 generic.go:356] "Generic (PLEG): container finished" podID="53867202-24a8-425c-b9c5-ada8d6cc631e" containerID="f5ade6d5b69bd618b0ec5306affb9b63f2dcef276fb3045b074dfe1a800200b9" exitCode=1
Sep 18 19:39:40.996610 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:40.996299    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw" event={"ID":"53867202-24a8-425c-b9c5-ada8d6cc631e","Type":"ContainerStarted","Data":"899f157a9b9d385368922edfe768b59a4784646f84ab69cb49aa2a1509ff40f7"}
Sep 18 19:39:40.996610 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:40.996374    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw" event={"ID":"53867202-24a8-425c-b9c5-ada8d6cc631e","Type":"ContainerStarted","Data":"6d22e6e1cdaa71f3b1cdb1b8c81ba6b3e255f9d2b4288fc51179034a2aa07d08"}
Sep 18 19:39:40.996610 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:40.996405    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw" event={"ID":"53867202-24a8-425c-b9c5-ada8d6cc631e","Type":"ContainerStarted","Data":"4c25128db974ac93d6384613f873b6ec6d28df43e37002b04fcc23833fafa8d7"}
Sep 18 19:39:40.996610 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:40.996433    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw" event={"ID":"53867202-24a8-425c-b9c5-ada8d6cc631e","Type":"ContainerStarted","Data":"514429926a2385ae1f12804c233836051f9c75a135801e9dd57d86863a1ad476"}
Sep 18 19:39:40.996610 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:40.996463    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw" event={"ID":"53867202-24a8-425c-b9c5-ada8d6cc631e","Type":"ContainerDied","Data":"f5ade6d5b69bd618b0ec5306affb9b63f2dcef276fb3045b074dfe1a800200b9"}
Sep 18 19:39:40.997724 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:40.997702    2583 generic.go:356] "Generic (PLEG): container finished" podID="56f66ac8-8aa6-4fbb-b20a-5f89e15fa483" containerID="7d9ff74d4d9f1e001e662def0ff3e90b4337dbc75c68de6328ccbea831450238" exitCode=0
Sep 18 19:39:40.997844 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:40.997725    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hv4r5" event={"ID":"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483","Type":"ContainerDied","Data":"7d9ff74d4d9f1e001e662def0ff3e90b4337dbc75c68de6328ccbea831450238"}
Sep 18 19:39:40.999265 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:40.999237    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7vlhj" event={"ID":"b83ca37a-46bd-4d22-9fa2-f9d3517200e6","Type":"ContainerStarted","Data":"f1d83382f6d766f23f3cd39eb30ee63c358b0e40b435107173ac988c0899bb3d"}
Sep 18 19:39:41.000687 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.000661    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v955m" event={"ID":"743090bb-ae20-420a-82b1-2a9157f6d299","Type":"ContainerStarted","Data":"857419e903113bec0b8f4341e03b6ffeef283c26038d20b5527c1a500c3b4084"}
Sep 18 19:39:41.002095 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.002072    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zqk5q" event={"ID":"19f67046-5187-4f84-b4ad-1ef94c8a8e27","Type":"ContainerStarted","Data":"d65fa234821f8c9981f3ff0e52e4dd82fe1e98679e7c805273db4d613a42a9f0"}
Sep 18 19:39:41.003544 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.003523    2583 generic.go:356] "Generic (PLEG): container finished" podID="507a24b2ffe92f3b87cfca5c4f26c0f5" containerID="2aa5d2143b1705a8a37026833c9be607d5d745474baf8f178f298aa7def637bd" exitCode=0
Sep 18 19:39:41.003635 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.003598    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" event={"ID":"507a24b2ffe92f3b87cfca5c4f26c0f5","Type":"ContainerDied","Data":"2aa5d2143b1705a8a37026833c9be607d5d745474baf8f178f298aa7def637bd"}
Sep 18 19:39:41.004966 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.004939    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dbv6f" event={"ID":"7502ed14-3896-469a-b1e2-8e58bf1433a1","Type":"ContainerStarted","Data":"5373df475300ec03723b21a6ec0cdddca36405786acbed5c37f71340a53e938e"}
Sep 18 19:39:41.006498 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.006480    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw" event={"ID":"b1f37600-119a-43f1-9bca-846a323869cb","Type":"ContainerStarted","Data":"b84126d12d292068e7f985f5f8cea71b5c9daa48505c543b182ab71917a1926e"}
Sep 18 19:39:41.036111 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.036051    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dbv6f" podStartSLOduration=3.519356082 podStartE2EDuration="22.036021229s" totalImagesPullingTime="18.516665147s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:41.035692532 +0000 UTC m=+23.362786296" watchObservedRunningTime="2026-09-18 19:39:41.036021229 +0000 UTC m=+23.363114993"
Sep 18 19:39:41.051773 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.051713    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zqk5q" podStartSLOduration=3.542909506 podStartE2EDuration="22.051691837s" totalImagesPullingTime="18.508782331s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:41.051101885 +0000 UTC m=+23.378195650" watchObservedRunningTime="2026-09-18 19:39:41.051691837 +0000 UTC m=+23.378785603"
Sep 18 19:39:41.067875 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.067824    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v955m" podStartSLOduration=2.916956226 podStartE2EDuration="22.067806866s" totalImagesPullingTime="19.15085064s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:41.067190002 +0000 UTC m=+23.394283767" watchObservedRunningTime="2026-09-18 19:39:41.067806866 +0000 UTC m=+23.394900631"
Sep 18 19:39:41.083476 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.083419    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7vlhj" podStartSLOduration=2.606434451 podStartE2EDuration="21.083405001s" totalImagesPullingTime="18.47697055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:41.083346107 +0000 UTC m=+23.410439871" watchObservedRunningTime="2026-09-18 19:39:41.083405001 +0000 UTC m=+23.410498766"
Sep 18 19:39:41.452189 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.452164    2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 18 19:39:41.729577 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.729407    2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-18T19:39:41.452184898Z","UUID":"9ae840fd-c249-4957-ad2d-be7fa3ee67aa","Handler":null,"Name":"","Endpoint":""}
Sep 18 19:39:41.731149 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.731129    2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 18 19:39:41.731283 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.731162    2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 18 19:39:41.805175 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:41.805139    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:41.805337 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:41.805259    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:42.011201 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:42.011109    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-q7lp5" event={"ID":"6b5106ce-c269-414c-b49b-cd669145501f","Type":"ContainerStarted","Data":"5eecdce676b068b17de102bfb24a92bda5f35ff3ac226604303f2ec0c300a3f6"}
Sep 18 19:39:42.013476 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:42.013440    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw" event={"ID":"b1f37600-119a-43f1-9bca-846a323869cb","Type":"ContainerStarted","Data":"43191f9cf48e1c36c879ba78722fddffb57783aaaac272638b394e46f706a293"}
Sep 18 19:39:42.015492 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:42.015468    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" event={"ID":"507a24b2ffe92f3b87cfca5c4f26c0f5","Type":"ContainerStarted","Data":"f9f790b9d515dd77a66d32b1a537906b7380e19a70ecaf202690f9dee0f4c758"}
Sep 18 19:39:42.042304 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:42.042247    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-q7lp5" podStartSLOduration=3.637304002 podStartE2EDuration="22.042225295s" totalImagesPullingTime="18.404921293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:42.025591862 +0000 UTC m=+24.352685627" watchObservedRunningTime="2026-09-18 19:39:42.042225295 +0000 UTC m=+24.369319059"
Sep 18 19:39:42.042478 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:42.042343    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" podStartSLOduration=22.042336737 podStartE2EDuration="22.042336737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:42.041630364 +0000 UTC m=+24.368724128" watchObservedRunningTime="2026-09-18 19:39:42.042336737 +0000 UTC m=+24.369430502"
Sep 18 19:39:42.804863 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:42.804787    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:42.805076 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:42.804925    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:42.805076 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:42.804981    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:42.805191 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:42.805120    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:43.021806 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:43.021766    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 19:39:43.022355 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:43.022323    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw" event={"ID":"53867202-24a8-425c-b9c5-ada8d6cc631e","Type":"ContainerStarted","Data":"1e2ee3c0142ff2962b4b9dccd7180b05022767cc78f188b771eb35a024d502de"}
Sep 18 19:39:43.266192 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:43.266109    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7vlhj"
Sep 18 19:39:43.266797 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:43.266777    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7vlhj"
Sep 18 19:39:43.804994 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:43.804953    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:43.805177 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:43.805095    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:44.027516 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:44.027482    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw" event={"ID":"b1f37600-119a-43f1-9bca-846a323869cb","Type":"ContainerStarted","Data":"a041af957297c1936e7e6f8df7d642f398db91a596507bd3f2ff45b5d46292c1"}
Sep 18 19:39:44.028007 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:44.027630    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7vlhj"
Sep 18 19:39:44.028205 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:44.028188    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7vlhj"
Sep 18 19:39:44.048689 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:44.048636    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8zxnw" podStartSLOduration=4.113827811 podStartE2EDuration="25.048614089s" totalImagesPullingTime="20.934786278s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:44.04841257 +0000 UTC m=+26.375506335" watchObservedRunningTime="2026-09-18 19:39:44.048614089 +0000 UTC m=+26.375707859"
Sep 18 19:39:44.806441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:44.806237    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:44.806631 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:44.806300    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:44.806631 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:44.806531    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:44.806770 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:44.806625    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:45.804847 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:45.804809    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:45.805751 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:45.804932    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:46.035338 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:46.035310    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 19:39:46.035737 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:46.035713    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw" event={"ID":"53867202-24a8-425c-b9c5-ada8d6cc631e","Type":"ContainerStarted","Data":"9183437ba2bfdcf07a567eaebc80e4b6fa9ee0dd53c8ecebfbdd1c9d54c812ce"}
Sep 18 19:39:46.035994 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:46.035974    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:46.036098 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:46.036060    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:46.036272 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:46.036249    2583 scope.go:117] "RemoveContainer" containerID="f5ade6d5b69bd618b0ec5306affb9b63f2dcef276fb3045b074dfe1a800200b9"
Sep 18 19:39:46.038117 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:46.038091    2583 generic.go:356] "Generic (PLEG): container finished" podID="56f66ac8-8aa6-4fbb-b20a-5f89e15fa483" containerID="69a90fd9d544fe2eb2365234db6d48bafcfb554b0f04fbfa1c60a71ed5a80e42" exitCode=0
Sep 18 19:39:46.038188 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:46.038130    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hv4r5" event={"ID":"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483","Type":"ContainerDied","Data":"69a90fd9d544fe2eb2365234db6d48bafcfb554b0f04fbfa1c60a71ed5a80e42"}
Sep 18 19:39:46.053628 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:46.053608    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:46.805514 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:46.805329    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:46.806009 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:46.805394    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:46.806009 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:46.805606    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:46.806009 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:46.805706    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:47.044652 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:47.044628    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 19:39:47.045057 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:47.045014    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw" event={"ID":"53867202-24a8-425c-b9c5-ada8d6cc631e","Type":"ContainerStarted","Data":"10919f8beae72adfbb88535c2b75c6ded581dc5740aa9c8368fc70027410f46c"}
Sep 18 19:39:47.045331 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:47.045308    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:47.060434 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:47.060349    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:39:47.079323 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:47.079279    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw" podStartSLOduration=8.382345864 podStartE2EDuration="27.079263897s" totalImagesPullingTime="18.696918033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:47.078949211 +0000 UTC m=+29.406042976" watchObservedRunningTime="2026-09-18 19:39:47.079263897 +0000 UTC m=+29.406357660"
Sep 18 19:39:47.251106 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:47.251071    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qqfbz"]
Sep 18 19:39:47.251282 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:47.251217    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:47.251348 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:47.251301    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:47.265427 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:47.265400    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mjnpd"]
Sep 18 19:39:47.265566 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:47.265502    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:47.265602 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:47.265585    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:47.268892 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:47.268869    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ntbrb"]
Sep 18 19:39:47.269022 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:47.268961    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:47.269097 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:47.269033    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:48.050952 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:48.050915    2583 generic.go:356] "Generic (PLEG): container finished" podID="56f66ac8-8aa6-4fbb-b20a-5f89e15fa483" containerID="7458f24879ed06dba29745f3dc0aa2c036a0367a1195bc8dfc269c2ccd1d03dd" exitCode=0
Sep 18 19:39:48.051324 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:48.051002    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hv4r5" event={"ID":"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483","Type":"ContainerDied","Data":"7458f24879ed06dba29745f3dc0aa2c036a0367a1195bc8dfc269c2ccd1d03dd"}
Sep 18 19:39:48.805026 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:48.805005    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:48.805190 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:48.805119    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:48.805190 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:48.805145    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:48.805190 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:48.805141    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:48.805286 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:48.805214    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:48.805286 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:48.805264    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:49.056304 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:49.056216    2583 generic.go:356] "Generic (PLEG): container finished" podID="56f66ac8-8aa6-4fbb-b20a-5f89e15fa483" containerID="ed02e9c9703aaec5e9e70ed4c0b40016337184348c5910a0363e0d925c245659" exitCode=0
Sep 18 19:39:49.056687 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:49.056311    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hv4r5" event={"ID":"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483","Type":"ContainerDied","Data":"ed02e9c9703aaec5e9e70ed4c0b40016337184348c5910a0363e0d925c245659"}
Sep 18 19:39:50.804746 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:50.804707    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:50.804746 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:50.804734    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:50.805223 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:50.804734    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:50.805223 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:50.804839    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:50.805223 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:50.804917    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:50.805223 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:50.805026    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:52.503326 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:52.503109    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:52.503787 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:52.503348    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:52.503787 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:52.503300    2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:52.503787 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:52.503453    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:52.503787 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:52.503480    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret podName:8f0786db-0fd7-4113-ab68-7fc1a4048560 nodeName:}" failed. No retries permitted until 2026-09-18 19:40:24.503458175 +0000 UTC m=+66.830551937 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret") pod "global-pull-secret-syncer-ntbrb" (UID: "8f0786db-0fd7-4113-ab68-7fc1a4048560") : object "kube-system"/"original-pull-secret" not registered
Sep 18 19:39:52.503787 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:52.503501    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs podName:f4839d65-2531-49a9-b4fb-0a752464b27e nodeName:}" failed. No retries permitted until 2026-09-18 19:40:24.503487021 +0000 UTC m=+66.830580763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs") pod "network-metrics-daemon-qqfbz" (UID: "f4839d65-2531-49a9-b4fb-0a752464b27e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 18 19:39:52.603819 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:52.603779    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc8gv\" (UniqueName: \"kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv\") pod \"network-check-target-mjnpd\" (UID: \"21ec5095-12ad-49d8-96d2-f0c7179768a4\") " pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:52.603974 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:52.603959    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 18 19:39:52.604015 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:52.603983    2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 18 19:39:52.604015 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:52.603993    2583 projected.go:196] Error preparing data for projected volume kube-api-access-pc8gv for pod openshift-network-diagnostics/network-check-target-mjnpd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:52.604151 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:52.604078    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv podName:21ec5095-12ad-49d8-96d2-f0c7179768a4 nodeName:}" failed. No retries permitted until 2026-09-18 19:40:24.604058545 +0000 UTC m=+66.931152310 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pc8gv" (UniqueName: "kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv") pod "network-check-target-mjnpd" (UID: "21ec5095-12ad-49d8-96d2-f0c7179768a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 18 19:39:52.804799 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:52.804711    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:52.804799 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:52.804753    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:52.804799 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:52.804753    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:52.805062 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:52.804831    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ntbrb" podUID="8f0786db-0fd7-4113-ab68-7fc1a4048560"
Sep 18 19:39:52.805062 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:52.804938    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mjnpd" podUID="21ec5095-12ad-49d8-96d2-f0c7179768a4"
Sep 18 19:39:52.805062 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:52.805029    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:39:53.073377 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.073306    2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeReady"
Sep 18 19:39:53.073509 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.073432    2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 18 19:39:53.112639 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.112608    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"]
Sep 18 19:39:53.125760 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.125729    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d94c755-6mpmm"]
Sep 18 19:39:53.125908 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.125868    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:39:53.128604 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.128578    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 18 19:39:53.128732 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.128670    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 18 19:39:53.128732 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.128693    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fznpg\""
Sep 18 19:39:53.140329 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.140306    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"]
Sep 18 19:39:53.140443 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.140335    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d94c755-6mpmm"]
Sep 18 19:39:53.140443 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.140350    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xxsmg"]
Sep 18 19:39:53.140443 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.140427    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.145624 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.145603    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 18 19:39:53.145752 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.145645    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b9rnh\""
Sep 18 19:39:53.145752 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.145662    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 18 19:39:53.145963 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.145941    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 18 19:39:53.151283 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.151264    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 18 19:39:53.152653 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.152633    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n4mp2"]
Sep 18 19:39:53.152775 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.152761    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:53.155896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.155874    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v8jjp\""
Sep 18 19:39:53.158241 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.156499    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 18 19:39:53.158241 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.156511    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 18 19:39:53.166943 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.166924    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n4mp2"]
Sep 18 19:39:53.167033 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.166952    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xxsmg"]
Sep 18 19:39:53.167088 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.167064    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n4mp2"
Sep 18 19:39:53.170061 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.170028    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wfwhm\""
Sep 18 19:39:53.170061 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.170054    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 18 19:39:53.170203 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.170029    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 18 19:39:53.170203 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.170089    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 18 19:39:53.207811 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.207777    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f3bc1eb-3f59-47af-8721-017b79a0830c-ca-trust-extracted\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.207811 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.207811    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74v88\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-kube-api-access-74v88\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.208023 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.207835    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/70f3f4ae-9bcc-4527-b307-6d9b707d7673-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:39:53.208023 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.207879    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-bound-sa-token\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.208023 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.207900    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-certificates\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.208023 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.207916    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f3bc1eb-3f59-47af-8721-017b79a0830c-trusted-ca\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.208023 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.207931    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f3bc1eb-3f59-47af-8721-017b79a0830c-installation-pull-secrets\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.208023 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.207957    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f3bc1eb-3f59-47af-8721-017b79a0830c-image-registry-private-configuration\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.208023 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.207978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:39:53.208270 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.208060    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.309214 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309180    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f3bc1eb-3f59-47af-8721-017b79a0830c-ca-trust-extracted\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.309214 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309214    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74v88\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-kube-api-access-74v88\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.309407 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309232    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/70f3f4ae-9bcc-4527-b307-6d9b707d7673-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:39:53.309407 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309252    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-bound-sa-token\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.309407 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309330    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:53.309407 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-certificates\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.309564 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309422    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f3bc1eb-3f59-47af-8721-017b79a0830c-trusted-ca\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.309564 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309463    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f3bc1eb-3f59-47af-8721-017b79a0830c-installation-pull-secrets\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.309564 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309496    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f3bc1eb-3f59-47af-8721-017b79a0830c-image-registry-private-configuration\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.309564 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309522    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:39:53.309755 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309564    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.309755 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309608    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f3bc1eb-3f59-47af-8721-017b79a0830c-ca-trust-extracted\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.309755 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309635    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77200409-483c-4a0f-bc4c-51980845fa8e-cert\") pod \"ingress-canary-n4mp2\" (UID: \"77200409-483c-4a0f-bc4c-51980845fa8e\") " pod="openshift-ingress-canary/ingress-canary-n4mp2"
Sep 18 19:39:53.309755 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c53ef47-6278-4b13-88f8-9e873a25f48d-config-volume\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:53.309755 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309685    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs2gg\" (UniqueName: \"kubernetes.io/projected/9c53ef47-6278-4b13-88f8-9e873a25f48d-kube-api-access-zs2gg\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:53.309755 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:53.309703    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 19:39:53.309755 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309714    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5zvb\" (UniqueName: \"kubernetes.io/projected/77200409-483c-4a0f-bc4c-51980845fa8e-kube-api-access-s5zvb\") pod \"ingress-canary-n4mp2\" (UID: \"77200409-483c-4a0f-bc4c-51980845fa8e\") " pod="openshift-ingress-canary/ingress-canary-n4mp2"
Sep 18 19:39:53.309755 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309742    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c53ef47-6278-4b13-88f8-9e873a25f48d-tmp-dir\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:53.310113 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:53.309779    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert podName:70f3f4ae-9bcc-4527-b307-6d9b707d7673 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:53.809753142 +0000 UTC m=+36.136846900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-tp4hr" (UID: "70f3f4ae-9bcc-4527-b307-6d9b707d7673") : secret "networking-console-plugin-cert" not found
Sep 18 19:39:53.310113 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:53.309806    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:39:53.310113 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:53.309827    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d94c755-6mpmm: secret "image-registry-tls" not found
Sep 18 19:39:53.310113 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:53.309876    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls podName:0f3bc1eb-3f59-47af-8721-017b79a0830c nodeName:}" failed. No retries permitted until 2026-09-18 19:39:53.809860535 +0000 UTC m=+36.136954278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls") pod "image-registry-5d94c755-6mpmm" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c") : secret "image-registry-tls" not found
Sep 18 19:39:53.310113 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309926    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-certificates\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.310113 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.309989    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/70f3f4ae-9bcc-4527-b307-6d9b707d7673-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:39:53.310525 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.310500    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f3bc1eb-3f59-47af-8721-017b79a0830c-trusted-ca\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.313495 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.313468    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f3bc1eb-3f59-47af-8721-017b79a0830c-image-registry-private-configuration\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.313495 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.313475    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f3bc1eb-3f59-47af-8721-017b79a0830c-installation-pull-secrets\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.317759 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.317736    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-bound-sa-token\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.318135 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.318103    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74v88\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-kube-api-access-74v88\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.410288 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.410260    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:53.410440 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.410367    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77200409-483c-4a0f-bc4c-51980845fa8e-cert\") pod \"ingress-canary-n4mp2\" (UID: \"77200409-483c-4a0f-bc4c-51980845fa8e\") " pod="openshift-ingress-canary/ingress-canary-n4mp2"
Sep 18 19:39:53.410440 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.410391    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c53ef47-6278-4b13-88f8-9e873a25f48d-config-volume\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:53.410440 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.410412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs2gg\" (UniqueName: \"kubernetes.io/projected/9c53ef47-6278-4b13-88f8-9e873a25f48d-kube-api-access-zs2gg\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:53.410440 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:53.410430    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:39:53.410440 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.410437    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5zvb\" (UniqueName: \"kubernetes.io/projected/77200409-483c-4a0f-bc4c-51980845fa8e-kube-api-access-s5zvb\") pod \"ingress-canary-n4mp2\" (UID: \"77200409-483c-4a0f-bc4c-51980845fa8e\") " pod="openshift-ingress-canary/ingress-canary-n4mp2"
Sep 18 19:39:53.410664 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.410462    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c53ef47-6278-4b13-88f8-9e873a25f48d-tmp-dir\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:53.410664 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:53.410496    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls podName:9c53ef47-6278-4b13-88f8-9e873a25f48d nodeName:}" failed. No retries permitted until 2026-09-18 19:39:53.910475887 +0000 UTC m=+36.237569648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls") pod "dns-default-xxsmg" (UID: "9c53ef47-6278-4b13-88f8-9e873a25f48d") : secret "dns-default-metrics-tls" not found
Sep 18 19:39:53.410763 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.410746    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c53ef47-6278-4b13-88f8-9e873a25f48d-tmp-dir\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:53.410959 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.410940    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c53ef47-6278-4b13-88f8-9e873a25f48d-config-volume\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:53.412725 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.412708    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/77200409-483c-4a0f-bc4c-51980845fa8e-cert\") pod \"ingress-canary-n4mp2\" (UID: \"77200409-483c-4a0f-bc4c-51980845fa8e\") " pod="openshift-ingress-canary/ingress-canary-n4mp2"
Sep 18 19:39:53.421811 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.421788    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs2gg\" (UniqueName: \"kubernetes.io/projected/9c53ef47-6278-4b13-88f8-9e873a25f48d-kube-api-access-zs2gg\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:53.422374 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.422359    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5zvb\" (UniqueName: \"kubernetes.io/projected/77200409-483c-4a0f-bc4c-51980845fa8e-kube-api-access-s5zvb\") pod \"ingress-canary-n4mp2\" (UID: \"77200409-483c-4a0f-bc4c-51980845fa8e\") " pod="openshift-ingress-canary/ingress-canary-n4mp2"
Sep 18 19:39:53.480220 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.480179    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n4mp2"
Sep 18 19:39:53.809307 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.809236    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n4mp2"]
Sep 18 19:39:53.812119 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:39:53.812090    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77200409_483c_4a0f_bc4c_51980845fa8e.slice/crio-99239f27404c1f0fc19931475eaaa1bcd7c0417a85da94afd62f6ae0163f8c60 WatchSource:0}: Error finding container 99239f27404c1f0fc19931475eaaa1bcd7c0417a85da94afd62f6ae0163f8c60: Status 404 returned error can't find the container with id 99239f27404c1f0fc19931475eaaa1bcd7c0417a85da94afd62f6ae0163f8c60
Sep 18 19:39:53.813570 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.813546    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:39:53.813693 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.813588    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:53.813693 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:53.813685    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 19:39:53.813795 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:53.813736    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:39:53.813795 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:53.813744    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert podName:70f3f4ae-9bcc-4527-b307-6d9b707d7673 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:54.813728649 +0000 UTC m=+37.140822410 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-tp4hr" (UID: "70f3f4ae-9bcc-4527-b307-6d9b707d7673") : secret "networking-console-plugin-cert" not found
Sep 18 19:39:53.813795 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:53.813749    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d94c755-6mpmm: secret "image-registry-tls" not found
Sep 18 19:39:53.813950 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:53.813802    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls podName:0f3bc1eb-3f59-47af-8721-017b79a0830c nodeName:}" failed. No retries permitted until 2026-09-18 19:39:54.813788497 +0000 UTC m=+37.140882240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls") pod "image-registry-5d94c755-6mpmm" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c") : secret "image-registry-tls" not found
Sep 18 19:39:53.914267 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:53.914232    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:53.914398 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:53.914373    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:39:53.914457 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:53.914446    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls podName:9c53ef47-6278-4b13-88f8-9e873a25f48d nodeName:}" failed. No retries permitted until 2026-09-18 19:39:54.914431088 +0000 UTC m=+37.241524830 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls") pod "dns-default-xxsmg" (UID: "9c53ef47-6278-4b13-88f8-9e873a25f48d") : secret "dns-default-metrics-tls" not found
Sep 18 19:39:54.071276 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.071188    2583 generic.go:356] "Generic (PLEG): container finished" podID="56f66ac8-8aa6-4fbb-b20a-5f89e15fa483" containerID="a7e2ff03122a2c42cba33e96597d99241fb45bffc86c1392161b5e8dbe5d9999" exitCode=0
Sep 18 19:39:54.071421 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.071273    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hv4r5" event={"ID":"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483","Type":"ContainerDied","Data":"a7e2ff03122a2c42cba33e96597d99241fb45bffc86c1392161b5e8dbe5d9999"}
Sep 18 19:39:54.072460 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.072434    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n4mp2" event={"ID":"77200409-483c-4a0f-bc4c-51980845fa8e","Type":"ContainerStarted","Data":"99239f27404c1f0fc19931475eaaa1bcd7c0417a85da94afd62f6ae0163f8c60"}
Sep 18 19:39:54.805344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.805305    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:39:54.805539 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.805359    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:39:54.805539 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.805320    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:39:54.808129 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.808098    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 19:39:54.808240 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.808098    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 19:39:54.808240 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.808099    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 19:39:54.809140 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.809121    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m9tpx\""
Sep 18 19:39:54.809252 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.809153    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t5jrl\""
Sep 18 19:39:54.809304 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.809265    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 19:39:54.822449 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.822428    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:39:54.822770 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.822476    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:54.822832 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:54.822800    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 19:39:54.822962 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:54.822897    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert podName:70f3f4ae-9bcc-4527-b307-6d9b707d7673 nodeName:}" failed. No retries permitted until 2026-09-18 19:39:56.822874002 +0000 UTC m=+39.149967762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-tp4hr" (UID: "70f3f4ae-9bcc-4527-b307-6d9b707d7673") : secret "networking-console-plugin-cert" not found
Sep 18 19:39:54.823098 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:54.823019    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:39:54.823098 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:54.823032    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d94c755-6mpmm: secret "image-registry-tls" not found
Sep 18 19:39:54.823195 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:54.823108    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls podName:0f3bc1eb-3f59-47af-8721-017b79a0830c nodeName:}" failed. No retries permitted until 2026-09-18 19:39:56.823093021 +0000 UTC m=+39.150186762 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls") pod "image-registry-5d94c755-6mpmm" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c") : secret "image-registry-tls" not found
Sep 18 19:39:54.923733 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:54.923691    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:54.923896 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:54.923836    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:39:54.923955 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:54.923905    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls podName:9c53ef47-6278-4b13-88f8-9e873a25f48d nodeName:}" failed. No retries permitted until 2026-09-18 19:39:56.923886444 +0000 UTC m=+39.250980208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls") pod "dns-default-xxsmg" (UID: "9c53ef47-6278-4b13-88f8-9e873a25f48d") : secret "dns-default-metrics-tls" not found
Sep 18 19:39:55.078331 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:55.078244    2583 generic.go:356] "Generic (PLEG): container finished" podID="56f66ac8-8aa6-4fbb-b20a-5f89e15fa483" containerID="9466c3f273062e668dfbc589243a050cc974f282ebd1852b4a3c0f78f8e95df5" exitCode=0
Sep 18 19:39:55.078331 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:55.078288    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hv4r5" event={"ID":"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483","Type":"ContainerDied","Data":"9466c3f273062e668dfbc589243a050cc974f282ebd1852b4a3c0f78f8e95df5"}
Sep 18 19:39:56.086022 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:56.085986    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hv4r5" event={"ID":"56f66ac8-8aa6-4fbb-b20a-5f89e15fa483","Type":"ContainerStarted","Data":"791d30ec46d2daa3f767c449267ae7b9e2e47bd72a949acdf937c1df9179da92"}
Sep 18 19:39:56.110768 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:56.110714    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hv4r5" podStartSLOduration=7.4633812840000004 podStartE2EDuration="36.110695365s" totalImagesPullingTime="28.647314081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:56.109362792 +0000 UTC m=+38.436456557" watchObservedRunningTime="2026-09-18 19:39:56.110695365 +0000 UTC m=+38.437789127"
Sep 18 19:39:56.261759 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:56.261707    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:39:56.359639 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:56.359568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:39:56.838769 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:56.838728    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:39:56.838928 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:56.838792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:39:56.838977 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:56.838914    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 19:39:56.838977 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:56.838943    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:39:56.838977 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:56.838958    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d94c755-6mpmm: secret "image-registry-tls" not found
Sep 18 19:39:56.839101 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:56.839000    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert podName:70f3f4ae-9bcc-4527-b307-6d9b707d7673 nodeName:}" failed. No retries permitted until 2026-09-18 19:40:00.838981279 +0000 UTC m=+43.166075044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-tp4hr" (UID: "70f3f4ae-9bcc-4527-b307-6d9b707d7673") : secret "networking-console-plugin-cert" not found
Sep 18 19:39:56.839101 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:56.839016    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls podName:0f3bc1eb-3f59-47af-8721-017b79a0830c nodeName:}" failed. No retries permitted until 2026-09-18 19:40:00.839010182 +0000 UTC m=+43.166103924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls") pod "image-registry-5d94c755-6mpmm" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c") : secret "image-registry-tls" not found
Sep 18 19:39:56.939764 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:56.939728    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:39:56.939957 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:56.939853    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:39:56.939957 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:39:56.939920    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls podName:9c53ef47-6278-4b13-88f8-9e873a25f48d nodeName:}" failed. No retries permitted until 2026-09-18 19:40:00.939903092 +0000 UTC m=+43.266996847 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls") pod "dns-default-xxsmg" (UID: "9c53ef47-6278-4b13-88f8-9e873a25f48d") : secret "dns-default-metrics-tls" not found
Sep 18 19:39:57.089795 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:57.089756    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n4mp2" event={"ID":"77200409-483c-4a0f-bc4c-51980845fa8e","Type":"ContainerStarted","Data":"d1600f1a4092e2d10bff59b6bceff34b7fde54367cfe349e3693e7065b2e26e3"}
Sep 18 19:39:57.107675 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:57.107631    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n4mp2" podStartSLOduration=1.542674482 podStartE2EDuration="4.107614357s" totalImagesPullingTime="2.564939875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:39:57.106726146 +0000 UTC m=+39.433819925" watchObservedRunningTime="2026-09-18 19:39:57.107614357 +0000 UTC m=+39.434708120"
Sep 18 19:39:58.005056 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:58.004889    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:39:58.108137 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:58.108098    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:39:58.725741 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:58.725713    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:39:58.826473 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:39:58.826434    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:00.869993 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:00.869935    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:40:00.870403 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:00.870017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:40:00.870403 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:00.870124    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 19:40:00.870403 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:00.870189    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert podName:70f3f4ae-9bcc-4527-b307-6d9b707d7673 nodeName:}" failed. No retries permitted until 2026-09-18 19:40:08.870173734 +0000 UTC m=+51.197267489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-tp4hr" (UID: "70f3f4ae-9bcc-4527-b307-6d9b707d7673") : secret "networking-console-plugin-cert" not found
Sep 18 19:40:00.870403 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:00.870128    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:40:00.870403 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:00.870225    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d94c755-6mpmm: secret "image-registry-tls" not found
Sep 18 19:40:00.870403 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:00.870274    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls podName:0f3bc1eb-3f59-47af-8721-017b79a0830c nodeName:}" failed. No retries permitted until 2026-09-18 19:40:08.870261027 +0000 UTC m=+51.197354772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls") pod "image-registry-5d94c755-6mpmm" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c") : secret "image-registry-tls" not found
Sep 18 19:40:00.971212 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:00.971171    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:40:00.971365 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:00.971324    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:40:00.971400 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:00.971391    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls podName:9c53ef47-6278-4b13-88f8-9e873a25f48d nodeName:}" failed. No retries permitted until 2026-09-18 19:40:08.97137449 +0000 UTC m=+51.298468238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls") pod "dns-default-xxsmg" (UID: "9c53ef47-6278-4b13-88f8-9e873a25f48d") : secret "dns-default-metrics-tls" not found
Sep 18 19:40:01.796755 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:01.796705    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:01.900675 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:01.900646    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:04.743178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:04.743142    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:04.839151 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:04.839119    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:04.938607 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:04.938561    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:05.007242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:05.007166    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:08.932230 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:08.932191    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:40:08.932628 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:08.932251    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:40:08.932628 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:08.932364    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 19:40:08.932628 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:08.932383    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:40:08.932628 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:08.932394    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d94c755-6mpmm: secret "image-registry-tls" not found
Sep 18 19:40:08.932628 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:08.932445    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls podName:0f3bc1eb-3f59-47af-8721-017b79a0830c nodeName:}" failed. No retries permitted until 2026-09-18 19:40:24.932427372 +0000 UTC m=+67.259521132 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls") pod "image-registry-5d94c755-6mpmm" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c") : secret "image-registry-tls" not found
Sep 18 19:40:08.932628 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:08.932461    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert podName:70f3f4ae-9bcc-4527-b307-6d9b707d7673 nodeName:}" failed. No retries permitted until 2026-09-18 19:40:24.932452494 +0000 UTC m=+67.259546239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-tp4hr" (UID: "70f3f4ae-9bcc-4527-b307-6d9b707d7673") : secret "networking-console-plugin-cert" not found
Sep 18 19:40:09.032991 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:09.032958    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:40:09.033163 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:09.033151    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:40:09.033230 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:09.033219    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls podName:9c53ef47-6278-4b13-88f8-9e873a25f48d nodeName:}" failed. No retries permitted until 2026-09-18 19:40:25.033200785 +0000 UTC m=+67.360294549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls") pod "dns-default-xxsmg" (UID: "9c53ef47-6278-4b13-88f8-9e873a25f48d") : secret "dns-default-metrics-tls" not found
Sep 18 19:40:18.986869 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:18.986832    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:19.046308 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:19.046261    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:19.066898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:19.066873    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zggbw"
Sep 18 19:40:19.222424 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:19.222396    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:19.278625 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:19.278548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:24.546974 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:24.546941    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:40:24.546974 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:24.546981    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:40:24.549656 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:24.549635    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 18 19:40:24.549830 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:24.549807    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 18 19:40:24.557693 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:24.557672    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 19:40:24.557795 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:24.557729    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs podName:f4839d65-2531-49a9-b4fb-0a752464b27e nodeName:}" failed. No retries permitted until 2026-09-18 19:41:28.557713679 +0000 UTC m=+130.884807434 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs") pod "network-metrics-daemon-qqfbz" (UID: "f4839d65-2531-49a9-b4fb-0a752464b27e") : secret "metrics-daemon-secret" not found
Sep 18 19:40:24.561109 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:24.561089    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f0786db-0fd7-4113-ab68-7fc1a4048560-original-pull-secret\") pod \"global-pull-secret-syncer-ntbrb\" (UID: \"8f0786db-0fd7-4113-ab68-7fc1a4048560\") " pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:40:24.648080 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:24.648017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc8gv\" (UniqueName: \"kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv\") pod \"network-check-target-mjnpd\" (UID: \"21ec5095-12ad-49d8-96d2-f0c7179768a4\") " pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:40:24.650629 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:24.650614    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 18 19:40:24.661308 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:24.661290    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 18 19:40:24.671731 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:24.671707    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc8gv\" (UniqueName: \"kubernetes.io/projected/21ec5095-12ad-49d8-96d2-f0c7179768a4-kube-api-access-pc8gv\") pod \"network-check-target-mjnpd\" (UID: \"21ec5095-12ad-49d8-96d2-f0c7179768a4\") " pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:40:24.817208 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:24.817108    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ntbrb"
Sep 18 19:40:24.835651 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:24.835630    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-t5jrl\""
Sep 18 19:40:24.844150 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:24.844116    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:40:24.950778 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:24.950742    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:40:24.950778 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:24.950785    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:40:24.950988 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:24.950908    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 19:40:24.950988 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:24.950982    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert podName:70f3f4ae-9bcc-4527-b307-6d9b707d7673 nodeName:}" failed. No retries permitted until 2026-09-18 19:40:56.95096715 +0000 UTC m=+99.278060891 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-tp4hr" (UID: "70f3f4ae-9bcc-4527-b307-6d9b707d7673") : secret "networking-console-plugin-cert" not found
Sep 18 19:40:24.951105 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:24.950919    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:40:24.951105 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:24.951013    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d94c755-6mpmm: secret "image-registry-tls" not found
Sep 18 19:40:24.951105 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:24.951080    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls podName:0f3bc1eb-3f59-47af-8721-017b79a0830c nodeName:}" failed. No retries permitted until 2026-09-18 19:40:56.951066673 +0000 UTC m=+99.278160434 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls") pod "image-registry-5d94c755-6mpmm" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c") : secret "image-registry-tls" not found
Sep 18 19:40:25.051855 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:25.051817    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:40:25.052006 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:25.051940    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:40:25.052006 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:25.051988    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls podName:9c53ef47-6278-4b13-88f8-9e873a25f48d nodeName:}" failed. No retries permitted until 2026-09-18 19:40:57.051975717 +0000 UTC m=+99.379069460 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls") pod "dns-default-xxsmg" (UID: "9c53ef47-6278-4b13-88f8-9e873a25f48d") : secret "dns-default-metrics-tls" not found
Sep 18 19:40:25.083717 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:25.083647    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ntbrb"]
Sep 18 19:40:25.087278 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:40:25.087253    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f0786db_0fd7_4113_ab68_7fc1a4048560.slice/crio-0940457b5fabc214c0374eb3e56b63f20e588cb3195a0df5ef1c45903dd52d05 WatchSource:0}: Error finding container 0940457b5fabc214c0374eb3e56b63f20e588cb3195a0df5ef1c45903dd52d05: Status 404 returned error can't find the container with id 0940457b5fabc214c0374eb3e56b63f20e588cb3195a0df5ef1c45903dd52d05
Sep 18 19:40:25.113932 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:25.113879    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mjnpd"]
Sep 18 19:40:25.117216 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:40:25.117191    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21ec5095_12ad_49d8_96d2_f0c7179768a4.slice/crio-6ca8b11522e7e5398f15a1a0172d7a2db7905f9eb4de1113717f86e57579e1f7 WatchSource:0}: Error finding container 6ca8b11522e7e5398f15a1a0172d7a2db7905f9eb4de1113717f86e57579e1f7: Status 404 returned error can't find the container with id 6ca8b11522e7e5398f15a1a0172d7a2db7905f9eb4de1113717f86e57579e1f7
Sep 18 19:40:25.155316 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:25.155289    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mjnpd" event={"ID":"21ec5095-12ad-49d8-96d2-f0c7179768a4","Type":"ContainerStarted","Data":"6ca8b11522e7e5398f15a1a0172d7a2db7905f9eb4de1113717f86e57579e1f7"}
Sep 18 19:40:25.156376 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:25.156354    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ntbrb" event={"ID":"8f0786db-0fd7-4113-ab68-7fc1a4048560","Type":"ContainerStarted","Data":"0940457b5fabc214c0374eb3e56b63f20e588cb3195a0df5ef1c45903dd52d05"}
Sep 18 19:40:26.714480 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:26.714442    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:26.815785 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:26.815751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:30.170162 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:30.170125    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mjnpd" event={"ID":"21ec5095-12ad-49d8-96d2-f0c7179768a4","Type":"ContainerStarted","Data":"b73a8f6f2fdd2bdc2ecd4a3a137e8b08c93a1adb8623ba0a080df1e0520f0c62"}
Sep 18 19:40:30.170589 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:30.170223    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:40:30.171645 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:30.171627    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ntbrb" event={"ID":"8f0786db-0fd7-4113-ab68-7fc1a4048560","Type":"ContainerStarted","Data":"9f66a2e2c512e555169a693f0ddc8245899275b3773e92a7f5c76594a64166ea"}
Sep 18 19:40:30.187818 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:30.187347    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mjnpd" podStartSLOduration=66.718769169 podStartE2EDuration="1m11.187327319s" totalImagesPullingTime="4.46855815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:40:30.186906807 +0000 UTC m=+72.514000571" watchObservedRunningTime="2026-09-18 19:40:30.187327319 +0000 UTC m=+72.514421084"
Sep 18 19:40:30.203128 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:30.203076    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ntbrb" podStartSLOduration=65.700363418 podStartE2EDuration="1m10.203056723s" totalImagesPullingTime="4.502693305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:40:30.20266209 +0000 UTC m=+72.529755868" watchObservedRunningTime="2026-09-18 19:40:30.203056723 +0000 UTC m=+72.530150485"
Sep 18 19:40:33.306661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:33.306516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:33.356280 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:33.356252    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:56.981875 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:56.981828    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:40:56.981875 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:56.981878    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:40:56.982383 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:56.981983    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 19:40:56.982383 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:56.982072    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert podName:70f3f4ae-9bcc-4527-b307-6d9b707d7673 nodeName:}" failed. No retries permitted until 2026-09-18 19:42:00.982056606 +0000 UTC m=+163.309150361 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-tp4hr" (UID: "70f3f4ae-9bcc-4527-b307-6d9b707d7673") : secret "networking-console-plugin-cert" not found
Sep 18 19:40:56.982383 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:56.981987    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:40:56.982383 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:56.982098    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d94c755-6mpmm: secret "image-registry-tls" not found
Sep 18 19:40:56.982383 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:56.982168    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls podName:0f3bc1eb-3f59-47af-8721-017b79a0830c nodeName:}" failed. No retries permitted until 2026-09-18 19:42:00.982148859 +0000 UTC m=+163.309242603 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls") pod "image-registry-5d94c755-6mpmm" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c") : secret "image-registry-tls" not found
Sep 18 19:40:57.082943 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:57.082921    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:40:57.083078 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:57.083055    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:40:57.083121 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:40:57.083101    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls podName:9c53ef47-6278-4b13-88f8-9e873a25f48d nodeName:}" failed. No retries permitted until 2026-09-18 19:42:01.0830885 +0000 UTC m=+163.410182242 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls") pod "dns-default-xxsmg" (UID: "9c53ef47-6278-4b13-88f8-9e873a25f48d") : secret "dns-default-metrics-tls" not found
Sep 18 19:40:58.650755 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:58.650723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:40:58.699353 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:40:58.699327    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:41:01.176655 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:41:01.176630    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mjnpd"
Sep 18 19:41:28.600191 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:41:28.600143    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:41:28.600653 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:41:28.600265    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 19:41:28.600653 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:41:28.600326    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs podName:f4839d65-2531-49a9-b4fb-0a752464b27e nodeName:}" failed. No retries permitted until 2026-09-18 19:43:30.60031309 +0000 UTC m=+252.927406845 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs") pod "network-metrics-daemon-qqfbz" (UID: "f4839d65-2531-49a9-b4fb-0a752464b27e") : secret "metrics-daemon-secret" not found
Sep 18 19:41:56.136728 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:41:56.136681    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr" podUID="70f3f4ae-9bcc-4527-b307-6d9b707d7673"
Sep 18 19:41:56.148848 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:41:56.148815    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5d94c755-6mpmm" podUID="0f3bc1eb-3f59-47af-8721-017b79a0830c"
Sep 18 19:41:56.165442 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:41:56.165406    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xxsmg" podUID="9c53ef47-6278-4b13-88f8-9e873a25f48d"
Sep 18 19:41:56.371995 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:41:56.371967    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:41:56.372204 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:41:56.371967    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:41:57.827693 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:41:57.827649    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:42:01.025053 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:42:01.025000    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:42:01.025053 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:42:01.025054    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:42:01.025545 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:42:01.025165    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 19:42:01.025545 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:42:01.025180    2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 18 19:42:01.025545 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:42:01.025191    2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d94c755-6mpmm: secret "image-registry-tls" not found
Sep 18 19:42:01.025545 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:42:01.025239    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert podName:70f3f4ae-9bcc-4527-b307-6d9b707d7673 nodeName:}" failed. No retries permitted until 2026-09-18 19:44:03.025220946 +0000 UTC m=+285.352314709 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-tp4hr" (UID: "70f3f4ae-9bcc-4527-b307-6d9b707d7673") : secret "networking-console-plugin-cert" not found
Sep 18 19:42:01.025545 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:42:01.025256    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls podName:0f3bc1eb-3f59-47af-8721-017b79a0830c nodeName:}" failed. No retries permitted until 2026-09-18 19:44:03.025249319 +0000 UTC m=+285.352343061 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls") pod "image-registry-5d94c755-6mpmm" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c") : secret "image-registry-tls" not found
Sep 18 19:42:01.126045 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:42:01.126009    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:42:01.126171 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:42:01.126153    2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 18 19:42:01.126223 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:42:01.126214    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls podName:9c53ef47-6278-4b13-88f8-9e873a25f48d nodeName:}" failed. No retries permitted until 2026-09-18 19:44:03.126198889 +0000 UTC m=+285.453292631 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls") pod "dns-default-xxsmg" (UID: "9c53ef47-6278-4b13-88f8-9e873a25f48d") : secret "dns-default-metrics-tls" not found
Sep 18 19:42:06.804906 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:42:06.804873    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:42:08.805511 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:42:08.805480    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:42:43.820392 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:42:43.820361    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:42:54.831389 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:42:54.831355    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:29.016950 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:29.016910    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:30.646076 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:30.646032    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:43:30.646446 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:30.646176    2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 18 19:43:30.646446 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:30.646260    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs podName:f4839d65-2531-49a9-b4fb-0a752464b27e nodeName:}" failed. No retries permitted until 2026-09-18 19:45:32.646243683 +0000 UTC m=+374.973337446 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs") pod "network-metrics-daemon-qqfbz" (UID: "f4839d65-2531-49a9-b4fb-0a752464b27e") : secret "metrics-daemon-secret" not found
Sep 18 19:43:47.352366 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.352290    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-7s7sk"]
Sep 18 19:43:47.354027 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.354011    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-7s7sk"
Sep 18 19:43:47.356312 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.356290    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-26vtn\""
Sep 18 19:43:47.359483 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.359289    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"]
Sep 18 19:43:47.361247 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.360870    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l"]
Sep 18 19:43:47.361247 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.361032    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:43:47.362618 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.362602    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-679f8486cd-4ktr5"]
Sep 18 19:43:47.362722 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.362707    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l"
Sep 18 19:43:47.363469 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.363448    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-x59kh\""
Sep 18 19:43:47.363686 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.363668    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 18 19:43:47.363790 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.363774    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 18 19:43:47.364115 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.364103    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"]
Sep 18 19:43:47.364213 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.364199    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:47.365306 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.365291    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 18 19:43:47.365398 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.365353    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 18 19:43:47.365951 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.365935    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"
Sep 18 19:43:47.366845 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.366826    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 18 19:43:47.366970 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.366951    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-mgvdm\""
Sep 18 19:43:47.367174 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.367157    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 18 19:43:47.367412 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.367376    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 18 19:43:47.367529 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.367411    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 18 19:43:47.367529 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.367430    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 18 19:43:47.367680 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.367663    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-7s7sk"]
Sep 18 19:43:47.367895 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.367874    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 18 19:43:47.367968 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.367895    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-l6qgz\""
Sep 18 19:43:47.367968 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.367884    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 18 19:43:47.367968 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.367920    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 18 19:43:47.368158 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.367882    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 18 19:43:47.368158 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.367897    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 18 19:43:47.368373 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.368344    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 18 19:43:47.368471 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.368423    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 18 19:43:47.368685 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.368669    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 18 19:43:47.369367 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.369349    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-s7smx\""
Sep 18 19:43:47.372969 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.372949    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"]
Sep 18 19:43:47.376564 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.376543    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l"]
Sep 18 19:43:47.378978 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.378959    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-679f8486cd-4ktr5"]
Sep 18 19:43:47.390160 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.390137    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"]
Sep 18 19:43:47.455500 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.455471    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7txlp\" (UniqueName: \"kubernetes.io/projected/e218c301-a9dc-4497-a0c8-11674cc3670d-kube-api-access-7txlp\") pod \"cluster-samples-operator-685d7d68b5-cg8sq\" (UID: \"e218c301-a9dc-4497-a0c8-11674cc3670d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"
Sep 18 19:43:47.455698 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.455515    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-stats-auth\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:47.455698 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.455542    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/793a4f9c-0c8b-4ade-b72d-38db5bd23628-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-cdh8l\" (UID: \"793a4f9c-0c8b-4ade-b72d-38db5bd23628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l"
Sep 18 19:43:47.455698 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.455578    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtbb4\" (UniqueName: \"kubernetes.io/projected/793a4f9c-0c8b-4ade-b72d-38db5bd23628-kube-api-access-wtbb4\") pod \"kube-storage-version-migrator-operator-55889f7b47-cdh8l\" (UID: \"793a4f9c-0c8b-4ade-b72d-38db5bd23628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l"
Sep 18 19:43:47.455698 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.455664    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8dzt\" (UniqueName: \"kubernetes.io/projected/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-kube-api-access-l8dzt\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:47.455933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.455699    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvqmt\" (UniqueName: \"kubernetes.io/projected/e82cbbf2-9c64-4139-b7a5-0269815d4a21-kube-api-access-vvqmt\") pod \"cluster-monitoring-operator-847b8bd8d7-slmwj\" (UID: \"e82cbbf2-9c64-4139-b7a5-0269815d4a21\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:43:47.455933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.455737    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:47.455933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.455768    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-cg8sq\" (UID: \"e218c301-a9dc-4497-a0c8-11674cc3670d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"
Sep 18 19:43:47.455933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.455812    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzfzm\" (UniqueName: \"kubernetes.io/projected/03ba9884-292f-4a6a-939d-787d598683f4-kube-api-access-zzfzm\") pod \"network-check-source-7cbc45fddc-7s7sk\" (UID: \"03ba9884-292f-4a6a-939d-787d598683f4\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-7s7sk"
Sep 18 19:43:47.455933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.455860    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e82cbbf2-9c64-4139-b7a5-0269815d4a21-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-slmwj\" (UID: \"e82cbbf2-9c64-4139-b7a5-0269815d4a21\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:43:47.455933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.455890    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-slmwj\" (UID: \"e82cbbf2-9c64-4139-b7a5-0269815d4a21\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:43:47.456184 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.455964    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/793a4f9c-0c8b-4ade-b72d-38db5bd23628-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-cdh8l\" (UID: \"793a4f9c-0c8b-4ade-b72d-38db5bd23628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l"
Sep 18 19:43:47.456184 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.456016    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-default-certificate\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:47.456184 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.456087    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:47.556948 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.556919    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzfzm\" (UniqueName: \"kubernetes.io/projected/03ba9884-292f-4a6a-939d-787d598683f4-kube-api-access-zzfzm\") pod \"network-check-source-7cbc45fddc-7s7sk\" (UID: \"03ba9884-292f-4a6a-939d-787d598683f4\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-7s7sk"
Sep 18 19:43:47.557122 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.556960    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e82cbbf2-9c64-4139-b7a5-0269815d4a21-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-slmwj\" (UID: \"e82cbbf2-9c64-4139-b7a5-0269815d4a21\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:43:47.557122 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.556979    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-slmwj\" (UID: \"e82cbbf2-9c64-4139-b7a5-0269815d4a21\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:43:47.557122 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.557000    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/793a4f9c-0c8b-4ade-b72d-38db5bd23628-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-cdh8l\" (UID: \"793a4f9c-0c8b-4ade-b72d-38db5bd23628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l"
Sep 18 19:43:47.557122 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.557034    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-default-certificate\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:47.557122 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.557076    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:47.557396 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:47.557139    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 19:43:47.557396 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.557170    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7txlp\" (UniqueName: \"kubernetes.io/projected/e218c301-a9dc-4497-a0c8-11674cc3670d-kube-api-access-7txlp\") pod \"cluster-samples-operator-685d7d68b5-cg8sq\" (UID: \"e218c301-a9dc-4497-a0c8-11674cc3670d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"
Sep 18 19:43:47.557396 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:47.557193    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle podName:2d739ea5-66dc-4a3c-83b6-59d21c3054e5 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:48.05717331 +0000 UTC m=+270.384267075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle") pod "router-default-679f8486cd-4ktr5" (UID: "2d739ea5-66dc-4a3c-83b6-59d21c3054e5") : configmap references non-existent config key: service-ca.crt
Sep 18 19:43:47.557396 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:47.557279    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls podName:e82cbbf2-9c64-4139-b7a5-0269815d4a21 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:48.057259888 +0000 UTC m=+270.384353641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-slmwj" (UID: "e82cbbf2-9c64-4139-b7a5-0269815d4a21") : secret "cluster-monitoring-operator-tls" not found
Sep 18 19:43:47.557396 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.557327    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-stats-auth\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:47.557396 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.557353    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/793a4f9c-0c8b-4ade-b72d-38db5bd23628-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-cdh8l\" (UID: \"793a4f9c-0c8b-4ade-b72d-38db5bd23628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l"
Sep 18 19:43:47.557396 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.557379    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtbb4\" (UniqueName: \"kubernetes.io/projected/793a4f9c-0c8b-4ade-b72d-38db5bd23628-kube-api-access-wtbb4\") pod \"kube-storage-version-migrator-operator-55889f7b47-cdh8l\" (UID: \"793a4f9c-0c8b-4ade-b72d-38db5bd23628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l"
Sep 18 19:43:47.557754 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.557424    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8dzt\" (UniqueName: \"kubernetes.io/projected/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-kube-api-access-l8dzt\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:47.557754 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.557459    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqmt\" (UniqueName: \"kubernetes.io/projected/e82cbbf2-9c64-4139-b7a5-0269815d4a21-kube-api-access-vvqmt\") pod \"cluster-monitoring-operator-847b8bd8d7-slmwj\" (UID: \"e82cbbf2-9c64-4139-b7a5-0269815d4a21\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:43:47.557754 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.557496    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:47.557754 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.557524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-cg8sq\" (UID: \"e218c301-a9dc-4497-a0c8-11674cc3670d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"
Sep 18 19:43:47.557754 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:47.557647    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 19:43:47.557754 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.557710    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/793a4f9c-0c8b-4ade-b72d-38db5bd23628-config\") pod \"kube-storage-version-migrator-operator-55889f7b47-cdh8l\" (UID: \"793a4f9c-0c8b-4ade-b72d-38db5bd23628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l"
Sep 18 19:43:47.557754 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:47.557716    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls podName:e218c301-a9dc-4497-a0c8-11674cc3670d nodeName:}" failed. No retries permitted until 2026-09-18 19:43:48.057695799 +0000 UTC m=+270.384789555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-cg8sq" (UID: "e218c301-a9dc-4497-a0c8-11674cc3670d") : secret "samples-operator-tls" not found
Sep 18 19:43:47.558068 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:47.557791    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 19:43:47.558068 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:47.557848    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs podName:2d739ea5-66dc-4a3c-83b6-59d21c3054e5 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:48.057833484 +0000 UTC m=+270.384927240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs") pod "router-default-679f8486cd-4ktr5" (UID: "2d739ea5-66dc-4a3c-83b6-59d21c3054e5") : secret "router-metrics-certs-default" not found
Sep 18 19:43:47.558068 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.557867    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e82cbbf2-9c64-4139-b7a5-0269815d4a21-telemetry-config\") pod \"cluster-monitoring-operator-847b8bd8d7-slmwj\" (UID: \"e82cbbf2-9c64-4139-b7a5-0269815d4a21\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:43:47.559536 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.559517    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/793a4f9c-0c8b-4ade-b72d-38db5bd23628-serving-cert\") pod \"kube-storage-version-migrator-operator-55889f7b47-cdh8l\" (UID: \"793a4f9c-0c8b-4ade-b72d-38db5bd23628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l"
Sep 18 19:43:47.559655 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.559640    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-default-certificate\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:47.559692 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.559677    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-stats-auth\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:47.568192 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.568163    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7txlp\" (UniqueName: \"kubernetes.io/projected/e218c301-a9dc-4497-a0c8-11674cc3670d-kube-api-access-7txlp\") pod \"cluster-samples-operator-685d7d68b5-cg8sq\" (UID: \"e218c301-a9dc-4497-a0c8-11674cc3670d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"
Sep 18 19:43:47.568647 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.568623    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtbb4\" (UniqueName: \"kubernetes.io/projected/793a4f9c-0c8b-4ade-b72d-38db5bd23628-kube-api-access-wtbb4\") pod \"kube-storage-version-migrator-operator-55889f7b47-cdh8l\" (UID: \"793a4f9c-0c8b-4ade-b72d-38db5bd23628\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l"
Sep 18 19:43:47.568732 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.568675    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvqmt\" (UniqueName: \"kubernetes.io/projected/e82cbbf2-9c64-4139-b7a5-0269815d4a21-kube-api-access-vvqmt\") pod \"cluster-monitoring-operator-847b8bd8d7-slmwj\" (UID: \"e82cbbf2-9c64-4139-b7a5-0269815d4a21\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:43:47.568732 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.568691    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8dzt\" (UniqueName: \"kubernetes.io/projected/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-kube-api-access-l8dzt\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:47.568911 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.568887    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzfzm\" (UniqueName: \"kubernetes.io/projected/03ba9884-292f-4a6a-939d-787d598683f4-kube-api-access-zzfzm\") pod \"network-check-source-7cbc45fddc-7s7sk\" (UID: \"03ba9884-292f-4a6a-939d-787d598683f4\") " pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-7s7sk"
Sep 18 19:43:47.641313 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.641237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:47.664666 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.664645    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-7s7sk"
Sep 18 19:43:47.687687 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.687658    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l"
Sep 18 19:43:47.742754 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.742662    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:47.933025 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.932955    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7cbc45fddc-7s7sk"]
Sep 18 19:43:47.935788 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:43:47.935761    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ba9884_292f_4a6a_939d_787d598683f4.slice/crio-2afedf9fe6506bec34921aea61971b054584d032c50983c591a405e4ded9e4c7 WatchSource:0}: Error finding container 2afedf9fe6506bec34921aea61971b054584d032c50983c591a405e4ded9e4c7: Status 404 returned error can't find the container with id 2afedf9fe6506bec34921aea61971b054584d032c50983c591a405e4ded9e4c7
Sep 18 19:43:47.964981 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:47.963434    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l"]
Sep 18 19:43:47.969621 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:43:47.969592    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod793a4f9c_0c8b_4ade_b72d_38db5bd23628.slice/crio-134bc7b4b43014ecdda33be4f22915e3cf580cba321517c21c9a9afa594223c7 WatchSource:0}: Error finding container 134bc7b4b43014ecdda33be4f22915e3cf580cba321517c21c9a9afa594223c7: Status 404 returned error can't find the container with id 134bc7b4b43014ecdda33be4f22915e3cf580cba321517c21c9a9afa594223c7
Sep 18 19:43:48.061767 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:48.061727    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:48.061952 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:48.061796    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:48.061952 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:48.061821    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-cg8sq\" (UID: \"e218c301-a9dc-4497-a0c8-11674cc3670d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"
Sep 18 19:43:48.061952 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:48.061849    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-slmwj\" (UID: \"e82cbbf2-9c64-4139-b7a5-0269815d4a21\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:43:48.061952 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:48.061937    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle podName:2d739ea5-66dc-4a3c-83b6-59d21c3054e5 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:49.061911778 +0000 UTC m=+271.389005533 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle") pod "router-default-679f8486cd-4ktr5" (UID: "2d739ea5-66dc-4a3c-83b6-59d21c3054e5") : configmap references non-existent config key: service-ca.crt
Sep 18 19:43:48.062146 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:48.061969    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 19:43:48.062146 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:48.061977    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 19:43:48.062146 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:48.062017    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls podName:e82cbbf2-9c64-4139-b7a5-0269815d4a21 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:49.062005185 +0000 UTC m=+271.389098931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-slmwj" (UID: "e82cbbf2-9c64-4139-b7a5-0269815d4a21") : secret "cluster-monitoring-operator-tls" not found
Sep 18 19:43:48.062146 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:48.062030    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls podName:e218c301-a9dc-4497-a0c8-11674cc3670d nodeName:}" failed. No retries permitted until 2026-09-18 19:43:49.062024304 +0000 UTC m=+271.389118046 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-cg8sq" (UID: "e218c301-a9dc-4497-a0c8-11674cc3670d") : secret "samples-operator-tls" not found
Sep 18 19:43:48.062146 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:48.061969    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 19:43:48.062146 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:48.062082    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs podName:2d739ea5-66dc-4a3c-83b6-59d21c3054e5 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:49.062072322 +0000 UTC m=+271.389166098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs") pod "router-default-679f8486cd-4ktr5" (UID: "2d739ea5-66dc-4a3c-83b6-59d21c3054e5") : secret "router-metrics-certs-default" not found
Sep 18 19:43:48.632862 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:48.632820    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l" event={"ID":"793a4f9c-0c8b-4ade-b72d-38db5bd23628","Type":"ContainerStarted","Data":"134bc7b4b43014ecdda33be4f22915e3cf580cba321517c21c9a9afa594223c7"}
Sep 18 19:43:48.634522 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:48.634489    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-7s7sk" event={"ID":"03ba9884-292f-4a6a-939d-787d598683f4","Type":"ContainerStarted","Data":"e73405bc50e8ad6ed52ae85b3f947f0ca9ddcffdc36a4fe8c15272cc4bc6bd8c"}
Sep 18 19:43:48.634659 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:48.634534    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-7s7sk" event={"ID":"03ba9884-292f-4a6a-939d-787d598683f4","Type":"ContainerStarted","Data":"2afedf9fe6506bec34921aea61971b054584d032c50983c591a405e4ded9e4c7"}
Sep 18 19:43:48.651501 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:48.651417    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7cbc45fddc-7s7sk" podStartSLOduration=1.651396262 podStartE2EDuration="1.651396262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:43:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:43:48.649989039 +0000 UTC m=+270.977082815" watchObservedRunningTime="2026-09-18 19:43:48.651396262 +0000 UTC m=+270.978490027"
Sep 18 19:43:49.068635 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:49.068548    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:49.068635 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:49.068594    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-cg8sq\" (UID: \"e218c301-a9dc-4497-a0c8-11674cc3670d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"
Sep 18 19:43:49.068852 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:49.068636    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-slmwj\" (UID: \"e82cbbf2-9c64-4139-b7a5-0269815d4a21\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:43:49.068852 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:49.068695    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:49.068852 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:49.068725    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 19:43:49.068852 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:49.068770    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 19:43:49.068852 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:49.068780    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 19:43:49.068852 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:49.068810    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle podName:2d739ea5-66dc-4a3c-83b6-59d21c3054e5 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:51.068792648 +0000 UTC m=+273.395886408 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle") pod "router-default-679f8486cd-4ktr5" (UID: "2d739ea5-66dc-4a3c-83b6-59d21c3054e5") : configmap references non-existent config key: service-ca.crt
Sep 18 19:43:49.068852 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:49.068837    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls podName:e82cbbf2-9c64-4139-b7a5-0269815d4a21 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:51.068819565 +0000 UTC m=+273.395913326 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-slmwj" (UID: "e82cbbf2-9c64-4139-b7a5-0269815d4a21") : secret "cluster-monitoring-operator-tls" not found
Sep 18 19:43:49.068852 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:49.068853    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls podName:e218c301-a9dc-4497-a0c8-11674cc3670d nodeName:}" failed. No retries permitted until 2026-09-18 19:43:51.068845483 +0000 UTC m=+273.395939230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-cg8sq" (UID: "e218c301-a9dc-4497-a0c8-11674cc3670d") : secret "samples-operator-tls" not found
Sep 18 19:43:49.069231 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:49.068868    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs podName:2d739ea5-66dc-4a3c-83b6-59d21c3054e5 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:51.068859632 +0000 UTC m=+273.395953373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs") pod "router-default-679f8486cd-4ktr5" (UID: "2d739ea5-66dc-4a3c-83b6-59d21c3054e5") : secret "router-metrics-certs-default" not found
Sep 18 19:43:49.640982 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:49.640953    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:49.752499 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:49.752475    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:50.641525 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:50.641489    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l" event={"ID":"793a4f9c-0c8b-4ade-b72d-38db5bd23628","Type":"ContainerStarted","Data":"4c4c5b4a3f75503ba140587f14f88c0f577973249d32eea472123a877bcd056b"}
Sep 18 19:43:50.658356 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:50.658309    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l" podStartSLOduration=1.951176862 podStartE2EDuration="3.658289068s" totalImagesPullingTime="1.707112206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:43:50.658104024 +0000 UTC m=+272.985197801" watchObservedRunningTime="2026-09-18 19:43:50.658289068 +0000 UTC m=+272.985382833"
Sep 18 19:43:51.083961 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.083926    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:51.084126 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.084006    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:51.084126 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.084057    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-cg8sq\" (UID: \"e218c301-a9dc-4497-a0c8-11674cc3670d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"
Sep 18 19:43:51.084126 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:51.084108    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle podName:2d739ea5-66dc-4a3c-83b6-59d21c3054e5 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:55.084091635 +0000 UTC m=+277.411185377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle") pod "router-default-679f8486cd-4ktr5" (UID: "2d739ea5-66dc-4a3c-83b6-59d21c3054e5") : configmap references non-existent config key: service-ca.crt
Sep 18 19:43:51.084296 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.084134    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-slmwj\" (UID: \"e82cbbf2-9c64-4139-b7a5-0269815d4a21\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:43:51.084296 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:51.084153    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 19:43:51.084296 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:51.084198    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs podName:2d739ea5-66dc-4a3c-83b6-59d21c3054e5 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:55.084186499 +0000 UTC m=+277.411280261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs") pod "router-default-679f8486cd-4ktr5" (UID: "2d739ea5-66dc-4a3c-83b6-59d21c3054e5") : secret "router-metrics-certs-default" not found
Sep 18 19:43:51.084296 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:51.084153    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 19:43:51.084296 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:51.084233    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls podName:e218c301-a9dc-4497-a0c8-11674cc3670d nodeName:}" failed. No retries permitted until 2026-09-18 19:43:55.08422256 +0000 UTC m=+277.411316320 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-cg8sq" (UID: "e218c301-a9dc-4497-a0c8-11674cc3670d") : secret "samples-operator-tls" not found
Sep 18 19:43:51.084296 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:51.084246    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 19:43:51.084296 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:51.084278    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls podName:e82cbbf2-9c64-4139-b7a5-0269815d4a21 nodeName:}" failed. No retries permitted until 2026-09-18 19:43:55.084268903 +0000 UTC m=+277.411362645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-slmwj" (UID: "e82cbbf2-9c64-4139-b7a5-0269815d4a21") : secret "cluster-monitoring-operator-tls" not found
Sep 18 19:43:51.587717 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.587684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:51.706602 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.706565    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:51.737771 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.737739    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-srf6t"]
Sep 18 19:43:51.739669 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.739653    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-srf6t"
Sep 18 19:43:51.742839 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.742818    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-8djt8\""
Sep 18 19:43:51.743980 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.743952    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 18 19:43:51.744285 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.744268    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 18 19:43:51.757268 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.757240    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-srf6t"]
Sep 18 19:43:51.795322 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.795287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:51.803089 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.803059    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f8svn"]
Sep 18 19:43:51.805107 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.805089    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:51.807794 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.807772    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 18 19:43:51.807794 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.807790    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 18 19:43:51.807974 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.807817    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 18 19:43:51.807974 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.807845    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 18 19:43:51.807974 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.807872    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ldqld\""
Sep 18 19:43:51.818746 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.818723    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f8svn"]
Sep 18 19:43:51.890894 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.890798    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:51.890894 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.890841    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nlfq\" (UniqueName: \"kubernetes.io/projected/5f7398bc-780a-40de-8214-60efb6295e06-kube-api-access-7nlfq\") pod \"migrator-76794cbd6c-srf6t\" (UID: \"5f7398bc-780a-40de-8214-60efb6295e06\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-srf6t"
Sep 18 19:43:51.891152 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.890913    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/296d30f9-5ce1-4b50-a561-52e035e9864a-crio-socket\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:51.891152 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.890978    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:51.891152 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.891012    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nj7l\" (UniqueName: \"kubernetes.io/projected/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-api-access-9nj7l\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:51.891152 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.891064    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/296d30f9-5ce1-4b50-a561-52e035e9864a-data-volume\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:51.893350 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.893328    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:51.991568 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.991535    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/296d30f9-5ce1-4b50-a561-52e035e9864a-crio-socket\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:51.991728 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.991603    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:51.991728 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.991626    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nj7l\" (UniqueName: \"kubernetes.io/projected/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-api-access-9nj7l\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:51.991728 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.991642    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/296d30f9-5ce1-4b50-a561-52e035e9864a-data-volume\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:51.991728 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.991664    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/296d30f9-5ce1-4b50-a561-52e035e9864a-crio-socket\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:51.991728 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.991690    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:51.991728 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:51.991705    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:51.991986 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:51.991762    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:43:51.991986 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.991709    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nlfq\" (UniqueName: \"kubernetes.io/projected/5f7398bc-780a-40de-8214-60efb6295e06-kube-api-access-7nlfq\") pod \"migrator-76794cbd6c-srf6t\" (UID: \"5f7398bc-780a-40de-8214-60efb6295e06\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-srf6t"
Sep 18 19:43:51.991986 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:51.991778    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls podName:296d30f9-5ce1-4b50-a561-52e035e9864a nodeName:}" failed. No retries permitted until 2026-09-18 19:43:52.491757528 +0000 UTC m=+274.818851294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f8svn" (UID: "296d30f9-5ce1-4b50-a561-52e035e9864a") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:51.991986 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:51.991813    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm podName:296d30f9-5ce1-4b50-a561-52e035e9864a nodeName:}" failed. No retries permitted until 2026-09-18 19:43:52.49179957 +0000 UTC m=+274.818893315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f8svn" (UID: "296d30f9-5ce1-4b50-a561-52e035e9864a") : configmap "kube-rbac-proxy" not found
Sep 18 19:43:51.991986 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:51.991961    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/296d30f9-5ce1-4b50-a561-52e035e9864a-data-volume\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:52.000463 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:52.000432    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nj7l\" (UniqueName: \"kubernetes.io/projected/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-api-access-9nj7l\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:52.000577 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:52.000495    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nlfq\" (UniqueName: \"kubernetes.io/projected/5f7398bc-780a-40de-8214-60efb6295e06-kube-api-access-7nlfq\") pod \"migrator-76794cbd6c-srf6t\" (UID: \"5f7398bc-780a-40de-8214-60efb6295e06\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-srf6t"
Sep 18 19:43:52.052267 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:52.052230    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-srf6t"
Sep 18 19:43:52.306475 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:52.306393    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:52.319049 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:52.318863    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-srf6t"]
Sep 18 19:43:52.321760 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:43:52.321733    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f7398bc_780a_40de_8214_60efb6295e06.slice/crio-96cc1c3bd8f71bb10bfd70ace32b394016d52aba691536e8d9e94ee089254136 WatchSource:0}: Error finding container 96cc1c3bd8f71bb10bfd70ace32b394016d52aba691536e8d9e94ee089254136: Status 404 returned error can't find the container with id 96cc1c3bd8f71bb10bfd70ace32b394016d52aba691536e8d9e94ee089254136
Sep 18 19:43:52.408434 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:52.408408    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:52.496250 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:52.496216    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:52.496475 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:52.496284    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:52.496475 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:52.496386    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:52.496475 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:52.496452    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls podName:296d30f9-5ce1-4b50-a561-52e035e9864a nodeName:}" failed. No retries permitted until 2026-09-18 19:43:53.496436343 +0000 UTC m=+275.823530086 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f8svn" (UID: "296d30f9-5ce1-4b50-a561-52e035e9864a") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:52.496475 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:52.496389    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:43:52.496605 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:52.496514    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm podName:296d30f9-5ce1-4b50-a561-52e035e9864a nodeName:}" failed. No retries permitted until 2026-09-18 19:43:53.496501872 +0000 UTC m=+275.823595614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f8svn" (UID: "296d30f9-5ce1-4b50-a561-52e035e9864a") : configmap "kube-rbac-proxy" not found
Sep 18 19:43:52.650905 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:52.650871    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-srf6t" event={"ID":"5f7398bc-780a-40de-8214-60efb6295e06","Type":"ContainerStarted","Data":"96cc1c3bd8f71bb10bfd70ace32b394016d52aba691536e8d9e94ee089254136"}
Sep 18 19:43:53.505114 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:53.505092    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:53.505388 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:53.505157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:53.505388 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:53.505227    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:53.505388 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:53.505249    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:43:53.505388 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:53.505277    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls podName:296d30f9-5ce1-4b50-a561-52e035e9864a nodeName:}" failed. No retries permitted until 2026-09-18 19:43:55.505262119 +0000 UTC m=+277.832355866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f8svn" (UID: "296d30f9-5ce1-4b50-a561-52e035e9864a") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:53.505388 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:53.505291    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm podName:296d30f9-5ce1-4b50-a561-52e035e9864a nodeName:}" failed. No retries permitted until 2026-09-18 19:43:55.505283925 +0000 UTC m=+277.832377667 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f8svn" (UID: "296d30f9-5ce1-4b50-a561-52e035e9864a") : configmap "kube-rbac-proxy" not found
Sep 18 19:43:53.655627 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:53.655554    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-srf6t" event={"ID":"5f7398bc-780a-40de-8214-60efb6295e06","Type":"ContainerStarted","Data":"3bf9365712aa0fd644cac03a556c08f07b364ab02cf3255bff4e680f740f86a8"}
Sep 18 19:43:53.655627 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:53.655602    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-srf6t" event={"ID":"5f7398bc-780a-40de-8214-60efb6295e06","Type":"ContainerStarted","Data":"281d07e91805b586dafc4ac703bac51fc8642d98d4dedcd03fc2c5c61532cfb2"}
Sep 18 19:43:53.672240 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:53.672196    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-srf6t" podStartSLOduration=1.608112222 podStartE2EDuration="2.672182418s" totalImagesPullingTime="1.064070196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:43:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:43:53.670601595 +0000 UTC m=+275.997695359" watchObservedRunningTime="2026-09-18 19:43:53.672182418 +0000 UTC m=+275.999276181"
Sep 18 19:43:53.781545 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:53.781516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:53.842441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:53.842412    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:53.947123 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:53.947028    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:54.019218 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:54.019186    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:54.354973 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:54.354945    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dbv6f_7502ed14-3896-469a-b1e2-8e58bf1433a1/dns-node-resolver/0.log"
Sep 18 19:43:54.926129 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:54.926101    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:55.117540 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:55.117511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:55.117691 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:55.117582    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:43:55.117691 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:55.117604    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-cg8sq\" (UID: \"e218c301-a9dc-4497-a0c8-11674cc3670d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"
Sep 18 19:43:55.117691 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:55.117629    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-slmwj\" (UID: \"e82cbbf2-9c64-4139-b7a5-0269815d4a21\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:43:55.117691 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:55.117669    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle podName:2d739ea5-66dc-4a3c-83b6-59d21c3054e5 nodeName:}" failed. No retries permitted until 2026-09-18 19:44:03.117653367 +0000 UTC m=+285.444747110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle") pod "router-default-679f8486cd-4ktr5" (UID: "2d739ea5-66dc-4a3c-83b6-59d21c3054e5") : configmap references non-existent config key: service-ca.crt
Sep 18 19:43:55.117923 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:55.117738    2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 18 19:43:55.117923 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:55.117781    2583 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 18 19:43:55.117923 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:55.117786    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs podName:2d739ea5-66dc-4a3c-83b6-59d21c3054e5 nodeName:}" failed. No retries permitted until 2026-09-18 19:44:03.117773877 +0000 UTC m=+285.444867640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs") pod "router-default-679f8486cd-4ktr5" (UID: "2d739ea5-66dc-4a3c-83b6-59d21c3054e5") : secret "router-metrics-certs-default" not found
Sep 18 19:43:55.117923 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:55.117848    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls podName:e218c301-a9dc-4497-a0c8-11674cc3670d nodeName:}" failed. No retries permitted until 2026-09-18 19:44:03.117832764 +0000 UTC m=+285.444926511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls") pod "cluster-samples-operator-685d7d68b5-cg8sq" (UID: "e218c301-a9dc-4497-a0c8-11674cc3670d") : secret "samples-operator-tls" not found
Sep 18 19:43:55.117923 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:55.117789    2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 18 19:43:55.117923 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:55.117904    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls podName:e82cbbf2-9c64-4139-b7a5-0269815d4a21 nodeName:}" failed. No retries permitted until 2026-09-18 19:44:03.117890089 +0000 UTC m=+285.444983848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-847b8bd8d7-slmwj" (UID: "e82cbbf2-9c64-4139-b7a5-0269815d4a21") : secret "cluster-monitoring-operator-tls" not found
Sep 18 19:43:55.475354 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:55.475314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:55.521049 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:55.521003    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:55.521199 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:55.521114    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:43:55.521199 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:55.521168    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm podName:296d30f9-5ce1-4b50-a561-52e035e9864a nodeName:}" failed. No retries permitted until 2026-09-18 19:43:59.52115353 +0000 UTC m=+281.848247271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f8svn" (UID: "296d30f9-5ce1-4b50-a561-52e035e9864a") : configmap "kube-rbac-proxy" not found
Sep 18 19:43:55.521199 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:55.521117    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:55.521199 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:55.521179    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:55.521350 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:55.521215    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls podName:296d30f9-5ce1-4b50-a561-52e035e9864a nodeName:}" failed. No retries permitted until 2026-09-18 19:43:59.521205323 +0000 UTC m=+281.848299064 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f8svn" (UID: "296d30f9-5ce1-4b50-a561-52e035e9864a") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:55.590204 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:55.590163    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:55.690288 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:55.690258    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:55.755745 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:55.755683    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zqk5q_19f67046-5187-4f84-b4ad-1ef94c8a8e27/node-ca/0.log"
Sep 18 19:43:55.798119 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:55.798091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:55.868374 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:55.868349    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:55.992590 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:55.992562    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:56.176652 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:56.176623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:56.355586 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:56.355562    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n4mp2_77200409-483c-4a0f-bc4c-51980845fa8e/serve-healthcheck-canary/0.log"
Sep 18 19:43:56.756336 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:56.756314    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-srf6t_5f7398bc-780a-40de-8214-60efb6295e06/migrator/0.log"
Sep 18 19:43:56.955776 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:56.955749    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-srf6t_5f7398bc-780a-40de-8214-60efb6295e06/graceful-termination/0.log"
Sep 18 19:43:57.156549 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:57.156512    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-cdh8l_793a4f9c-0c8b-4ade-b72d-38db5bd23628/kube-storage-version-migrator-operator/0.log"
Sep 18 19:43:57.403227 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:57.403200    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:57.582057 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:57.582000    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:57.794101 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:57.794072    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:57.980424 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:57.980341    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:58.205102 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:58.205066    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:58.749896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:58.749853    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:59.155276 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:59.155246    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:59.222486 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:59.222459    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:59.371742 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:59.371694    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:59.372634 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:59.372612    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xxsmg" podUID="9c53ef47-6278-4b13-88f8-9e873a25f48d"
Sep 18 19:43:59.372682 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:59.372612    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr" podUID="70f3f4ae-9bcc-4527-b307-6d9b707d7673"
Sep 18 19:43:59.556791 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:59.556718    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:59.556914 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:59.556832    2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:59.556914 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:59.556856    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:43:59.556914 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:59.556883    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls podName:296d30f9-5ce1-4b50-a561-52e035e9864a nodeName:}" failed. No retries permitted until 2026-09-18 19:44:07.556869431 +0000 UTC m=+289.883963190 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f8svn" (UID: "296d30f9-5ce1-4b50-a561-52e035e9864a") : secret "insights-runtime-extractor-tls" not found
Sep 18 19:43:59.556914 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:59.556908    2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 18 19:43:59.557140 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:43:59.556945    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm podName:296d30f9-5ce1-4b50-a561-52e035e9864a nodeName:}" failed. No retries permitted until 2026-09-18 19:44:07.556934834 +0000 UTC m=+289.884028581 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f8svn" (UID: "296d30f9-5ce1-4b50-a561-52e035e9864a") : configmap "kube-rbac-proxy" not found
Sep 18 19:43:59.574237 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:59.574208    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:59.672787 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:59.672761    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:43:59.672909 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:59.672761    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:43:59.781375 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:59.781336    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:43:59.966229 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:43:59.966199    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:00.375031 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:00.374991    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:00.965946 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:00.965912    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:01.359192 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:01.359155    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:01.761111 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:01.761023    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:01.963147 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:01.963119    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:02.063367 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:02.063290    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:02.362584 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:02.362542    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:03.003172 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.003143    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:03.085004 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.084961    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:44:03.085209 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.085108    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:44:03.085209 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:44:03.085121    2583 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 18 19:44:03.085209 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:44:03.085178    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert podName:70f3f4ae-9bcc-4527-b307-6d9b707d7673 nodeName:}" failed. No retries permitted until 2026-09-18 19:46:05.085163062 +0000 UTC m=+407.412256804 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-tp4hr" (UID: "70f3f4ae-9bcc-4527-b307-6d9b707d7673") : secret "networking-console-plugin-cert" not found
Sep 18 19:44:03.087457 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.087436    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls\") pod \"image-registry-5d94c755-6mpmm\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") " pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:44:03.186103 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.186067    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-slmwj\" (UID: \"e82cbbf2-9c64-4139-b7a5-0269815d4a21\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:44:03.186249 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.186153    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:44:03.186249 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.186205    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:44:03.186388 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.186366    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:44:03.186443 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.186410    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-cg8sq\" (UID: \"e218c301-a9dc-4497-a0c8-11674cc3670d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"
Sep 18 19:44:03.186858 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.186822    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-service-ca-bundle\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:44:03.188643 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.188614    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c53ef47-6278-4b13-88f8-9e873a25f48d-metrics-tls\") pod \"dns-default-xxsmg\" (UID: \"9c53ef47-6278-4b13-88f8-9e873a25f48d\") " pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:44:03.188735 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.188647    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e82cbbf2-9c64-4139-b7a5-0269815d4a21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-847b8bd8d7-slmwj\" (UID: \"e82cbbf2-9c64-4139-b7a5-0269815d4a21\") " pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:44:03.188735 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.188678    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d739ea5-66dc-4a3c-83b6-59d21c3054e5-metrics-certs\") pod \"router-default-679f8486cd-4ktr5\" (UID: \"2d739ea5-66dc-4a3c-83b6-59d21c3054e5\") " pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:44:03.188735 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.188709    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e218c301-a9dc-4497-a0c8-11674cc3670d-samples-operator-tls\") pod \"cluster-samples-operator-685d7d68b5-cg8sq\" (UID: \"e218c301-a9dc-4497-a0c8-11674cc3670d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"
Sep 18 19:44:03.208596 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.208571    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b9rnh\""
Sep 18 19:44:03.216867 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.216850    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:44:03.273334 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.273305    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"
Sep 18 19:44:03.275931 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.275911    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-v8jjp\""
Sep 18 19:44:03.281169 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.281099    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"
Sep 18 19:44:03.283749 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.283730    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:44:03.291888 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.291866    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:44:03.364620 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.364259    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:03.493001 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.492974    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d94c755-6mpmm"]
Sep 18 19:44:03.496286 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:44:03.496256    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f3bc1eb_3f59_47af_8721_017b79a0830c.slice/crio-2733f088cd276aa24bf722cb4a180903c0f194362a3b440b0e2fc905d52f2777 WatchSource:0}: Error finding container 2733f088cd276aa24bf722cb4a180903c0f194362a3b440b0e2fc905d52f2777: Status 404 returned error can't find the container with id 2733f088cd276aa24bf722cb4a180903c0f194362a3b440b0e2fc905d52f2777
Sep 18 19:44:03.551139 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.551051    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj"]
Sep 18 19:44:03.552907 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:44:03.552880    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode82cbbf2_9c64_4139_b7a5_0269815d4a21.slice/crio-6718edfe0b9bb6c9c9c2c6be2c501165bdbbbf7da57c288d3f9e91831199232e WatchSource:0}: Error finding container 6718edfe0b9bb6c9c9c2c6be2c501165bdbbbf7da57c288d3f9e91831199232e: Status 404 returned error can't find the container with id 6718edfe0b9bb6c9c9c2c6be2c501165bdbbbf7da57c288d3f9e91831199232e
Sep 18 19:44:03.581959 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.581932    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xxsmg"]
Sep 18 19:44:03.584967 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:44:03.584936    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c53ef47_6278_4b13_88f8_9e873a25f48d.slice/crio-9d10fb2ee84e1b9883ff31a689e55643cec4b2bd361b48c3cc234f0b63697cc8 WatchSource:0}: Error finding container 9d10fb2ee84e1b9883ff31a689e55643cec4b2bd361b48c3cc234f0b63697cc8: Status 404 returned error can't find the container with id 9d10fb2ee84e1b9883ff31a689e55643cec4b2bd361b48c3cc234f0b63697cc8
Sep 18 19:44:03.586110 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.585984    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-679f8486cd-4ktr5"]
Sep 18 19:44:03.587150 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.587025    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq"]
Sep 18 19:44:03.589953 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:44:03.589931    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d739ea5_66dc_4a3c_83b6_59d21c3054e5.slice/crio-219450e4e0b3ebf445f87e10cfbe8078ffa014be29a474eb6fe5851ad8939631 WatchSource:0}: Error finding container 219450e4e0b3ebf445f87e10cfbe8078ffa014be29a474eb6fe5851ad8939631: Status 404 returned error can't find the container with id 219450e4e0b3ebf445f87e10cfbe8078ffa014be29a474eb6fe5851ad8939631
Sep 18 19:44:03.686963 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.686930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xxsmg" event={"ID":"9c53ef47-6278-4b13-88f8-9e873a25f48d","Type":"ContainerStarted","Data":"9d10fb2ee84e1b9883ff31a689e55643cec4b2bd361b48c3cc234f0b63697cc8"}
Sep 18 19:44:03.688236 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.688205    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj" event={"ID":"e82cbbf2-9c64-4139-b7a5-0269815d4a21","Type":"ContainerStarted","Data":"6718edfe0b9bb6c9c9c2c6be2c501165bdbbbf7da57c288d3f9e91831199232e"}
Sep 18 19:44:03.689737 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.689710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d94c755-6mpmm" event={"ID":"0f3bc1eb-3f59-47af-8721-017b79a0830c","Type":"ContainerStarted","Data":"c8d1726b55ebafb16e55a32f5f1838e1dc3d8bc46d0adccdc1c5a606ea81d27f"}
Sep 18 19:44:03.689837 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.689756    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d94c755-6mpmm" event={"ID":"0f3bc1eb-3f59-47af-8721-017b79a0830c","Type":"ContainerStarted","Data":"2733f088cd276aa24bf722cb4a180903c0f194362a3b440b0e2fc905d52f2777"}
Sep 18 19:44:03.689837 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.689805    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:44:03.691287 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.691266    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-679f8486cd-4ktr5" event={"ID":"2d739ea5-66dc-4a3c-83b6-59d21c3054e5","Type":"ContainerStarted","Data":"85ffc09061994c98ea833894c82c40aa7594f0a57fab1bbb31364808173c0f67"}
Sep 18 19:44:03.691369 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.691303    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-679f8486cd-4ktr5" event={"ID":"2d739ea5-66dc-4a3c-83b6-59d21c3054e5","Type":"ContainerStarted","Data":"219450e4e0b3ebf445f87e10cfbe8078ffa014be29a474eb6fe5851ad8939631"}
Sep 18 19:44:03.692506 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.692487    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq" event={"ID":"e218c301-a9dc-4497-a0c8-11674cc3670d","Type":"ContainerStarted","Data":"184c92ed2cac791f21889c18a58d54f9243f5aa58647834a1d9c5b283394168f"}
Sep 18 19:44:03.712328 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.712278    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d94c755-6mpmm" podStartSLOduration=283.712259476 podStartE2EDuration="4m43.712259476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:39:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:03.710549523 +0000 UTC m=+286.037643288" watchObservedRunningTime="2026-09-18 19:44:03.712259476 +0000 UTC m=+286.039353242"
Sep 18 19:44:03.732647 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.732603    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-679f8486cd-4ktr5" podStartSLOduration=16.732595384 podStartE2EDuration="16.732595384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:43:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:03.731772976 +0000 UTC m=+286.058866738" watchObservedRunningTime="2026-09-18 19:44:03.732595384 +0000 UTC m=+286.059689147"
Sep 18 19:44:03.762492 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:03.762429    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:04.167987 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:04.167318    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:04.292744 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:04.292439    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:44:04.295545 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:04.295521    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:44:04.565281 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:04.565190    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:04.698249 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:04.698220    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:44:04.699748 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:04.699725    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-679f8486cd-4ktr5"
Sep 18 19:44:04.891656 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:04.891608    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:04.992476 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:04.992435    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:05.362375 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:05.362343    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:05.564488 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:05.564456    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:05.962261 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:05.962201    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:06.144506 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.144407    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:06.244759 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.244728    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:06.446374 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.446338    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:06.547884 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.547809    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:06.647784 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.647751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:06.707424 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.707391    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq" event={"ID":"e218c301-a9dc-4497-a0c8-11674cc3670d","Type":"ContainerStarted","Data":"a28ffe381bcbb886a62fa4ef87d80ecf257eb313c012677e726152ed0a5b5a39"}
Sep 18 19:44:06.707621 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.707455    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq" event={"ID":"e218c301-a9dc-4497-a0c8-11674cc3670d","Type":"ContainerStarted","Data":"97844d26f293dde6d521988199b75a45ff6126962281f0431e66b723ae532c80"}
Sep 18 19:44:06.709229 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.709202    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xxsmg" event={"ID":"9c53ef47-6278-4b13-88f8-9e873a25f48d","Type":"ContainerStarted","Data":"0165898a8741364c28ebdd218afac79ad435ac7532b419560bfc7037a5c09270"}
Sep 18 19:44:06.709334 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.709253    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xxsmg" event={"ID":"9c53ef47-6278-4b13-88f8-9e873a25f48d","Type":"ContainerStarted","Data":"4f2760be2fcb3b0498dd7c488107955413fc851ead780906ebc28faa3a7eea3b"}
Sep 18 19:44:06.709334 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.709323    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:44:06.710712 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.710690    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj" event={"ID":"e82cbbf2-9c64-4139-b7a5-0269815d4a21","Type":"ContainerStarted","Data":"dde19f3216973dd3dbc8e5cc3c9f0dedf5bd9e8fccd5344ce614e83c1bdfadd3"}
Sep 18 19:44:06.726510 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.726466    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-685d7d68b5-cg8sq" podStartSLOduration=17.262812882 podStartE2EDuration="19.726449293s" totalImagesPullingTime="2.463636411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:06.72517034 +0000 UTC m=+289.052264104" watchObservedRunningTime="2026-09-18 19:44:06.726449293 +0000 UTC m=+289.053543057"
Sep 18 19:44:06.731241 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.731222    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:06.746966 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.746912    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xxsmg" podStartSLOduration=251.239244491 podStartE2EDuration="4m13.746893391s" totalImagesPullingTime="2.5076489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:06.745460903 +0000 UTC m=+289.072554667" watchObservedRunningTime="2026-09-18 19:44:06.746893391 +0000 UTC m=+289.073987155"
Sep 18 19:44:06.765098 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:06.765035    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-847b8bd8d7-slmwj" podStartSLOduration=17.228144052 podStartE2EDuration="19.765021179s" totalImagesPullingTime="2.536877127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:43:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:06.764108937 +0000 UTC m=+289.091202750" watchObservedRunningTime="2026-09-18 19:44:06.765021179 +0000 UTC m=+289.092114943"
Sep 18 19:44:07.623107 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:07.623058    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:44:07.623576 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:07.623226    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:44:07.623720 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:07.623700    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/296d30f9-5ce1-4b50-a561-52e035e9864a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:44:07.625300 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:07.625280    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/296d30f9-5ce1-4b50-a561-52e035e9864a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f8svn\" (UID: \"296d30f9-5ce1-4b50-a561-52e035e9864a\") " pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:44:07.713847 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:07.713817    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f8svn"
Sep 18 19:44:07.984759 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:07.984733    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f8svn"]
Sep 18 19:44:07.987030 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:44:07.987004    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod296d30f9_5ce1_4b50_a561_52e035e9864a.slice/crio-70e9f45b6ddd5628f285c01f72dad1ff56534dda35766bdf66c894e826fc609c WatchSource:0}: Error finding container 70e9f45b6ddd5628f285c01f72dad1ff56534dda35766bdf66c894e826fc609c: Status 404 returned error can't find the container with id 70e9f45b6ddd5628f285c01f72dad1ff56534dda35766bdf66c894e826fc609c
Sep 18 19:44:08.719614 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:08.719580    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8svn" event={"ID":"296d30f9-5ce1-4b50-a561-52e035e9864a","Type":"ContainerStarted","Data":"2af07912e5bee6c1da4164614733037979681e6022f0aabd9d57513173a03523"}
Sep 18 19:44:08.719955 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:08.719636    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8svn" event={"ID":"296d30f9-5ce1-4b50-a561-52e035e9864a","Type":"ContainerStarted","Data":"70e9f45b6ddd5628f285c01f72dad1ff56534dda35766bdf66c894e826fc609c"}
Sep 18 19:44:09.730574 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:09.730534    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8svn" event={"ID":"296d30f9-5ce1-4b50-a561-52e035e9864a","Type":"ContainerStarted","Data":"7e63feb14803b71c58d14885b70ff1180690a98b2c325f0abaafbf6bd675b938"}
Sep 18 19:44:10.735517 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:10.735481    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f8svn" event={"ID":"296d30f9-5ce1-4b50-a561-52e035e9864a","Type":"ContainerStarted","Data":"a1d3b2621d11d5a20647877b651502e76280f008f53f15040d5a8ee390128d4c"}
Sep 18 19:44:10.756723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:10.756671    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f8svn" podStartSLOduration=17.729056325 podStartE2EDuration="19.756654167s" totalImagesPullingTime="2.027597842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 19:43:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:10.755763569 +0000 UTC m=+293.082857340" watchObservedRunningTime="2026-09-18 19:44:10.756654167 +0000 UTC m=+293.083747908"
Sep 18 19:44:11.806271 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:44:11.806231    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-qqfbz" podUID="f4839d65-2531-49a9-b4fb-0a752464b27e"
Sep 18 19:44:13.879155 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:13.879115    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:13.980068 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:13.980021    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:14.040375 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:14.040343    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:14.178447 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:14.178384    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:14.556649 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:14.556568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:14.656455 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:14.656424    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:14.991555 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:14.991526    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:15.107358 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:15.107326    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:15.205646 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:15.205571    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:15.571525 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:15.571445    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:15.673194 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:15.673162    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:15.773208 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:15.773181    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:16.715635 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:16.715604    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xxsmg"
Sep 18 19:44:16.727831 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:16.727805    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:16.829105 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:16.829076    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:17.220891 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:17.220857    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:17.321567 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:17.321530    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:18.625762 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.625729    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:18.670408 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.670361    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"]
Sep 18 19:44:18.674597 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.674581    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:18.677211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.677190    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 18 19:44:18.677457 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.677443    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 18 19:44:18.678641 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.678624    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 18 19:44:18.678712 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.678628    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xm26j\""
Sep 18 19:44:18.686488 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.686468    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"]
Sep 18 19:44:18.699452 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.699427    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp84w\" (UniqueName: \"kubernetes.io/projected/92c9b495-5902-4735-aed3-fd3f18befbf9-kube-api-access-hp84w\") pod \"prometheus-operator-7bd5d56d6-lfksr\" (UID: \"92c9b495-5902-4735-aed3-fd3f18befbf9\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:18.699577 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.699462    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92c9b495-5902-4735-aed3-fd3f18befbf9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-lfksr\" (UID: \"92c9b495-5902-4735-aed3-fd3f18befbf9\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:18.699577 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.699483    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92c9b495-5902-4735-aed3-fd3f18befbf9-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-lfksr\" (UID: \"92c9b495-5902-4735-aed3-fd3f18befbf9\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:18.699659 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.699576    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/92c9b495-5902-4735-aed3-fd3f18befbf9-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-lfksr\" (UID: \"92c9b495-5902-4735-aed3-fd3f18befbf9\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:18.700328 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.700309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:18.800605 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.800573    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/92c9b495-5902-4735-aed3-fd3f18befbf9-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-lfksr\" (UID: \"92c9b495-5902-4735-aed3-fd3f18befbf9\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:18.800750 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.800641    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp84w\" (UniqueName: \"kubernetes.io/projected/92c9b495-5902-4735-aed3-fd3f18befbf9-kube-api-access-hp84w\") pod \"prometheus-operator-7bd5d56d6-lfksr\" (UID: \"92c9b495-5902-4735-aed3-fd3f18befbf9\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:18.800750 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.800667    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92c9b495-5902-4735-aed3-fd3f18befbf9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-lfksr\" (UID: \"92c9b495-5902-4735-aed3-fd3f18befbf9\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:18.800750 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.800683    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92c9b495-5902-4735-aed3-fd3f18befbf9-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-lfksr\" (UID: \"92c9b495-5902-4735-aed3-fd3f18befbf9\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:18.800750 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:44:18.800736    2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 18 19:44:18.800934 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:44:18.800823    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c9b495-5902-4735-aed3-fd3f18befbf9-prometheus-operator-tls podName:92c9b495-5902-4735-aed3-fd3f18befbf9 nodeName:}" failed. No retries permitted until 2026-09-18 19:44:19.30080286 +0000 UTC m=+301.627896601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/92c9b495-5902-4735-aed3-fd3f18befbf9-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-lfksr" (UID: "92c9b495-5902-4735-aed3-fd3f18befbf9") : secret "prometheus-operator-tls" not found
Sep 18 19:44:18.801509 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.801488    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92c9b495-5902-4735-aed3-fd3f18befbf9-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-lfksr\" (UID: \"92c9b495-5902-4735-aed3-fd3f18befbf9\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:18.803142 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.803127    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92c9b495-5902-4735-aed3-fd3f18befbf9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-lfksr\" (UID: \"92c9b495-5902-4735-aed3-fd3f18befbf9\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:18.809125 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.809108    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp84w\" (UniqueName: \"kubernetes.io/projected/92c9b495-5902-4735-aed3-fd3f18befbf9-kube-api-access-hp84w\") pod \"prometheus-operator-7bd5d56d6-lfksr\" (UID: \"92c9b495-5902-4735-aed3-fd3f18befbf9\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:18.889310 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:18.889237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:19.303518 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:19.303425    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/92c9b495-5902-4735-aed3-fd3f18befbf9-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-lfksr\" (UID: \"92c9b495-5902-4735-aed3-fd3f18befbf9\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:19.305855 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:19.305826    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/92c9b495-5902-4735-aed3-fd3f18befbf9-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-lfksr\" (UID: \"92c9b495-5902-4735-aed3-fd3f18befbf9\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:19.583232 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:19.583198    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"
Sep 18 19:44:19.662867 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:19.662843    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 19:44:19.663224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:19.662991    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 19:44:19.669932 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:19.669915    2583 kubelet.go:1648] "Image garbage collection succeeded"
Sep 18 19:44:19.854576 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:19.854513    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr"]
Sep 18 19:44:19.857404 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:44:19.857381    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c9b495_5902_4735_aed3_fd3f18befbf9.slice/crio-75d6534636ff2360ed40ee28faa822b961d830d3411a6c55b8dde9508d55f5c0 WatchSource:0}: Error finding container 75d6534636ff2360ed40ee28faa822b961d830d3411a6c55b8dde9508d55f5c0: Status 404 returned error can't find the container with id 75d6534636ff2360ed40ee28faa822b961d830d3411a6c55b8dde9508d55f5c0
Sep 18 19:44:20.768214 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:20.768175    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr" event={"ID":"92c9b495-5902-4735-aed3-fd3f18befbf9","Type":"ContainerStarted","Data":"75d6534636ff2360ed40ee28faa822b961d830d3411a6c55b8dde9508d55f5c0"}
Sep 18 19:44:21.348885 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:21.348832    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:21.772889 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:21.772858    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr" event={"ID":"92c9b495-5902-4735-aed3-fd3f18befbf9","Type":"ContainerStarted","Data":"23b6ba24956efa72c7e1e8c7d1dc301dc78fe01189312bbc42af1d62977bfcf7"}
Sep 18 19:44:21.773258 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:21.772916    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr" event={"ID":"92c9b495-5902-4735-aed3-fd3f18befbf9","Type":"ContainerStarted","Data":"2a39a633fe76fa3fbec7a97f132fe4bd960a5af245e814d909c866d00b156272"}
Sep 18 19:44:21.789436 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:21.789396    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-lfksr" podStartSLOduration=2.54887287 podStartE2EDuration="3.78938367s" totalImagesPullingTime="1.2405108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:44:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:21.789102064 +0000 UTC m=+304.116195830" watchObservedRunningTime="2026-09-18 19:44:21.78938367 +0000 UTC m=+304.116477433"
Sep 18 19:44:22.804990 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:22.804956    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:44:23.221422 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:23.221388    2583 patch_prober.go:28] interesting pod/image-registry-5d94c755-6mpmm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 18 19:44:23.221666 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:23.221441    2583 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d94c755-6mpmm" podUID="0f3bc1eb-3f59-47af-8721-017b79a0830c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:44:23.774833 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:23.774801    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:24.026763 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.026684    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zlbpj"]
Sep 18 19:44:24.032740 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.032716    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"]
Sep 18 19:44:24.032860 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.032843    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.035142 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.035119    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 18 19:44:24.035259 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.035174    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 18 19:44:24.035259 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.035233    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 18 19:44:24.035375 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.035298    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4wzv5\""
Sep 18 19:44:24.036943 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.036924    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.039417 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.039396    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 18 19:44:24.039517 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.039493    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 18 19:44:24.040267 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.040248    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 18 19:44:24.040267 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.040257    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7g8vm\""
Sep 18 19:44:24.046641 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.046623    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"]
Sep 18 19:44:24.140220 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140186    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-textfile\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.140366 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140226    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.140366 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140316    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq4sm\" (UniqueName: \"kubernetes.io/projected/c604c92b-e572-499f-8da4-526f1c924ccf-kube-api-access-pq4sm\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.140366 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140351    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c604c92b-e572-499f-8da4-526f1c924ccf-sys\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.140498 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140368    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-wtmp\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.140498 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140383    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.140561 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140489    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.140561 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140520    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a863862-2470-44ab-8eaa-2e6d1377801f-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.140561 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140548    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-tls\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.140656 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140588    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c604c92b-e572-499f-8da4-526f1c924ccf-metrics-client-ca\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.140656 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140608    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.140656 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140625    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5a863862-2470-44ab-8eaa-2e6d1377801f-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.140745 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n59s2\" (UniqueName: \"kubernetes.io/projected/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-api-access-n59s2\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.140745 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.140745 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.140703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c604c92b-e572-499f-8da4-526f1c924ccf-root\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.241654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241617    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c604c92b-e572-499f-8da4-526f1c924ccf-root\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.241813 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241663    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-textfile\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.241813 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241686    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.241813 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241728    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq4sm\" (UniqueName: \"kubernetes.io/projected/c604c92b-e572-499f-8da4-526f1c924ccf-kube-api-access-pq4sm\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.241813 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241734    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c604c92b-e572-499f-8da4-526f1c924ccf-root\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.241813 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241758    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c604c92b-e572-499f-8da4-526f1c924ccf-sys\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.241813 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241801    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c604c92b-e572-499f-8da4-526f1c924ccf-sys\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.241813 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241809    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-wtmp\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.242211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241837    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.242211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241893    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.242211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241920    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a863862-2470-44ab-8eaa-2e6d1377801f-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.242211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241946    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-tls\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.242211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241976    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c604c92b-e572-499f-8da4-526f1c924ccf-metrics-client-ca\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.242211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241999    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.242211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.242017    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-textfile\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.242211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.242021    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5a863862-2470-44ab-8eaa-2e6d1377801f-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.242211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.242069    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n59s2\" (UniqueName: \"kubernetes.io/projected/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-api-access-n59s2\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.242211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.242109    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.242211 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:44:24.242132    2583 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 18 19:44:24.242211 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:44:24.242193    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-state-metrics-tls podName:5a863862-2470-44ab-8eaa-2e6d1377801f nodeName:}" failed. No retries permitted until 2026-09-18 19:44:24.742174183 +0000 UTC m=+307.069267941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-state-metrics-tls") pod "kube-state-metrics-84c885658c-mvvgs" (UID: "5a863862-2470-44ab-8eaa-2e6d1377801f") : secret "kube-state-metrics-tls" not found
Sep 18 19:44:24.242787 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.242370    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-accelerators-collector-config\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.242787 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:44:24.242608    2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 18 19:44:24.242787 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:44:24.242678    2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-tls podName:c604c92b-e572-499f-8da4-526f1c924ccf nodeName:}" failed. No retries permitted until 2026-09-18 19:44:24.74265607 +0000 UTC m=+307.069749826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-tls") pod "node-exporter-zlbpj" (UID: "c604c92b-e572-499f-8da4-526f1c924ccf") : secret "node-exporter-tls" not found
Sep 18 19:44:24.242787 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.242689    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a863862-2470-44ab-8eaa-2e6d1377801f-metrics-client-ca\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.242787 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.241995    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-wtmp\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.242787 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.242761    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5a863862-2470-44ab-8eaa-2e6d1377801f-volume-directive-shadow\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.243117 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.242967    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.243175 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.243154    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c604c92b-e572-499f-8da4-526f1c924ccf-metrics-client-ca\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.244825 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.244806    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.244932 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.244895    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.250267 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.250226    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq4sm\" (UniqueName: \"kubernetes.io/projected/c604c92b-e572-499f-8da4-526f1c924ccf-kube-api-access-pq4sm\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.251310 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.251288    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n59s2\" (UniqueName: \"kubernetes.io/projected/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-api-access-n59s2\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.702825 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.702799    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:44:24.746173 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.746144    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.746335 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.746208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-tls\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.748894 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.748863    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c604c92b-e572-499f-8da4-526f1c924ccf-node-exporter-tls\") pod \"node-exporter-zlbpj\" (UID: \"c604c92b-e572-499f-8da4-526f1c924ccf\") " pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.749017 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.748960    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5a863862-2470-44ab-8eaa-2e6d1377801f-kube-state-metrics-tls\") pod \"kube-state-metrics-84c885658c-mvvgs\" (UID: \"5a863862-2470-44ab-8eaa-2e6d1377801f\") " pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.936466 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.936434    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:24.944402 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.944376    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zlbpj"
Sep 18 19:44:24.948548 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.948529    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"
Sep 18 19:44:24.962490 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:44:24.962455    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc604c92b_e572_499f_8da4_526f1c924ccf.slice/crio-2f8cad65caec598bab350286541157364310cb2142aba452561e9d2b2fff1e8e WatchSource:0}: Error finding container 2f8cad65caec598bab350286541157364310cb2142aba452561e9d2b2fff1e8e: Status 404 returned error can't find the container with id 2f8cad65caec598bab350286541157364310cb2142aba452561e9d2b2fff1e8e
Sep 18 19:44:24.964186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:24.964170    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 19:44:25.038508 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:25.038467    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:25.111416 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:25.111389    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:25.236910 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:25.236831    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-84c885658c-mvvgs"]
Sep 18 19:44:25.239604 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:44:25.239574    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a863862_2470_44ab_8eaa_2e6d1377801f.slice/crio-3abcd6eb492c619004126a8a7c2428af1acffed810a6c46275be6c8f4d4d8c27 WatchSource:0}: Error finding container 3abcd6eb492c619004126a8a7c2428af1acffed810a6c46275be6c8f4d4d8c27: Status 404 returned error can't find the container with id 3abcd6eb492c619004126a8a7c2428af1acffed810a6c46275be6c8f4d4d8c27
Sep 18 19:44:25.243628 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:25.243586    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:25.338779 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:25.338749    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:25.439249 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:25.439222    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:25.788612 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:25.788568    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlbpj" event={"ID":"c604c92b-e572-499f-8da4-526f1c924ccf","Type":"ContainerStarted","Data":"2f8cad65caec598bab350286541157364310cb2142aba452561e9d2b2fff1e8e"}
Sep 18 19:44:25.790065 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:25.790017    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs" event={"ID":"5a863862-2470-44ab-8eaa-2e6d1377801f","Type":"ContainerStarted","Data":"3abcd6eb492c619004126a8a7c2428af1acffed810a6c46275be6c8f4d4d8c27"}
Sep 18 19:44:25.886586 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:25.886549    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:25.987155 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:25.987126    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:26.096128 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.096099    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"]
Sep 18 19:44:26.099958 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.099934    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.102665 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.102383    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 18 19:44:26.102665 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.102498    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 18 19:44:26.102665 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.102597    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 18 19:44:26.102665 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.102651    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-n8gt9\""
Sep 18 19:44:26.102933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.102695    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4m2hj6ip1psfd\""
Sep 18 19:44:26.102933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.102855    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 18 19:44:26.102933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.102859    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 18 19:44:26.110152 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.110129    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"]
Sep 18 19:44:26.159736 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.159710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.159861 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.159744    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20c50db7-aa2f-40b1-9379-6f3ffea5c941-metrics-client-ca\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.159861 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.159796    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-tls\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.159945 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.159870    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.159945 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.159913    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.159945 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.159934    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.160128 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.159956    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4cd7\" (UniqueName: \"kubernetes.io/projected/20c50db7-aa2f-40b1-9379-6f3ffea5c941-kube-api-access-s4cd7\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.160128 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.160099    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-grpc-tls\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.261107 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.261070    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.261279 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.261132    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.261279 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.261160    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.261279 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.261186    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4cd7\" (UniqueName: \"kubernetes.io/projected/20c50db7-aa2f-40b1-9379-6f3ffea5c941-kube-api-access-s4cd7\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.261279 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.261248    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-grpc-tls\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.261505 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.261293    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.261505 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.261318    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20c50db7-aa2f-40b1-9379-6f3ffea5c941-metrics-client-ca\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.261505 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.261358    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-tls\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.262227 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.262174    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20c50db7-aa2f-40b1-9379-6f3ffea5c941-metrics-client-ca\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.264260 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.264116    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.264260 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.264209    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.264617 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.264582    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.264701 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.264613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-grpc-tls\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.264764 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.264708    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.265052 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.265011    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/20c50db7-aa2f-40b1-9379-6f3ffea5c941-secret-thanos-querier-tls\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.269328 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.269307    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4cd7\" (UniqueName: \"kubernetes.io/projected/20c50db7-aa2f-40b1-9379-6f3ffea5c941-kube-api-access-s4cd7\") pod \"thanos-querier-6f8f5c4f87-cbknm\" (UID: \"20c50db7-aa2f-40b1-9379-6f3ffea5c941\") " pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.412316 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.412279    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:26.707348 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.707315    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"]
Sep 18 19:44:26.709931 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:44:26.709898    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20c50db7_aa2f_40b1_9379_6f3ffea5c941.slice/crio-97bb42fafa29c3a897448f8c00548a515457a631606803003a2d2d020555b81d WatchSource:0}: Error finding container 97bb42fafa29c3a897448f8c00548a515457a631606803003a2d2d020555b81d: Status 404 returned error can't find the container with id 97bb42fafa29c3a897448f8c00548a515457a631606803003a2d2d020555b81d
Sep 18 19:44:26.795569 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.795530    2583 generic.go:356] "Generic (PLEG): container finished" podID="c604c92b-e572-499f-8da4-526f1c924ccf" containerID="290a7d418d82681e9a1e7d85b273bac49c9df0d636fca5cb94f87212448db67d" exitCode=0
Sep 18 19:44:26.795732 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.795623    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlbpj" event={"ID":"c604c92b-e572-499f-8da4-526f1c924ccf","Type":"ContainerDied","Data":"290a7d418d82681e9a1e7d85b273bac49c9df0d636fca5cb94f87212448db67d"}
Sep 18 19:44:26.797936 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.797904    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs" event={"ID":"5a863862-2470-44ab-8eaa-2e6d1377801f","Type":"ContainerStarted","Data":"d4785c462617fbfbb1e6761bb22d2bdcc236addfdeff7533150362afca737cc0"}
Sep 18 19:44:26.798079 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.797963    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs" event={"ID":"5a863862-2470-44ab-8eaa-2e6d1377801f","Type":"ContainerStarted","Data":"2c0a1221d3fd848cb9a5b38490398e5adbee66813cb8b1f8af05e788a665a897"}
Sep 18 19:44:26.798079 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.797989    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs" event={"ID":"5a863862-2470-44ab-8eaa-2e6d1377801f","Type":"ContainerStarted","Data":"84cd878fd803a8d33876735eccc71f13710c686d91b096bfb213270c3e39d228"}
Sep 18 19:44:26.799184 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.799163    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm" event={"ID":"20c50db7-aa2f-40b1-9379-6f3ffea5c941","Type":"ContainerStarted","Data":"97bb42fafa29c3a897448f8c00548a515457a631606803003a2d2d020555b81d"}
Sep 18 19:44:26.830980 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.830926    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-84c885658c-mvvgs" podStartSLOduration=1.6394283170000001 podStartE2EDuration="2.830908386s" totalImagesPullingTime="1.191480069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:26.829859556 +0000 UTC m=+309.156953320" watchObservedRunningTime="2026-09-18 19:44:26.830908386 +0000 UTC m=+309.158002152"
Sep 18 19:44:26.978249 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:26.978160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:27.078532 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:27.078494    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:27.810375 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:27.810340    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlbpj" event={"ID":"c604c92b-e572-499f-8da4-526f1c924ccf","Type":"ContainerStarted","Data":"c08500c07f32f1bf1ca31373ab070596e2e8c9896718e1dc8dc4beb3cb0b0d98"}
Sep 18 19:44:27.810793 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:27.810402    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zlbpj" event={"ID":"c604c92b-e572-499f-8da4-526f1c924ccf","Type":"ContainerStarted","Data":"968e646a5d932500853171c66bbcad4c2545f743dcd83e04d83bca3bfa2a9cc3"}
Sep 18 19:44:27.832557 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:27.832501    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zlbpj" podStartSLOduration=2.723057545 podStartE2EDuration="3.832483646s" totalImagesPullingTime="1.037862012s" totalInitContainerRuntime="71.564089ms" isStatefulPod=true podCreationTimestamp="2026-09-18 19:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:27.829954428 +0000 UTC m=+310.157048194" watchObservedRunningTime="2026-09-18 19:44:27.832483646 +0000 UTC m=+310.159577410"
Sep 18 19:44:28.212713 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:28.212640    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:28.311616 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:28.311576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:28.812411 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:28.812360    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm" event={"ID":"20c50db7-aa2f-40b1-9379-6f3ffea5c941","Type":"ContainerStarted","Data":"8425fab844bedf4bfc43f53e6adbcb8ea70697409725d026568a66bf691abc57"}
Sep 18 19:44:28.812753 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:28.812442    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm" event={"ID":"20c50db7-aa2f-40b1-9379-6f3ffea5c941","Type":"ContainerStarted","Data":"338c14382980c63bf725cb0b6b01997d3f8c36ac2031325a59c9982e78dc7b02"}
Sep 18 19:44:28.858450 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:28.858408    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:28.930177 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:28.930103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:29.042566 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:29.042533    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:29.547686 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:29.547657    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:29.648494 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:29.648466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:29.817911 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:29.817832    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm" event={"ID":"20c50db7-aa2f-40b1-9379-6f3ffea5c941","Type":"ContainerStarted","Data":"677ab62e8f9be09daf25e3168b307cfc5c8ec8605e2ec49e72bd234ad04c1e6b"}
Sep 18 19:44:29.817911 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:29.817898    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm" event={"ID":"20c50db7-aa2f-40b1-9379-6f3ffea5c941","Type":"ContainerStarted","Data":"af70ab6b0711b0b74baa614b753b96f1b39361748e4780aba548e2a0726a58a2"}
Sep 18 19:44:29.818412 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:29.817925    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm" event={"ID":"20c50db7-aa2f-40b1-9379-6f3ffea5c941","Type":"ContainerStarted","Data":"3a5c7341b5bf656198e45c1c1798ed1464e52efb1bccfd095456b5feb5d8a8ad"}
Sep 18 19:44:29.818412 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:29.817950    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm" event={"ID":"20c50db7-aa2f-40b1-9379-6f3ffea5c941","Type":"ContainerStarted","Data":"d936d2a7ab4fe46be4282d9aed3fcc90226f190adea99ad91b4aa1df7d5adb31"}
Sep 18 19:44:29.818412 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:29.818015    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:29.847985 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:29.847940    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm" podStartSLOduration=1.150369878 podStartE2EDuration="3.847925883s" totalImagesPullingTime="2.697556005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:44:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:29.845668879 +0000 UTC m=+312.172762644" watchObservedRunningTime="2026-09-18 19:44:29.847925883 +0000 UTC m=+312.175019646"
Sep 18 19:44:30.222187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:30.222156    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:30.392273 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:30.392239    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:33.383339 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.383301    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79766fb7ff-6bzzw"]
Sep 18 19:44:33.386425 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.386408    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.388902 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.388869    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 18 19:44:33.388997 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.388866    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 18 19:44:33.388997 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.388982    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hbqz6\""
Sep 18 19:44:33.389096 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.389000    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 18 19:44:33.389996 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.389975    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 18 19:44:33.390118 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.390023    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 18 19:44:33.390118 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.390089    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 18 19:44:33.390401 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.390385    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 18 19:44:33.394419 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.394401    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 18 19:44:33.398848 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.398829    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79766fb7ff-6bzzw"]
Sep 18 19:44:33.428970 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.428945    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-config\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.428970 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.428973    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h59k6\" (UniqueName: \"kubernetes.io/projected/02097b6e-30ca-42e5-bfc6-90f1e2657903-kube-api-access-h59k6\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.429166 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.428997    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-oauth-serving-cert\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.429166 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.429015    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-trusted-ca-bundle\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.429166 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.429120    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-oauth-config\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.429166 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.429162    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-serving-cert\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.429320 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.429177    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-service-ca\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.530219 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.530181    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-oauth-config\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.530349 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.530258    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-serving-cert\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.530349 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.530282    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-service-ca\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.530349 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.530331    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-config\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.530517 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.530358    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h59k6\" (UniqueName: \"kubernetes.io/projected/02097b6e-30ca-42e5-bfc6-90f1e2657903-kube-api-access-h59k6\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.530517 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.530401    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-oauth-serving-cert\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.530517 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.530429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-trusted-ca-bundle\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.531011 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.530989    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-service-ca\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.531303 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.531280    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-oauth-serving-cert\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.531378 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.531322    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-config\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.531528 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.531508    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-trusted-ca-bundle\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.532679 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.532660    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-oauth-config\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.532789 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.532772    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-serving-cert\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.538719 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.538699    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h59k6\" (UniqueName: \"kubernetes.io/projected/02097b6e-30ca-42e5-bfc6-90f1e2657903-kube-api-access-h59k6\") pod \"console-79766fb7ff-6bzzw\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") " pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.696927 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.696856    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:33.968087 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:33.967997    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79766fb7ff-6bzzw"]
Sep 18 19:44:33.971065 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:44:33.971017    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02097b6e_30ca_42e5_bfc6_90f1e2657903.slice/crio-f23b01ae1f6aecb962ebb8015f96a9805c2fdf1943b9ab26060e5041653e84ca WatchSource:0}: Error finding container f23b01ae1f6aecb962ebb8015f96a9805c2fdf1943b9ab26060e5041653e84ca: Status 404 returned error can't find the container with id f23b01ae1f6aecb962ebb8015f96a9805c2fdf1943b9ab26060e5041653e84ca
Sep 18 19:44:34.157169 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:34.157137    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:34.258421 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:34.258326    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:34.682336 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:34.682274    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:34.747060 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:34.747010    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:34.840462 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:34.840402    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79766fb7ff-6bzzw" event={"ID":"02097b6e-30ca-42e5-bfc6-90f1e2657903","Type":"ContainerStarted","Data":"f23b01ae1f6aecb962ebb8015f96a9805c2fdf1943b9ab26060e5041653e84ca"}
Sep 18 19:44:34.889441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:34.889353    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:34.990629 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:34.990559    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:35.828114 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:35.828087    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6f8f5c4f87-cbknm"
Sep 18 19:44:37.403269 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:37.403235    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d94c755-6mpmm"]
Sep 18 19:44:37.502250 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:37.502214    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:37.607496 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:37.607462    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:38.584542 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:38.584514    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:38.644560 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:38.644523    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:38.861078 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:38.860978    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79766fb7ff-6bzzw" event={"ID":"02097b6e-30ca-42e5-bfc6-90f1e2657903","Type":"ContainerStarted","Data":"907a944a3dac845e4c6a6463ca4dedb2bdd117788e8d6698334077c094d451af"}
Sep 18 19:44:38.878922 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:38.878860    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79766fb7ff-6bzzw" podStartSLOduration=1.5998134080000002 podStartE2EDuration="5.878835969s" totalImagesPullingTime="4.279022561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:38.877512612 +0000 UTC m=+321.204606376" watchObservedRunningTime="2026-09-18 19:44:38.878835969 +0000 UTC m=+321.205929734"
Sep 18 19:44:40.988020 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:40.987987    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79766fb7ff-6bzzw"]
Sep 18 19:44:41.016228 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.016194    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66b6f7fbf-ztwgr"]
Sep 18 19:44:41.049393 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.049360    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66b6f7fbf-ztwgr"]
Sep 18 19:44:41.049557 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.049469    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.206717 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.206687    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53b6e72-2490-42af-81f2-412bf4373898-console-oauth-config\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.206881 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.206741    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53b6e72-2490-42af-81f2-412bf4373898-console-serving-cert\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.206881 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.206806    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-console-config\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.206881 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.206831    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdjxq\" (UniqueName: \"kubernetes.io/projected/a53b6e72-2490-42af-81f2-412bf4373898-kube-api-access-xdjxq\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.206881 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.206872    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-trusted-ca-bundle\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.207021 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.206891    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-service-ca\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.207021 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.206912    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-oauth-serving-cert\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.307582 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.307509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-oauth-serving-cert\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.307582 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.307580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53b6e72-2490-42af-81f2-412bf4373898-console-oauth-config\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.307766 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.307634    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53b6e72-2490-42af-81f2-412bf4373898-console-serving-cert\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.307766 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.307675    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-console-config\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.307766 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.307696    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdjxq\" (UniqueName: \"kubernetes.io/projected/a53b6e72-2490-42af-81f2-412bf4373898-kube-api-access-xdjxq\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.307916 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.307763    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-trusted-ca-bundle\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.307916 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.307804    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-service-ca\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.308384 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.308358    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-oauth-serving-cert\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.308613 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.308402    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-console-config\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.308613 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.308525    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-service-ca\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.308754 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.308629    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-trusted-ca-bundle\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.310180 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.310159    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53b6e72-2490-42af-81f2-412bf4373898-console-serving-cert\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.310180 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.310170    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53b6e72-2490-42af-81f2-412bf4373898-console-oauth-config\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.315236 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.315220    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdjxq\" (UniqueName: \"kubernetes.io/projected/a53b6e72-2490-42af-81f2-412bf4373898-kube-api-access-xdjxq\") pod \"console-66b6f7fbf-ztwgr\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") " pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.358223 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.358203    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:41.658005 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.657981    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66b6f7fbf-ztwgr"]
Sep 18 19:44:41.660340 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:44:41.660310    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda53b6e72_2490_42af_81f2_412bf4373898.slice/crio-0dc9ded2c172ba0cf1c78fc3510606236677b4353016a45a398bbb8d34203e36 WatchSource:0}: Error finding container 0dc9ded2c172ba0cf1c78fc3510606236677b4353016a45a398bbb8d34203e36: Status 404 returned error can't find the container with id 0dc9ded2c172ba0cf1c78fc3510606236677b4353016a45a398bbb8d34203e36
Sep 18 19:44:41.873356 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.873310    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b6f7fbf-ztwgr" event={"ID":"a53b6e72-2490-42af-81f2-412bf4373898","Type":"ContainerStarted","Data":"2d6acd6ee7fb29770e37422510b4df5edd2bf650c5087d08a3433a15a20ccc11"}
Sep 18 19:44:41.873526 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.873370    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b6f7fbf-ztwgr" event={"ID":"a53b6e72-2490-42af-81f2-412bf4373898","Type":"ContainerStarted","Data":"0dc9ded2c172ba0cf1c78fc3510606236677b4353016a45a398bbb8d34203e36"}
Sep 18 19:44:41.890723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:41.890678    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66b6f7fbf-ztwgr" podStartSLOduration=1.89066326 podStartE2EDuration="1.89066326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:44:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:44:41.889925805 +0000 UTC m=+324.217019569" watchObservedRunningTime="2026-09-18 19:44:41.89066326 +0000 UTC m=+324.217757023"
Sep 18 19:44:43.697500 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:43.697469    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:44:43.791115 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:43.791079    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:43.855393 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:43.855357    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:46.381268 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:46.381235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:46.435546 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:46.435515    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:46.726289 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:46.726215    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:46.827015 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:46.826982    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:51.359406 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:51.359372    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:51.359848 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:51.359437    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:51.364327 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:51.364303    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:51.915605 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:51.915570    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:44:52.064205 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:52.064171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:52.166165 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:52.166071    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:52.270351 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:52.270318    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:44:52.372017 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:44:52.371986    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:00.945820 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:00.945736    2583 generic.go:356] "Generic (PLEG): container finished" podID="793a4f9c-0c8b-4ade-b72d-38db5bd23628" containerID="4c4c5b4a3f75503ba140587f14f88c0f577973249d32eea472123a877bcd056b" exitCode=0
Sep 18 19:45:00.946232 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:00.945812    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l" event={"ID":"793a4f9c-0c8b-4ade-b72d-38db5bd23628","Type":"ContainerDied","Data":"4c4c5b4a3f75503ba140587f14f88c0f577973249d32eea472123a877bcd056b"}
Sep 18 19:45:00.946272 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:00.946246    2583 scope.go:117] "RemoveContainer" containerID="4c4c5b4a3f75503ba140587f14f88c0f577973249d32eea472123a877bcd056b"
Sep 18 19:45:01.726020 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:01.725941    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:01.807635 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:01.807599    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:01.951843 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:01.951815    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55889f7b47-cdh8l" event={"ID":"793a4f9c-0c8b-4ade-b72d-38db5bd23628","Type":"ContainerStarted","Data":"8a105555879d7afcc2dbb2a8813f85db6d6d0de9e2685d98d7378de593eb3081"}
Sep 18 19:45:02.423735 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.423695    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d94c755-6mpmm" podUID="0f3bc1eb-3f59-47af-8721-017b79a0830c" containerName="registry" containerID="cri-o://c8d1726b55ebafb16e55a32f5f1838e1dc3d8bc46d0adccdc1c5a606ea81d27f" gracePeriod=30
Sep 18 19:45:02.662509 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.662487    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:45:02.692469 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.692406    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f3bc1eb-3f59-47af-8721-017b79a0830c-image-registry-private-configuration\") pod \"0f3bc1eb-3f59-47af-8721-017b79a0830c\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") "
Sep 18 19:45:02.692469 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.692454    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-bound-sa-token\") pod \"0f3bc1eb-3f59-47af-8721-017b79a0830c\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") "
Sep 18 19:45:02.692632 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.692480    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-certificates\") pod \"0f3bc1eb-3f59-47af-8721-017b79a0830c\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") "
Sep 18 19:45:02.692632 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.692594    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f3bc1eb-3f59-47af-8721-017b79a0830c-ca-trust-extracted\") pod \"0f3bc1eb-3f59-47af-8721-017b79a0830c\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") "
Sep 18 19:45:02.692757 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.692650    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f3bc1eb-3f59-47af-8721-017b79a0830c-trusted-ca\") pod \"0f3bc1eb-3f59-47af-8721-017b79a0830c\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") "
Sep 18 19:45:02.692757 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.692681    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74v88\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-kube-api-access-74v88\") pod \"0f3bc1eb-3f59-47af-8721-017b79a0830c\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") "
Sep 18 19:45:02.692757 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.692727    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls\") pod \"0f3bc1eb-3f59-47af-8721-017b79a0830c\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") "
Sep 18 19:45:02.692909 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.692778    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f3bc1eb-3f59-47af-8721-017b79a0830c-installation-pull-secrets\") pod \"0f3bc1eb-3f59-47af-8721-017b79a0830c\" (UID: \"0f3bc1eb-3f59-47af-8721-017b79a0830c\") "
Sep 18 19:45:02.692909 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.692798    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0f3bc1eb-3f59-47af-8721-017b79a0830c" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:45:02.693101 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.693071    2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-certificates\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:02.693353 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.693321    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f3bc1eb-3f59-47af-8721-017b79a0830c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0f3bc1eb-3f59-47af-8721-017b79a0830c" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:45:02.695113 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.695069    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f3bc1eb-3f59-47af-8721-017b79a0830c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0f3bc1eb-3f59-47af-8721-017b79a0830c" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:45:02.695387 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.695349    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0f3bc1eb-3f59-47af-8721-017b79a0830c" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:45:02.695387 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.695366    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0f3bc1eb-3f59-47af-8721-017b79a0830c" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:45:02.695569 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.695462    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-kube-api-access-74v88" (OuterVolumeSpecName: "kube-api-access-74v88") pod "0f3bc1eb-3f59-47af-8721-017b79a0830c" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c"). InnerVolumeSpecName "kube-api-access-74v88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:45:02.695631 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.695604    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f3bc1eb-3f59-47af-8721-017b79a0830c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0f3bc1eb-3f59-47af-8721-017b79a0830c" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:45:02.703277 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.703254    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f3bc1eb-3f59-47af-8721-017b79a0830c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0f3bc1eb-3f59-47af-8721-017b79a0830c" (UID: "0f3bc1eb-3f59-47af-8721-017b79a0830c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:45:02.794270 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.794230    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74v88\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-kube-api-access-74v88\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:02.794270 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.794267    2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-registry-tls\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:02.794270 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.794276    2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f3bc1eb-3f59-47af-8721-017b79a0830c-installation-pull-secrets\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:02.794449 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.794285    2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f3bc1eb-3f59-47af-8721-017b79a0830c-image-registry-private-configuration\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:02.794449 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.794294    2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f3bc1eb-3f59-47af-8721-017b79a0830c-bound-sa-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:02.794449 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.794302    2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f3bc1eb-3f59-47af-8721-017b79a0830c-ca-trust-extracted\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:02.794449 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.794309    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f3bc1eb-3f59-47af-8721-017b79a0830c-trusted-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:02.957363 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.957281    2583 generic.go:356] "Generic (PLEG): container finished" podID="0f3bc1eb-3f59-47af-8721-017b79a0830c" containerID="c8d1726b55ebafb16e55a32f5f1838e1dc3d8bc46d0adccdc1c5a606ea81d27f" exitCode=0
Sep 18 19:45:02.957363 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.957327    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d94c755-6mpmm"
Sep 18 19:45:02.957363 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.957331    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d94c755-6mpmm" event={"ID":"0f3bc1eb-3f59-47af-8721-017b79a0830c","Type":"ContainerDied","Data":"c8d1726b55ebafb16e55a32f5f1838e1dc3d8bc46d0adccdc1c5a606ea81d27f"}
Sep 18 19:45:02.957801 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.957377    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d94c755-6mpmm" event={"ID":"0f3bc1eb-3f59-47af-8721-017b79a0830c","Type":"ContainerDied","Data":"2733f088cd276aa24bf722cb4a180903c0f194362a3b440b0e2fc905d52f2777"}
Sep 18 19:45:02.957801 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.957410    2583 scope.go:117] "RemoveContainer" containerID="c8d1726b55ebafb16e55a32f5f1838e1dc3d8bc46d0adccdc1c5a606ea81d27f"
Sep 18 19:45:02.966691 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.966673    2583 scope.go:117] "RemoveContainer" containerID="c8d1726b55ebafb16e55a32f5f1838e1dc3d8bc46d0adccdc1c5a606ea81d27f"
Sep 18 19:45:02.966962 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:45:02.966944    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8d1726b55ebafb16e55a32f5f1838e1dc3d8bc46d0adccdc1c5a606ea81d27f\": container with ID starting with c8d1726b55ebafb16e55a32f5f1838e1dc3d8bc46d0adccdc1c5a606ea81d27f not found: ID does not exist" containerID="c8d1726b55ebafb16e55a32f5f1838e1dc3d8bc46d0adccdc1c5a606ea81d27f"
Sep 18 19:45:02.967031 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.966972    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8d1726b55ebafb16e55a32f5f1838e1dc3d8bc46d0adccdc1c5a606ea81d27f"} err="failed to get container status \"c8d1726b55ebafb16e55a32f5f1838e1dc3d8bc46d0adccdc1c5a606ea81d27f\": rpc error: code = NotFound desc = could not find container \"c8d1726b55ebafb16e55a32f5f1838e1dc3d8bc46d0adccdc1c5a606ea81d27f\": container with ID starting with c8d1726b55ebafb16e55a32f5f1838e1dc3d8bc46d0adccdc1c5a606ea81d27f not found: ID does not exist"
Sep 18 19:45:02.978926 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.978898    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d94c755-6mpmm"]
Sep 18 19:45:02.982795 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:02.982777    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d94c755-6mpmm"]
Sep 18 19:45:03.813237 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:03.811705    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f3bc1eb-3f59-47af-8721-017b79a0830c" path="/var/lib/kubelet/pods/0f3bc1eb-3f59-47af-8721-017b79a0830c/volumes"
Sep 18 19:45:06.007553 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.007501    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79766fb7ff-6bzzw" podUID="02097b6e-30ca-42e5-bfc6-90f1e2657903" containerName="console" containerID="cri-o://907a944a3dac845e4c6a6463ca4dedb2bdd117788e8d6698334077c094d451af" gracePeriod=15
Sep 18 19:45:06.248334 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.248313    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:45:06.325162 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.325100    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-config\") pod \"02097b6e-30ca-42e5-bfc6-90f1e2657903\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") "
Sep 18 19:45:06.325162 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.325137    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-serving-cert\") pod \"02097b6e-30ca-42e5-bfc6-90f1e2657903\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") "
Sep 18 19:45:06.325162 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.325158    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-trusted-ca-bundle\") pod \"02097b6e-30ca-42e5-bfc6-90f1e2657903\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") "
Sep 18 19:45:06.325383 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.325197    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-service-ca\") pod \"02097b6e-30ca-42e5-bfc6-90f1e2657903\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") "
Sep 18 19:45:06.325383 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.325217    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h59k6\" (UniqueName: \"kubernetes.io/projected/02097b6e-30ca-42e5-bfc6-90f1e2657903-kube-api-access-h59k6\") pod \"02097b6e-30ca-42e5-bfc6-90f1e2657903\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") "
Sep 18 19:45:06.325383 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.325239    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-oauth-serving-cert\") pod \"02097b6e-30ca-42e5-bfc6-90f1e2657903\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") "
Sep 18 19:45:06.325383 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.325289    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-oauth-config\") pod \"02097b6e-30ca-42e5-bfc6-90f1e2657903\" (UID: \"02097b6e-30ca-42e5-bfc6-90f1e2657903\") "
Sep 18 19:45:06.325572 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.325480    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-config" (OuterVolumeSpecName: "console-config") pod "02097b6e-30ca-42e5-bfc6-90f1e2657903" (UID: "02097b6e-30ca-42e5-bfc6-90f1e2657903"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:45:06.325717 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.325693    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-service-ca" (OuterVolumeSpecName: "service-ca") pod "02097b6e-30ca-42e5-bfc6-90f1e2657903" (UID: "02097b6e-30ca-42e5-bfc6-90f1e2657903"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:45:06.325772 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.325710    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "02097b6e-30ca-42e5-bfc6-90f1e2657903" (UID: "02097b6e-30ca-42e5-bfc6-90f1e2657903"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:45:06.325871 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.325852    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "02097b6e-30ca-42e5-bfc6-90f1e2657903" (UID: "02097b6e-30ca-42e5-bfc6-90f1e2657903"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:45:06.327595 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.327574    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02097b6e-30ca-42e5-bfc6-90f1e2657903-kube-api-access-h59k6" (OuterVolumeSpecName: "kube-api-access-h59k6") pod "02097b6e-30ca-42e5-bfc6-90f1e2657903" (UID: "02097b6e-30ca-42e5-bfc6-90f1e2657903"). InnerVolumeSpecName "kube-api-access-h59k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:45:06.327595 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.327581    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "02097b6e-30ca-42e5-bfc6-90f1e2657903" (UID: "02097b6e-30ca-42e5-bfc6-90f1e2657903"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:45:06.327727 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.327610    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "02097b6e-30ca-42e5-bfc6-90f1e2657903" (UID: "02097b6e-30ca-42e5-bfc6-90f1e2657903"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:45:06.426024 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.426000    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-trusted-ca-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:06.426024 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.426023    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:06.426174 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.426032    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h59k6\" (UniqueName: \"kubernetes.io/projected/02097b6e-30ca-42e5-bfc6-90f1e2657903-kube-api-access-h59k6\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:06.426174 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.426058    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-oauth-serving-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:06.426174 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.426067    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-oauth-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:06.426174 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.426080    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:06.426174 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.426091    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02097b6e-30ca-42e5-bfc6-90f1e2657903-console-serving-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:45:06.974582 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.974540    2583 generic.go:356] "Generic (PLEG): container finished" podID="02097b6e-30ca-42e5-bfc6-90f1e2657903" containerID="907a944a3dac845e4c6a6463ca4dedb2bdd117788e8d6698334077c094d451af" exitCode=0
Sep 18 19:45:06.974746 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.974589    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79766fb7ff-6bzzw"
Sep 18 19:45:06.974746 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.974633    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79766fb7ff-6bzzw" event={"ID":"02097b6e-30ca-42e5-bfc6-90f1e2657903","Type":"ContainerDied","Data":"907a944a3dac845e4c6a6463ca4dedb2bdd117788e8d6698334077c094d451af"}
Sep 18 19:45:06.974746 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.974688    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79766fb7ff-6bzzw" event={"ID":"02097b6e-30ca-42e5-bfc6-90f1e2657903","Type":"ContainerDied","Data":"f23b01ae1f6aecb962ebb8015f96a9805c2fdf1943b9ab26060e5041653e84ca"}
Sep 18 19:45:06.974746 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.974708    2583 scope.go:117] "RemoveContainer" containerID="907a944a3dac845e4c6a6463ca4dedb2bdd117788e8d6698334077c094d451af"
Sep 18 19:45:06.982886 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.982870    2583 scope.go:117] "RemoveContainer" containerID="907a944a3dac845e4c6a6463ca4dedb2bdd117788e8d6698334077c094d451af"
Sep 18 19:45:06.983175 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:45:06.983153    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"907a944a3dac845e4c6a6463ca4dedb2bdd117788e8d6698334077c094d451af\": container with ID starting with 907a944a3dac845e4c6a6463ca4dedb2bdd117788e8d6698334077c094d451af not found: ID does not exist" containerID="907a944a3dac845e4c6a6463ca4dedb2bdd117788e8d6698334077c094d451af"
Sep 18 19:45:06.983230 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.983186    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"907a944a3dac845e4c6a6463ca4dedb2bdd117788e8d6698334077c094d451af"} err="failed to get container status \"907a944a3dac845e4c6a6463ca4dedb2bdd117788e8d6698334077c094d451af\": rpc error: code = NotFound desc = could not find container \"907a944a3dac845e4c6a6463ca4dedb2bdd117788e8d6698334077c094d451af\": container with ID starting with 907a944a3dac845e4c6a6463ca4dedb2bdd117788e8d6698334077c094d451af not found: ID does not exist"
Sep 18 19:45:06.995302 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:06.995282    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79766fb7ff-6bzzw"]
Sep 18 19:45:07.003393 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:07.003372    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79766fb7ff-6bzzw"]
Sep 18 19:45:07.809880 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:07.809834    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02097b6e-30ca-42e5-bfc6-90f1e2657903" path="/var/lib/kubelet/pods/02097b6e-30ca-42e5-bfc6-90f1e2657903/volumes"
Sep 18 19:45:08.355894 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:08.355864    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:08.458499 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:08.458470    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:08.531175 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:08.531152    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:32.742812 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:32.742776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:45:32.745166 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:32.745141    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4839d65-2531-49a9-b4fb-0a752464b27e-metrics-certs\") pod \"network-metrics-daemon-qqfbz\" (UID: \"f4839d65-2531-49a9-b4fb-0a752464b27e\") " pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:45:33.008679 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:33.008589    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m9tpx\""
Sep 18 19:45:33.016091 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:33.016068    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qqfbz"
Sep 18 19:45:33.300909 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:33.300810    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qqfbz"]
Sep 18 19:45:33.311514 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:45:33.311486    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4839d65_2531_49a9_b4fb_0a752464b27e.slice/crio-d260e7475ddf904290a77beade05a818fe1189af5384d026ca7e258fb750fe83 WatchSource:0}: Error finding container d260e7475ddf904290a77beade05a818fe1189af5384d026ca7e258fb750fe83: Status 404 returned error can't find the container with id d260e7475ddf904290a77beade05a818fe1189af5384d026ca7e258fb750fe83
Sep 18 19:45:34.074262 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:34.074216    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qqfbz" event={"ID":"f4839d65-2531-49a9-b4fb-0a752464b27e","Type":"ContainerStarted","Data":"d260e7475ddf904290a77beade05a818fe1189af5384d026ca7e258fb750fe83"}
Sep 18 19:45:35.080826 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:35.080789    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qqfbz" event={"ID":"f4839d65-2531-49a9-b4fb-0a752464b27e","Type":"ContainerStarted","Data":"0a004387b5b6ad960ae7baa50616193d27627034547d8aad2cc19c980e62877a"}
Sep 18 19:45:35.081256 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:35.080849    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qqfbz" event={"ID":"f4839d65-2531-49a9-b4fb-0a752464b27e","Type":"ContainerStarted","Data":"55fcc7e79bc6cef54e17cab70c63fe0615908de62fa463bf1af536260cb73bc3"}
Sep 18 19:45:35.099215 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:35.099144    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qqfbz" podStartSLOduration=374.874354985 podStartE2EDuration="6m16.099119691s" totalImagesPullingTime="1.224764706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:39:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:45:35.096318276 +0000 UTC m=+377.423412042" watchObservedRunningTime="2026-09-18 19:45:35.099119691 +0000 UTC m=+377.426213456"
Sep 18 19:45:35.189869 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:35.189826    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:35.252389 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:35.252363    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:37.106412 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:37.106382    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:37.207537 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:37.207504    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:40.134447 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:40.134421    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:40.202266 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:40.202238    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:41.782329 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:41.782299    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:41.884144 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:41.884114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:47.929431 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:47.929399    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68c4dfdd56-chnql"]
Sep 18 19:45:47.929794 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:47.929678    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f3bc1eb-3f59-47af-8721-017b79a0830c" containerName="registry"
Sep 18 19:45:47.929794 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:47.929689    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f3bc1eb-3f59-47af-8721-017b79a0830c" containerName="registry"
Sep 18 19:45:47.929794 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:47.929699    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02097b6e-30ca-42e5-bfc6-90f1e2657903" containerName="console"
Sep 18 19:45:47.929794 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:47.929705    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="02097b6e-30ca-42e5-bfc6-90f1e2657903" containerName="console"
Sep 18 19:45:47.929794 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:47.929760    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="02097b6e-30ca-42e5-bfc6-90f1e2657903" containerName="console"
Sep 18 19:45:47.929794 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:47.929767    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f3bc1eb-3f59-47af-8721-017b79a0830c" containerName="registry"
Sep 18 19:45:47.934276 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:47.934260    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:47.946171 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:47.946148    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c4dfdd56-chnql"]
Sep 18 19:45:47.999507 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:47.999481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:48.077763 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.077735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-serving-cert\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.077933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.077777    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-service-ca\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.077933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.077796    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-trusted-ca-bundle\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.077933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.077879    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-oauth-serving-cert\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.078066 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.077935    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-config\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.078066 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.077959    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr9w9\" (UniqueName: \"kubernetes.io/projected/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-kube-api-access-vr9w9\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.078066 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.077973    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-oauth-config\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.098311 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.098285    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:48.178926 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.178895    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-serving-cert\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.179133 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.178941    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-service-ca\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.179133 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.178961    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-trusted-ca-bundle\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.179133 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.179013    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-oauth-serving-cert\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.179133 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.179076    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-config\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.179133 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.179111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr9w9\" (UniqueName: \"kubernetes.io/projected/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-kube-api-access-vr9w9\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.179373 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.179139    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-oauth-config\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.179805 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.179743    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-service-ca\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.179805 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.179775    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-oauth-serving-cert\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.179960 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.179887    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-config\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.180025 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.179978    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-trusted-ca-bundle\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.181424 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.181404    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-serving-cert\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.181540 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.181518    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-oauth-config\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.188654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.188635    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr9w9\" (UniqueName: \"kubernetes.io/projected/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-kube-api-access-vr9w9\") pod \"console-68c4dfdd56-chnql\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") " pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.242638 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.242614    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:48.524650 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:48.524433    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68c4dfdd56-chnql"]
Sep 18 19:45:48.527141 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:45:48.527117    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ccc004_0d6e_44d8_ac73_7b98dd1d201d.slice/crio-7679c6da23183e7f653d77cb15f1a95650d2a4dc9b6be7e362af62331f517c5f WatchSource:0}: Error finding container 7679c6da23183e7f653d77cb15f1a95650d2a4dc9b6be7e362af62331f517c5f: Status 404 returned error can't find the container with id 7679c6da23183e7f653d77cb15f1a95650d2a4dc9b6be7e362af62331f517c5f
Sep 18 19:45:49.138408 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:49.138375    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c4dfdd56-chnql" event={"ID":"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d","Type":"ContainerStarted","Data":"86bdc2106c33d808630334145b497b051f7a065b3a137e40c141c3f4d71b5fa0"}
Sep 18 19:45:49.138760 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:49.138420    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c4dfdd56-chnql" event={"ID":"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d","Type":"ContainerStarted","Data":"7679c6da23183e7f653d77cb15f1a95650d2a4dc9b6be7e362af62331f517c5f"}
Sep 18 19:45:49.158133 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:49.158083    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68c4dfdd56-chnql" podStartSLOduration=2.158065779 podStartE2EDuration="2.158065779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:45:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:45:49.157261587 +0000 UTC m=+391.484355351" watchObservedRunningTime="2026-09-18 19:45:49.158065779 +0000 UTC m=+391.485159543"
Sep 18 19:45:51.367255 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:51.367220    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:52.109055 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:52.108999    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:52.162387 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:52.162354    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:58.243418 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:58.243388    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:58.243849 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:58.243592    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:58.248186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:58.248165    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:59.181216 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:59.181187    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:45:59.228003 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:59.227970    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66b6f7fbf-ztwgr"]
Sep 18 19:45:59.326952 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:59.326916    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:59.384853 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:59.384824    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:45:59.451139 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:45:59.451072    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:01.750247 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:01.750211    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:01.836894 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:01.836864    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:02.673435 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:46:02.673392    2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr" podUID="70f3f4ae-9bcc-4527-b307-6d9b707d7673"
Sep 18 19:46:03.190979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:03.190953    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:46:05.115538 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:05.115503    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:46:05.117846 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:05.117826    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70f3f4ae-9bcc-4527-b307-6d9b707d7673-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-tp4hr\" (UID: \"70f3f4ae-9bcc-4527-b307-6d9b707d7673\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:46:05.294504 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:05.294473    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fznpg\""
Sep 18 19:46:05.302524 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:05.302505    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"
Sep 18 19:46:05.572461 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:05.572388    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr"]
Sep 18 19:46:05.575532 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:46:05.575511    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f3f4ae_9bcc_4527_b307_6d9b707d7673.slice/crio-6d8d6ffcf36f451293e35e5278fb3c1f06e8ad2ca1be0890c456c886a2583474 WatchSource:0}: Error finding container 6d8d6ffcf36f451293e35e5278fb3c1f06e8ad2ca1be0890c456c886a2583474: Status 404 returned error can't find the container with id 6d8d6ffcf36f451293e35e5278fb3c1f06e8ad2ca1be0890c456c886a2583474
Sep 18 19:46:06.203287 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:06.203247    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr" event={"ID":"70f3f4ae-9bcc-4527-b307-6d9b707d7673","Type":"ContainerStarted","Data":"6d8d6ffcf36f451293e35e5278fb3c1f06e8ad2ca1be0890c456c886a2583474"}
Sep 18 19:46:07.208890 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:07.208847    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr" event={"ID":"70f3f4ae-9bcc-4527-b307-6d9b707d7673","Type":"ContainerStarted","Data":"99c92c437ca413d38c173bb39af14b3e6302b9575c8e1ae44d1dce6c4721fbab"}
Sep 18 19:46:07.225653 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:07.225608    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-tp4hr" podStartSLOduration=406.121581938 podStartE2EDuration="6m47.225593951s" totalImagesPullingTime="1.104012013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:46:07.224437362 +0000 UTC m=+409.551531125" watchObservedRunningTime="2026-09-18 19:46:07.225593951 +0000 UTC m=+409.552687715"
Sep 18 19:46:07.325476 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:07.325445    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:07.379485 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:07.379455    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:17.437159 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:17.437127    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:17.542699 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:17.542669    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:18.763305 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:18.763265    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:18.904367 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:18.904332    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"]
Sep 18 19:46:18.908933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:18.908911    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"
Sep 18 19:46:18.913332 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:18.913309    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r2tvv\""
Sep 18 19:46:18.913426 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:18.913340    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 19:46:18.914785 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:18.914764    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 19:46:18.920251 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:18.920230    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"]
Sep 18 19:46:19.025675 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:19.025609    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d76af6d-2d21-4ff7-b2c0-84108235751c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9\" (UID: \"5d76af6d-2d21-4ff7-b2c0-84108235751c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"
Sep 18 19:46:19.025675 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:19.025655    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d76af6d-2d21-4ff7-b2c0-84108235751c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9\" (UID: \"5d76af6d-2d21-4ff7-b2c0-84108235751c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"
Sep 18 19:46:19.025850 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:19.025710    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6p4q\" (UniqueName: \"kubernetes.io/projected/5d76af6d-2d21-4ff7-b2c0-84108235751c-kube-api-access-f6p4q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9\" (UID: \"5d76af6d-2d21-4ff7-b2c0-84108235751c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"
Sep 18 19:46:19.127077 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:19.127025    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d76af6d-2d21-4ff7-b2c0-84108235751c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9\" (UID: \"5d76af6d-2d21-4ff7-b2c0-84108235751c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"
Sep 18 19:46:19.127223 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:19.127108    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d76af6d-2d21-4ff7-b2c0-84108235751c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9\" (UID: \"5d76af6d-2d21-4ff7-b2c0-84108235751c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"
Sep 18 19:46:19.127223 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:19.127130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6p4q\" (UniqueName: \"kubernetes.io/projected/5d76af6d-2d21-4ff7-b2c0-84108235751c-kube-api-access-f6p4q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9\" (UID: \"5d76af6d-2d21-4ff7-b2c0-84108235751c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"
Sep 18 19:46:19.127387 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:19.127370    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d76af6d-2d21-4ff7-b2c0-84108235751c-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9\" (UID: \"5d76af6d-2d21-4ff7-b2c0-84108235751c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"
Sep 18 19:46:19.127482 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:19.127463    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d76af6d-2d21-4ff7-b2c0-84108235751c-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9\" (UID: \"5d76af6d-2d21-4ff7-b2c0-84108235751c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"
Sep 18 19:46:19.136365 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:19.136338    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6p4q\" (UniqueName: \"kubernetes.io/projected/5d76af6d-2d21-4ff7-b2c0-84108235751c-kube-api-access-f6p4q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9\" (UID: \"5d76af6d-2d21-4ff7-b2c0-84108235751c\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"
Sep 18 19:46:19.217960 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:19.217939    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"
Sep 18 19:46:19.486862 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:19.486829    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"]
Sep 18 19:46:19.489990 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:46:19.489966    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d76af6d_2d21_4ff7_b2c0_84108235751c.slice/crio-1cc028215eaf15eebc93111e36be1544c023f9bfef9b55128525b518867376e4 WatchSource:0}: Error finding container 1cc028215eaf15eebc93111e36be1544c023f9bfef9b55128525b518867376e4: Status 404 returned error can't find the container with id 1cc028215eaf15eebc93111e36be1544c023f9bfef9b55128525b518867376e4
Sep 18 19:46:20.257084 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:20.257030    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9" event={"ID":"5d76af6d-2d21-4ff7-b2c0-84108235751c","Type":"ContainerStarted","Data":"1cc028215eaf15eebc93111e36be1544c023f9bfef9b55128525b518867376e4"}
Sep 18 19:46:24.249102 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:24.249063    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66b6f7fbf-ztwgr" podUID="a53b6e72-2490-42af-81f2-412bf4373898" containerName="console" containerID="cri-o://2d6acd6ee7fb29770e37422510b4df5edd2bf650c5087d08a3433a15a20ccc11" gracePeriod=15
Sep 18 19:46:24.966907 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:24.966885    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:46:25.075681 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.075621    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-trusted-ca-bundle\") pod \"a53b6e72-2490-42af-81f2-412bf4373898\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") "
Sep 18 19:46:25.075681 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.075667    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53b6e72-2490-42af-81f2-412bf4373898-console-serving-cert\") pod \"a53b6e72-2490-42af-81f2-412bf4373898\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") "
Sep 18 19:46:25.075681 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.075683    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-console-config\") pod \"a53b6e72-2490-42af-81f2-412bf4373898\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") "
Sep 18 19:46:25.075892 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.075702    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-service-ca\") pod \"a53b6e72-2490-42af-81f2-412bf4373898\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") "
Sep 18 19:46:25.075892 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.075747    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdjxq\" (UniqueName: \"kubernetes.io/projected/a53b6e72-2490-42af-81f2-412bf4373898-kube-api-access-xdjxq\") pod \"a53b6e72-2490-42af-81f2-412bf4373898\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") "
Sep 18 19:46:25.075892 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.075798    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53b6e72-2490-42af-81f2-412bf4373898-console-oauth-config\") pod \"a53b6e72-2490-42af-81f2-412bf4373898\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") "
Sep 18 19:46:25.075892 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.075822    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-oauth-serving-cert\") pod \"a53b6e72-2490-42af-81f2-412bf4373898\" (UID: \"a53b6e72-2490-42af-81f2-412bf4373898\") "
Sep 18 19:46:25.076116 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.076093    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a53b6e72-2490-42af-81f2-412bf4373898" (UID: "a53b6e72-2490-42af-81f2-412bf4373898"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:46:25.076273 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.076242    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-console-config" (OuterVolumeSpecName: "console-config") pod "a53b6e72-2490-42af-81f2-412bf4373898" (UID: "a53b6e72-2490-42af-81f2-412bf4373898"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:46:25.076388 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.076358    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-service-ca" (OuterVolumeSpecName: "service-ca") pod "a53b6e72-2490-42af-81f2-412bf4373898" (UID: "a53b6e72-2490-42af-81f2-412bf4373898"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:46:25.076388 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.076373    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a53b6e72-2490-42af-81f2-412bf4373898" (UID: "a53b6e72-2490-42af-81f2-412bf4373898"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:46:25.077724 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.077700    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a53b6e72-2490-42af-81f2-412bf4373898-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a53b6e72-2490-42af-81f2-412bf4373898" (UID: "a53b6e72-2490-42af-81f2-412bf4373898"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:46:25.077819 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.077796    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a53b6e72-2490-42af-81f2-412bf4373898-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a53b6e72-2490-42af-81f2-412bf4373898" (UID: "a53b6e72-2490-42af-81f2-412bf4373898"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:46:25.077877 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.077812    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a53b6e72-2490-42af-81f2-412bf4373898-kube-api-access-xdjxq" (OuterVolumeSpecName: "kube-api-access-xdjxq") pod "a53b6e72-2490-42af-81f2-412bf4373898" (UID: "a53b6e72-2490-42af-81f2-412bf4373898"). InnerVolumeSpecName "kube-api-access-xdjxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:46:25.177189 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.177162    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdjxq\" (UniqueName: \"kubernetes.io/projected/a53b6e72-2490-42af-81f2-412bf4373898-kube-api-access-xdjxq\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:46:25.177189 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.177185    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a53b6e72-2490-42af-81f2-412bf4373898-console-oauth-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:46:25.177189 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.177194    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-oauth-serving-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:46:25.177359 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.177202    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-trusted-ca-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:46:25.177359 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.177210    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a53b6e72-2490-42af-81f2-412bf4373898-console-serving-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:46:25.177359 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.177219    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-console-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:46:25.177359 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.177227    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a53b6e72-2490-42af-81f2-412bf4373898-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:46:25.281530 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.281504    2583 generic.go:356] "Generic (PLEG): container finished" podID="a53b6e72-2490-42af-81f2-412bf4373898" containerID="2d6acd6ee7fb29770e37422510b4df5edd2bf650c5087d08a3433a15a20ccc11" exitCode=0
Sep 18 19:46:25.281960 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.281548    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66b6f7fbf-ztwgr"
Sep 18 19:46:25.281960 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.281593    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b6f7fbf-ztwgr" event={"ID":"a53b6e72-2490-42af-81f2-412bf4373898","Type":"ContainerDied","Data":"2d6acd6ee7fb29770e37422510b4df5edd2bf650c5087d08a3433a15a20ccc11"}
Sep 18 19:46:25.281960 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.281686    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66b6f7fbf-ztwgr" event={"ID":"a53b6e72-2490-42af-81f2-412bf4373898","Type":"ContainerDied","Data":"0dc9ded2c172ba0cf1c78fc3510606236677b4353016a45a398bbb8d34203e36"}
Sep 18 19:46:25.281960 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.281715    2583 scope.go:117] "RemoveContainer" containerID="2d6acd6ee7fb29770e37422510b4df5edd2bf650c5087d08a3433a15a20ccc11"
Sep 18 19:46:25.283412 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.283388    2583 generic.go:356] "Generic (PLEG): container finished" podID="5d76af6d-2d21-4ff7-b2c0-84108235751c" containerID="f2559c12c2ab822f773097bea10363e1a0479f8894200d5cab1da9eae3afbd7a" exitCode=0
Sep 18 19:46:25.283513 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.283468    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9" event={"ID":"5d76af6d-2d21-4ff7-b2c0-84108235751c","Type":"ContainerDied","Data":"f2559c12c2ab822f773097bea10363e1a0479f8894200d5cab1da9eae3afbd7a"}
Sep 18 19:46:25.290732 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.290715    2583 scope.go:117] "RemoveContainer" containerID="2d6acd6ee7fb29770e37422510b4df5edd2bf650c5087d08a3433a15a20ccc11"
Sep 18 19:46:25.290974 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:46:25.290957    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d6acd6ee7fb29770e37422510b4df5edd2bf650c5087d08a3433a15a20ccc11\": container with ID starting with 2d6acd6ee7fb29770e37422510b4df5edd2bf650c5087d08a3433a15a20ccc11 not found: ID does not exist" containerID="2d6acd6ee7fb29770e37422510b4df5edd2bf650c5087d08a3433a15a20ccc11"
Sep 18 19:46:25.291022 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.290982    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d6acd6ee7fb29770e37422510b4df5edd2bf650c5087d08a3433a15a20ccc11"} err="failed to get container status \"2d6acd6ee7fb29770e37422510b4df5edd2bf650c5087d08a3433a15a20ccc11\": rpc error: code = NotFound desc = could not find container \"2d6acd6ee7fb29770e37422510b4df5edd2bf650c5087d08a3433a15a20ccc11\": container with ID starting with 2d6acd6ee7fb29770e37422510b4df5edd2bf650c5087d08a3433a15a20ccc11 not found: ID does not exist"
Sep 18 19:46:25.315117 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.315094    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66b6f7fbf-ztwgr"]
Sep 18 19:46:25.319272 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.319250    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66b6f7fbf-ztwgr"]
Sep 18 19:46:25.810068 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:25.810028    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a53b6e72-2490-42af-81f2-412bf4373898" path="/var/lib/kubelet/pods/a53b6e72-2490-42af-81f2-412bf4373898/volumes"
Sep 18 19:46:28.300424 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:28.300386    2583 generic.go:356] "Generic (PLEG): container finished" podID="5d76af6d-2d21-4ff7-b2c0-84108235751c" containerID="b05f3f2c723e95a0f1d4bcc06eff724ba665ce21ee80d94cab0b151077ad432e" exitCode=0
Sep 18 19:46:28.300862 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:28.300435    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9" event={"ID":"5d76af6d-2d21-4ff7-b2c0-84108235751c","Type":"ContainerDied","Data":"b05f3f2c723e95a0f1d4bcc06eff724ba665ce21ee80d94cab0b151077ad432e"}
Sep 18 19:46:36.334723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:36.334690    2583 generic.go:356] "Generic (PLEG): container finished" podID="5d76af6d-2d21-4ff7-b2c0-84108235751c" containerID="689109c4ddc15a2bda2f78eb5edd99e85875da15cbff5a293982906dbe908574" exitCode=0
Sep 18 19:46:36.335134 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:36.334734    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9" event={"ID":"5d76af6d-2d21-4ff7-b2c0-84108235751c","Type":"ContainerDied","Data":"689109c4ddc15a2bda2f78eb5edd99e85875da15cbff5a293982906dbe908574"}
Sep 18 19:46:37.465032 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:37.465010    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"
Sep 18 19:46:37.583243 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:37.583214    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6p4q\" (UniqueName: \"kubernetes.io/projected/5d76af6d-2d21-4ff7-b2c0-84108235751c-kube-api-access-f6p4q\") pod \"5d76af6d-2d21-4ff7-b2c0-84108235751c\" (UID: \"5d76af6d-2d21-4ff7-b2c0-84108235751c\") "
Sep 18 19:46:37.583416 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:37.583275    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d76af6d-2d21-4ff7-b2c0-84108235751c-util\") pod \"5d76af6d-2d21-4ff7-b2c0-84108235751c\" (UID: \"5d76af6d-2d21-4ff7-b2c0-84108235751c\") "
Sep 18 19:46:37.583416 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:37.583305    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d76af6d-2d21-4ff7-b2c0-84108235751c-bundle\") pod \"5d76af6d-2d21-4ff7-b2c0-84108235751c\" (UID: \"5d76af6d-2d21-4ff7-b2c0-84108235751c\") "
Sep 18 19:46:37.583970 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:37.583942    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d76af6d-2d21-4ff7-b2c0-84108235751c-bundle" (OuterVolumeSpecName: "bundle") pod "5d76af6d-2d21-4ff7-b2c0-84108235751c" (UID: "5d76af6d-2d21-4ff7-b2c0-84108235751c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:46:37.585380 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:37.585358    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d76af6d-2d21-4ff7-b2c0-84108235751c-kube-api-access-f6p4q" (OuterVolumeSpecName: "kube-api-access-f6p4q") pod "5d76af6d-2d21-4ff7-b2c0-84108235751c" (UID: "5d76af6d-2d21-4ff7-b2c0-84108235751c"). InnerVolumeSpecName "kube-api-access-f6p4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:46:37.588450 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:37.588425    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d76af6d-2d21-4ff7-b2c0-84108235751c-util" (OuterVolumeSpecName: "util") pod "5d76af6d-2d21-4ff7-b2c0-84108235751c" (UID: "5d76af6d-2d21-4ff7-b2c0-84108235751c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:46:37.684033 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:37.684004    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d76af6d-2d21-4ff7-b2c0-84108235751c-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:46:37.684033 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:37.684028    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6p4q\" (UniqueName: \"kubernetes.io/projected/5d76af6d-2d21-4ff7-b2c0-84108235751c-kube-api-access-f6p4q\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:46:37.684033 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:37.684054    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d76af6d-2d21-4ff7-b2c0-84108235751c-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:46:38.344326 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:38.344296    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9" event={"ID":"5d76af6d-2d21-4ff7-b2c0-84108235751c","Type":"ContainerDied","Data":"1cc028215eaf15eebc93111e36be1544c023f9bfef9b55128525b518867376e4"}
Sep 18 19:46:38.344537 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:38.344349    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1cc028215eaf15eebc93111e36be1544c023f9bfef9b55128525b518867376e4"
Sep 18 19:46:38.344537 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:38.344300    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gdrx9"
Sep 18 19:46:39.888920 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:39.888888    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:40.683349 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:40.683319    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:41.847394 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.847365    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-76vs9"]
Sep 18 19:46:41.847782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.847637    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d76af6d-2d21-4ff7-b2c0-84108235751c" containerName="extract"
Sep 18 19:46:41.847782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.847648    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d76af6d-2d21-4ff7-b2c0-84108235751c" containerName="extract"
Sep 18 19:46:41.847782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.847657    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d76af6d-2d21-4ff7-b2c0-84108235751c" containerName="util"
Sep 18 19:46:41.847782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.847662    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d76af6d-2d21-4ff7-b2c0-84108235751c" containerName="util"
Sep 18 19:46:41.847782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.847680    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d76af6d-2d21-4ff7-b2c0-84108235751c" containerName="pull"
Sep 18 19:46:41.847782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.847685    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d76af6d-2d21-4ff7-b2c0-84108235751c" containerName="pull"
Sep 18 19:46:41.847782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.847691    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a53b6e72-2490-42af-81f2-412bf4373898" containerName="console"
Sep 18 19:46:41.847782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.847696    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a53b6e72-2490-42af-81f2-412bf4373898" containerName="console"
Sep 18 19:46:41.847782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.847741    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d76af6d-2d21-4ff7-b2c0-84108235751c" containerName="extract"
Sep 18 19:46:41.847782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.847754    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a53b6e72-2490-42af-81f2-412bf4373898" containerName="console"
Sep 18 19:46:41.879895 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.879867    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-76vs9"]
Sep 18 19:46:41.880057 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.879954    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-76vs9"
Sep 18 19:46:41.882364 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.882342    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 18 19:46:41.882470 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.882384    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-w8km4\""
Sep 18 19:46:41.882470 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:41.882397    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 18 19:46:42.015866 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:42.015833    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwrt6\" (UniqueName: \"kubernetes.io/projected/ba1a14ff-ab82-466f-a8c6-83aac3013b14-kube-api-access-jwrt6\") pod \"cert-manager-operator-controller-manager-55c444bf86-76vs9\" (UID: \"ba1a14ff-ab82-466f-a8c6-83aac3013b14\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-76vs9"
Sep 18 19:46:42.016031 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:42.015884    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba1a14ff-ab82-466f-a8c6-83aac3013b14-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-76vs9\" (UID: \"ba1a14ff-ab82-466f-a8c6-83aac3013b14\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-76vs9"
Sep 18 19:46:42.117057 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:42.116958    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwrt6\" (UniqueName: \"kubernetes.io/projected/ba1a14ff-ab82-466f-a8c6-83aac3013b14-kube-api-access-jwrt6\") pod \"cert-manager-operator-controller-manager-55c444bf86-76vs9\" (UID: \"ba1a14ff-ab82-466f-a8c6-83aac3013b14\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-76vs9"
Sep 18 19:46:42.117057 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:42.117017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba1a14ff-ab82-466f-a8c6-83aac3013b14-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-76vs9\" (UID: \"ba1a14ff-ab82-466f-a8c6-83aac3013b14\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-76vs9"
Sep 18 19:46:42.117365 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:42.117343    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ba1a14ff-ab82-466f-a8c6-83aac3013b14-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-76vs9\" (UID: \"ba1a14ff-ab82-466f-a8c6-83aac3013b14\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-76vs9"
Sep 18 19:46:42.124686 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:42.124665    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwrt6\" (UniqueName: \"kubernetes.io/projected/ba1a14ff-ab82-466f-a8c6-83aac3013b14-kube-api-access-jwrt6\") pod \"cert-manager-operator-controller-manager-55c444bf86-76vs9\" (UID: \"ba1a14ff-ab82-466f-a8c6-83aac3013b14\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-76vs9"
Sep 18 19:46:42.189094 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:42.189059    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-76vs9"
Sep 18 19:46:42.484246 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:42.484225    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-76vs9"]
Sep 18 19:46:42.486067 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:46:42.486029    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba1a14ff_ab82_466f_a8c6_83aac3013b14.slice/crio-1ab51cc237d2411ca612836ba6b2319275f2a1fece17d7f84d806187e4f4dae5 WatchSource:0}: Error finding container 1ab51cc237d2411ca612836ba6b2319275f2a1fece17d7f84d806187e4f4dae5: Status 404 returned error can't find the container with id 1ab51cc237d2411ca612836ba6b2319275f2a1fece17d7f84d806187e4f4dae5
Sep 18 19:46:43.364950 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:43.364894    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-76vs9" event={"ID":"ba1a14ff-ab82-466f-a8c6-83aac3013b14","Type":"ContainerStarted","Data":"1ab51cc237d2411ca612836ba6b2319275f2a1fece17d7f84d806187e4f4dae5"}
Sep 18 19:46:43.538766 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:43.538733    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:43.642412 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:43.642346    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:44.373233 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:44.373197    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-76vs9" event={"ID":"ba1a14ff-ab82-466f-a8c6-83aac3013b14","Type":"ContainerStarted","Data":"2c70983c439551defbb944d8fb7f3c6bb1386f4f1a510bc8cd6bacb73d90a71a"}
Sep 18 19:46:44.398207 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:44.398163    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-76vs9" podStartSLOduration=1.855400446 podStartE2EDuration="3.398147626s" totalImagesPullingTime="1.54274718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:46:44.397880045 +0000 UTC m=+446.724973823" watchObservedRunningTime="2026-09-18 19:46:44.398147626 +0000 UTC m=+446.725241389"
Sep 18 19:46:44.810288 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:44.810193    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:44.922212 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:44.922176    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:45.525026 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.524990    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"]
Sep 18 19:46:45.529185 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.529157    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"
Sep 18 19:46:45.531752 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.531732    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r2tvv\""
Sep 18 19:46:45.531845 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.531759    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 19:46:45.532552 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.532539    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 19:46:45.535160 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.535139    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"]
Sep 18 19:46:45.645825 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.645792    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdvqw\" (UniqueName: \"kubernetes.io/projected/5a039a09-27de-42b4-a528-2bd25a63d958-kube-api-access-jdvqw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk\" (UID: \"5a039a09-27de-42b4-a528-2bd25a63d958\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"
Sep 18 19:46:45.645825 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.645826    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a039a09-27de-42b4-a528-2bd25a63d958-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk\" (UID: \"5a039a09-27de-42b4-a528-2bd25a63d958\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"
Sep 18 19:46:45.646134 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.645868    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a039a09-27de-42b4-a528-2bd25a63d958-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk\" (UID: \"5a039a09-27de-42b4-a528-2bd25a63d958\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"
Sep 18 19:46:45.691292 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.691261    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:45.747109 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.747079    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdvqw\" (UniqueName: \"kubernetes.io/projected/5a039a09-27de-42b4-a528-2bd25a63d958-kube-api-access-jdvqw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk\" (UID: \"5a039a09-27de-42b4-a528-2bd25a63d958\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"
Sep 18 19:46:45.747269 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.747112    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a039a09-27de-42b4-a528-2bd25a63d958-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk\" (UID: \"5a039a09-27de-42b4-a528-2bd25a63d958\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"
Sep 18 19:46:45.747269 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.747172    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a039a09-27de-42b4-a528-2bd25a63d958-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk\" (UID: \"5a039a09-27de-42b4-a528-2bd25a63d958\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"
Sep 18 19:46:45.747515 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.747496    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a039a09-27de-42b4-a528-2bd25a63d958-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk\" (UID: \"5a039a09-27de-42b4-a528-2bd25a63d958\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"
Sep 18 19:46:45.747551 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.747526    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a039a09-27de-42b4-a528-2bd25a63d958-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk\" (UID: \"5a039a09-27de-42b4-a528-2bd25a63d958\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"
Sep 18 19:46:45.755525 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.755499    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdvqw\" (UniqueName: \"kubernetes.io/projected/5a039a09-27de-42b4-a528-2bd25a63d958-kube-api-access-jdvqw\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk\" (UID: \"5a039a09-27de-42b4-a528-2bd25a63d958\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"
Sep 18 19:46:45.796424 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.796350    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:45.839015 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:45.838990    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"
Sep 18 19:46:46.118080 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:46.118059    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"]
Sep 18 19:46:46.120090 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:46:46.120064    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a039a09_27de_42b4_a528_2bd25a63d958.slice/crio-63e46f7fd759324a5f4190854c50b973cc17c79f26bc10cc8ff9424727754917 WatchSource:0}: Error finding container 63e46f7fd759324a5f4190854c50b973cc17c79f26bc10cc8ff9424727754917: Status 404 returned error can't find the container with id 63e46f7fd759324a5f4190854c50b973cc17c79f26bc10cc8ff9424727754917
Sep 18 19:46:46.382657 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:46.382582    2583 generic.go:356] "Generic (PLEG): container finished" podID="5a039a09-27de-42b4-a528-2bd25a63d958" containerID="5eb4c1e3104c65b616c206a04da0e810d8452148a261e494da330a5634d6759b" exitCode=0
Sep 18 19:46:46.382784 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:46.382670    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk" event={"ID":"5a039a09-27de-42b4-a528-2bd25a63d958","Type":"ContainerDied","Data":"5eb4c1e3104c65b616c206a04da0e810d8452148a261e494da330a5634d6759b"}
Sep 18 19:46:46.382784 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:46.382720    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk" event={"ID":"5a039a09-27de-42b4-a528-2bd25a63d958","Type":"ContainerStarted","Data":"63e46f7fd759324a5f4190854c50b973cc17c79f26bc10cc8ff9424727754917"}
Sep 18 19:46:47.699824 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:47.699772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:48.112599 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.112569    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:48.387881 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.387815    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b8xrw"]
Sep 18 19:46:48.389916 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.389889    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b8xrw"
Sep 18 19:46:48.393533 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.393511    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 18 19:46:48.393636 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.393560    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 18 19:46:48.393711 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.393653    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-r7hsx\""
Sep 18 19:46:48.403938 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.403918    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b8xrw"]
Sep 18 19:46:48.470602 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.470577    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghpcm\" (UniqueName: \"kubernetes.io/projected/13eaf5a8-83ed-4d35-a0b0-a3511ec9436d-kube-api-access-ghpcm\") pod \"cert-manager-cainjector-559cdd8c87-b8xrw\" (UID: \"13eaf5a8-83ed-4d35-a0b0-a3511ec9436d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b8xrw"
Sep 18 19:46:48.470694 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.470633    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13eaf5a8-83ed-4d35-a0b0-a3511ec9436d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b8xrw\" (UID: \"13eaf5a8-83ed-4d35-a0b0-a3511ec9436d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b8xrw"
Sep 18 19:46:48.571831 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.571804    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13eaf5a8-83ed-4d35-a0b0-a3511ec9436d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b8xrw\" (UID: \"13eaf5a8-83ed-4d35-a0b0-a3511ec9436d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b8xrw"
Sep 18 19:46:48.571948 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.571870    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghpcm\" (UniqueName: \"kubernetes.io/projected/13eaf5a8-83ed-4d35-a0b0-a3511ec9436d-kube-api-access-ghpcm\") pod \"cert-manager-cainjector-559cdd8c87-b8xrw\" (UID: \"13eaf5a8-83ed-4d35-a0b0-a3511ec9436d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b8xrw"
Sep 18 19:46:48.580789 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.580765    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13eaf5a8-83ed-4d35-a0b0-a3511ec9436d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-b8xrw\" (UID: \"13eaf5a8-83ed-4d35-a0b0-a3511ec9436d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b8xrw"
Sep 18 19:46:48.580981 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.580962    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghpcm\" (UniqueName: \"kubernetes.io/projected/13eaf5a8-83ed-4d35-a0b0-a3511ec9436d-kube-api-access-ghpcm\") pod \"cert-manager-cainjector-559cdd8c87-b8xrw\" (UID: \"13eaf5a8-83ed-4d35-a0b0-a3511ec9436d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-b8xrw"
Sep 18 19:46:48.706638 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.706574    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b8xrw"
Sep 18 19:46:48.977372 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:48.977352    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-b8xrw"]
Sep 18 19:46:48.979577 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:46:48.979548    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13eaf5a8_83ed_4d35_a0b0_a3511ec9436d.slice/crio-6222991f9d2d2db79cb50634be6852db99b0c124b5c9219c8306588120845412 WatchSource:0}: Error finding container 6222991f9d2d2db79cb50634be6852db99b0c124b5c9219c8306588120845412: Status 404 returned error can't find the container with id 6222991f9d2d2db79cb50634be6852db99b0c124b5c9219c8306588120845412
Sep 18 19:46:49.399966 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:49.399929    2583 generic.go:356] "Generic (PLEG): container finished" podID="5a039a09-27de-42b4-a528-2bd25a63d958" containerID="8574496375e4ee901fe6759c409aaa3e9668d7985be2af91ccb0d5973136956e" exitCode=0
Sep 18 19:46:49.400177 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:49.400016    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk" event={"ID":"5a039a09-27de-42b4-a528-2bd25a63d958","Type":"ContainerDied","Data":"8574496375e4ee901fe6759c409aaa3e9668d7985be2af91ccb0d5973136956e"}
Sep 18 19:46:49.401453 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:49.401430    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b8xrw" event={"ID":"13eaf5a8-83ed-4d35-a0b0-a3511ec9436d","Type":"ContainerStarted","Data":"6222991f9d2d2db79cb50634be6852db99b0c124b5c9219c8306588120845412"}
Sep 18 19:46:50.093816 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:50.093778    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:50.193807 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:50.193774    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:50.408493 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:50.408411    2583 generic.go:356] "Generic (PLEG): container finished" podID="5a039a09-27de-42b4-a528-2bd25a63d958" containerID="25c8b2bbeb7a261af744a2a891d1417359164d571c97d02daf2b2030aa462a16" exitCode=0
Sep 18 19:46:50.408665 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:50.408498    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk" event={"ID":"5a039a09-27de-42b4-a528-2bd25a63d958","Type":"ContainerDied","Data":"25c8b2bbeb7a261af744a2a891d1417359164d571c97d02daf2b2030aa462a16"}
Sep 18 19:46:51.583197 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:51.583175    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"
Sep 18 19:46:51.691514 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:51.691456    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:51.697503 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:51.697482    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdvqw\" (UniqueName: \"kubernetes.io/projected/5a039a09-27de-42b4-a528-2bd25a63d958-kube-api-access-jdvqw\") pod \"5a039a09-27de-42b4-a528-2bd25a63d958\" (UID: \"5a039a09-27de-42b4-a528-2bd25a63d958\") "
Sep 18 19:46:51.697611 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:51.697534    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a039a09-27de-42b4-a528-2bd25a63d958-bundle\") pod \"5a039a09-27de-42b4-a528-2bd25a63d958\" (UID: \"5a039a09-27de-42b4-a528-2bd25a63d958\") "
Sep 18 19:46:51.697611 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:51.697563    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a039a09-27de-42b4-a528-2bd25a63d958-util\") pod \"5a039a09-27de-42b4-a528-2bd25a63d958\" (UID: \"5a039a09-27de-42b4-a528-2bd25a63d958\") "
Sep 18 19:46:51.697895 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:51.697875    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a039a09-27de-42b4-a528-2bd25a63d958-bundle" (OuterVolumeSpecName: "bundle") pod "5a039a09-27de-42b4-a528-2bd25a63d958" (UID: "5a039a09-27de-42b4-a528-2bd25a63d958"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:46:51.699531 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:51.699509    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a039a09-27de-42b4-a528-2bd25a63d958-kube-api-access-jdvqw" (OuterVolumeSpecName: "kube-api-access-jdvqw") pod "5a039a09-27de-42b4-a528-2bd25a63d958" (UID: "5a039a09-27de-42b4-a528-2bd25a63d958"). InnerVolumeSpecName "kube-api-access-jdvqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:46:51.738834 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:51.738803    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a039a09-27de-42b4-a528-2bd25a63d958-util" (OuterVolumeSpecName: "util") pod "5a039a09-27de-42b4-a528-2bd25a63d958" (UID: "5a039a09-27de-42b4-a528-2bd25a63d958"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:46:51.757154 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:51.757122    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:51.798933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:51.798904    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdvqw\" (UniqueName: \"kubernetes.io/projected/5a039a09-27de-42b4-a528-2bd25a63d958-kube-api-access-jdvqw\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:46:51.798933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:51.798931    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5a039a09-27de-42b4-a528-2bd25a63d958-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:46:51.799102 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:51.798941    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5a039a09-27de-42b4-a528-2bd25a63d958-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:46:52.419737 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:52.419710    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk"
Sep 18 19:46:52.419737 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:52.419725    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f56zpk" event={"ID":"5a039a09-27de-42b4-a528-2bd25a63d958","Type":"ContainerDied","Data":"63e46f7fd759324a5f4190854c50b973cc17c79f26bc10cc8ff9424727754917"}
Sep 18 19:46:52.419937 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:52.419777    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63e46f7fd759324a5f4190854c50b973cc17c79f26bc10cc8ff9424727754917"
Sep 18 19:46:52.423661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:52.423631    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b8xrw" event={"ID":"13eaf5a8-83ed-4d35-a0b0-a3511ec9436d","Type":"ContainerStarted","Data":"d5e0aa45ab3184965ab71a4eaa4e250e01429372796c3c8aae21657e72ca20ea"}
Sep 18 19:46:52.442492 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:52.442446    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-b8xrw" podStartSLOduration=1.823600899 podStartE2EDuration="4.442431826s" totalImagesPullingTime="2.618830927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:46:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:46:52.441173069 +0000 UTC m=+454.768266832" watchObservedRunningTime="2026-09-18 19:46:52.442431826 +0000 UTC m=+454.769525589"
Sep 18 19:46:53.990711 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:53.990682    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wc57v"]
Sep 18 19:46:53.991087 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:53.990962    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a039a09-27de-42b4-a528-2bd25a63d958" containerName="extract"
Sep 18 19:46:53.991087 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:53.990973    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a039a09-27de-42b4-a528-2bd25a63d958" containerName="extract"
Sep 18 19:46:53.991087 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:53.990986    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a039a09-27de-42b4-a528-2bd25a63d958" containerName="util"
Sep 18 19:46:53.991087 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:53.990991    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a039a09-27de-42b4-a528-2bd25a63d958" containerName="util"
Sep 18 19:46:53.991087 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:53.991002    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a039a09-27de-42b4-a528-2bd25a63d958" containerName="pull"
Sep 18 19:46:53.991087 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:53.991008    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a039a09-27de-42b4-a528-2bd25a63d958" containerName="pull"
Sep 18 19:46:53.991087 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:53.991070    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a039a09-27de-42b4-a528-2bd25a63d958" containerName="extract"
Sep 18 19:46:53.993665 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:53.993647    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wc57v"
Sep 18 19:46:53.996778 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:53.996758    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-8hvfb\""
Sep 18 19:46:54.003804 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:54.003785    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wc57v"]
Sep 18 19:46:54.116928 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:54.116896    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d7e01e9-b8f9-4f3a-9267-ca0df49dba78-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wc57v\" (UID: \"6d7e01e9-b8f9-4f3a-9267-ca0df49dba78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wc57v"
Sep 18 19:46:54.116928 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:54.116932    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2btw\" (UniqueName: \"kubernetes.io/projected/6d7e01e9-b8f9-4f3a-9267-ca0df49dba78-kube-api-access-t2btw\") pod \"cert-manager-webhook-6486ffd997-wc57v\" (UID: \"6d7e01e9-b8f9-4f3a-9267-ca0df49dba78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wc57v"
Sep 18 19:46:54.217809 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:54.217773    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2btw\" (UniqueName: \"kubernetes.io/projected/6d7e01e9-b8f9-4f3a-9267-ca0df49dba78-kube-api-access-t2btw\") pod \"cert-manager-webhook-6486ffd997-wc57v\" (UID: \"6d7e01e9-b8f9-4f3a-9267-ca0df49dba78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wc57v"
Sep 18 19:46:54.217960 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:54.217845    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d7e01e9-b8f9-4f3a-9267-ca0df49dba78-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wc57v\" (UID: \"6d7e01e9-b8f9-4f3a-9267-ca0df49dba78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wc57v"
Sep 18 19:46:54.225855 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:54.225830    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6d7e01e9-b8f9-4f3a-9267-ca0df49dba78-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wc57v\" (UID: \"6d7e01e9-b8f9-4f3a-9267-ca0df49dba78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wc57v"
Sep 18 19:46:54.226027 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:54.225980    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2btw\" (UniqueName: \"kubernetes.io/projected/6d7e01e9-b8f9-4f3a-9267-ca0df49dba78-kube-api-access-t2btw\") pod \"cert-manager-webhook-6486ffd997-wc57v\" (UID: \"6d7e01e9-b8f9-4f3a-9267-ca0df49dba78\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wc57v"
Sep 18 19:46:54.302106 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:54.302029    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wc57v"
Sep 18 19:46:54.567857 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:54.567833    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wc57v"]
Sep 18 19:46:54.570397 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:46:54.570369    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d7e01e9_b8f9_4f3a_9267_ca0df49dba78.slice/crio-32c0a93d2961ccd5a6a020643404d024657a96a35fc5e3c600d4240575a9d5c4 WatchSource:0}: Error finding container 32c0a93d2961ccd5a6a020643404d024657a96a35fc5e3c600d4240575a9d5c4: Status 404 returned error can't find the container with id 32c0a93d2961ccd5a6a020643404d024657a96a35fc5e3c600d4240575a9d5c4
Sep 18 19:46:54.814455 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:54.814423    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:54.913845 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:54.913821    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:55.444094 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:55.444061    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wc57v" event={"ID":"6d7e01e9-b8f9-4f3a-9267-ca0df49dba78","Type":"ContainerStarted","Data":"837c0dd6e08aec73f31d20fe83a19eb0bc429e0bbcb8fc33e48db1ea8c8a7510"}
Sep 18 19:46:55.444094 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:55.444098    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wc57v" event={"ID":"6d7e01e9-b8f9-4f3a-9267-ca0df49dba78","Type":"ContainerStarted","Data":"32c0a93d2961ccd5a6a020643404d024657a96a35fc5e3c600d4240575a9d5c4"}
Sep 18 19:46:55.444478 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:55.444136    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wc57v"
Sep 18 19:46:55.462415 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:55.462368    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-wc57v" podStartSLOduration=2.462352007 podStartE2EDuration="2.462352007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:46:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:46:55.461482129 +0000 UTC m=+457.788575892" watchObservedRunningTime="2026-09-18 19:46:55.462352007 +0000 UTC m=+457.789445771"
Sep 18 19:46:56.294202 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:56.294171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:56.503683 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:56.503653    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:56.603951 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:56.603919    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:46:58.720436 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:58.720402    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75lvb"]
Sep 18 19:46:58.723676 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:58.723652    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75lvb"
Sep 18 19:46:58.726363 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:58.726340    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 18 19:46:58.726479 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:58.726363    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 18 19:46:58.727355 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:58.727338    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-r4krb\""
Sep 18 19:46:58.733401 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:58.733381    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75lvb"]
Sep 18 19:46:58.856621 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:58.856594    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99-tmp\") pod \"openshift-lws-operator-fd8ccff4c-75lvb\" (UID: \"4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75lvb"
Sep 18 19:46:58.856751 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:58.856638    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjq7x\" (UniqueName: \"kubernetes.io/projected/4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99-kube-api-access-gjq7x\") pod \"openshift-lws-operator-fd8ccff4c-75lvb\" (UID: \"4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75lvb"
Sep 18 19:46:58.957488 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:58.957464    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjq7x\" (UniqueName: \"kubernetes.io/projected/4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99-kube-api-access-gjq7x\") pod \"openshift-lws-operator-fd8ccff4c-75lvb\" (UID: \"4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75lvb"
Sep 18 19:46:58.957620 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:58.957536    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99-tmp\") pod \"openshift-lws-operator-fd8ccff4c-75lvb\" (UID: \"4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75lvb"
Sep 18 19:46:58.957917 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:58.957888    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99-tmp\") pod \"openshift-lws-operator-fd8ccff4c-75lvb\" (UID: \"4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75lvb"
Sep 18 19:46:58.965824 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:58.965806    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjq7x\" (UniqueName: \"kubernetes.io/projected/4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99-kube-api-access-gjq7x\") pod \"openshift-lws-operator-fd8ccff4c-75lvb\" (UID: \"4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75lvb"
Sep 18 19:46:59.033416 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:59.033363    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75lvb"
Sep 18 19:46:59.301778 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:59.301711    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75lvb"]
Sep 18 19:46:59.303958 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:46:59.303931    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4bbf1fbd_f8c4_4cea_9a17_1ff5a8e6fa99.slice/crio-01b9532da972673b1c98ab974acd0aa6c4a293b1492b9be405e2966ff0348a57 WatchSource:0}: Error finding container 01b9532da972673b1c98ab974acd0aa6c4a293b1492b9be405e2966ff0348a57: Status 404 returned error can't find the container with id 01b9532da972673b1c98ab974acd0aa6c4a293b1492b9be405e2966ff0348a57
Sep 18 19:46:59.467911 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:46:59.467866    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75lvb" event={"ID":"4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99","Type":"ContainerStarted","Data":"01b9532da972673b1c98ab974acd0aa6c4a293b1492b9be405e2966ff0348a57"}
Sep 18 19:47:01.449773 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:01.449703    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wc57v"
Sep 18 19:47:01.480707 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:01.480679    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75lvb" event={"ID":"4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99","Type":"ContainerStarted","Data":"4740afbc3227363270cfb85e9f6411ba346746912ddf339ffcfe303296813e8c"}
Sep 18 19:47:01.501331 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:01.501283    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-75lvb" podStartSLOduration=1.642116895 podStartE2EDuration="3.501267271s" totalImagesPullingTime="1.859150376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:01.50042606 +0000 UTC m=+463.827519825" watchObservedRunningTime="2026-09-18 19:47:01.501267271 +0000 UTC m=+463.828361034"
Sep 18 19:47:02.155528 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:02.155498    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:02.258217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:02.258184    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:04.351293 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:04.351261    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:05.305326 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.305290    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"]
Sep 18 19:47:05.309066 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.309032    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"
Sep 18 19:47:05.311667 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.311646    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 19:47:05.311803 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.311692    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r2tvv\""
Sep 18 19:47:05.311803 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.311742    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 19:47:05.316902 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.316880    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"]
Sep 18 19:47:05.405228 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.405194    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqmc8\" (UniqueName: \"kubernetes.io/projected/d5793016-6c2f-4722-81d1-5546515f6a20-kube-api-access-fqmc8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs\" (UID: \"d5793016-6c2f-4722-81d1-5546515f6a20\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"
Sep 18 19:47:05.405570 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.405260    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5793016-6c2f-4722-81d1-5546515f6a20-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs\" (UID: \"d5793016-6c2f-4722-81d1-5546515f6a20\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"
Sep 18 19:47:05.405570 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.405289    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5793016-6c2f-4722-81d1-5546515f6a20-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs\" (UID: \"d5793016-6c2f-4722-81d1-5546515f6a20\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"
Sep 18 19:47:05.506202 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.506170    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5793016-6c2f-4722-81d1-5546515f6a20-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs\" (UID: \"d5793016-6c2f-4722-81d1-5546515f6a20\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"
Sep 18 19:47:05.506347 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.506218    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5793016-6c2f-4722-81d1-5546515f6a20-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs\" (UID: \"d5793016-6c2f-4722-81d1-5546515f6a20\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"
Sep 18 19:47:05.506347 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.506251    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqmc8\" (UniqueName: \"kubernetes.io/projected/d5793016-6c2f-4722-81d1-5546515f6a20-kube-api-access-fqmc8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs\" (UID: \"d5793016-6c2f-4722-81d1-5546515f6a20\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"
Sep 18 19:47:05.506615 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.506594    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5793016-6c2f-4722-81d1-5546515f6a20-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs\" (UID: \"d5793016-6c2f-4722-81d1-5546515f6a20\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"
Sep 18 19:47:05.506651 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.506592    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5793016-6c2f-4722-81d1-5546515f6a20-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs\" (UID: \"d5793016-6c2f-4722-81d1-5546515f6a20\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"
Sep 18 19:47:05.514304 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.514283    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqmc8\" (UniqueName: \"kubernetes.io/projected/d5793016-6c2f-4722-81d1-5546515f6a20-kube-api-access-fqmc8\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs\" (UID: \"d5793016-6c2f-4722-81d1-5546515f6a20\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"
Sep 18 19:47:05.619373 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.619348    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"
Sep 18 19:47:05.889645 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:05.889621    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"]
Sep 18 19:47:05.891429 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:47:05.891398    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5793016_6c2f_4722_81d1_5546515f6a20.slice/crio-0418c10a3bd955ae8a0008cdd910d005a54a1a8bd768ad4a3336a90116dac344 WatchSource:0}: Error finding container 0418c10a3bd955ae8a0008cdd910d005a54a1a8bd768ad4a3336a90116dac344: Status 404 returned error can't find the container with id 0418c10a3bd955ae8a0008cdd910d005a54a1a8bd768ad4a3336a90116dac344
Sep 18 19:47:06.505712 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:06.505680    2583 generic.go:356] "Generic (PLEG): container finished" podID="d5793016-6c2f-4722-81d1-5546515f6a20" containerID="ac62ca972db3ef22e1c0120db7b76c375c4e22e8d2e522bbd2d70a9d0095a2b0" exitCode=0
Sep 18 19:47:06.506083 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:06.505767    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs" event={"ID":"d5793016-6c2f-4722-81d1-5546515f6a20","Type":"ContainerDied","Data":"ac62ca972db3ef22e1c0120db7b76c375c4e22e8d2e522bbd2d70a9d0095a2b0"}
Sep 18 19:47:06.506083 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:06.505816    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs" event={"ID":"d5793016-6c2f-4722-81d1-5546515f6a20","Type":"ContainerStarted","Data":"0418c10a3bd955ae8a0008cdd910d005a54a1a8bd768ad4a3336a90116dac344"}
Sep 18 19:47:07.511801 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:07.511717    2583 generic.go:356] "Generic (PLEG): container finished" podID="d5793016-6c2f-4722-81d1-5546515f6a20" containerID="dda5f67a9493d12918a0f887f2ef01e6352c55b9a6fd84c067f430af191ba993" exitCode=0
Sep 18 19:47:07.511801 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:07.511776    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs" event={"ID":"d5793016-6c2f-4722-81d1-5546515f6a20","Type":"ContainerDied","Data":"dda5f67a9493d12918a0f887f2ef01e6352c55b9a6fd84c067f430af191ba993"}
Sep 18 19:47:08.518485 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:08.518447    2583 generic.go:356] "Generic (PLEG): container finished" podID="d5793016-6c2f-4722-81d1-5546515f6a20" containerID="3e13d8a78b5830d61403674e37598f43ab7f8a437eddade3acb5be108a4b81f7" exitCode=0
Sep 18 19:47:08.518871 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:08.518520    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs" event={"ID":"d5793016-6c2f-4722-81d1-5546515f6a20","Type":"ContainerDied","Data":"3e13d8a78b5830d61403674e37598f43ab7f8a437eddade3acb5be108a4b81f7"}
Sep 18 19:47:09.666454 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:09.666428    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"
Sep 18 19:47:09.741597 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:09.741561    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fqmc8\" (UniqueName: \"kubernetes.io/projected/d5793016-6c2f-4722-81d1-5546515f6a20-kube-api-access-fqmc8\") pod \"d5793016-6c2f-4722-81d1-5546515f6a20\" (UID: \"d5793016-6c2f-4722-81d1-5546515f6a20\") "
Sep 18 19:47:09.741751 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:09.741617    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5793016-6c2f-4722-81d1-5546515f6a20-util\") pod \"d5793016-6c2f-4722-81d1-5546515f6a20\" (UID: \"d5793016-6c2f-4722-81d1-5546515f6a20\") "
Sep 18 19:47:09.741751 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:09.741685    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5793016-6c2f-4722-81d1-5546515f6a20-bundle\") pod \"d5793016-6c2f-4722-81d1-5546515f6a20\" (UID: \"d5793016-6c2f-4722-81d1-5546515f6a20\") "
Sep 18 19:47:09.742463 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:09.742428    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5793016-6c2f-4722-81d1-5546515f6a20-bundle" (OuterVolumeSpecName: "bundle") pod "d5793016-6c2f-4722-81d1-5546515f6a20" (UID: "d5793016-6c2f-4722-81d1-5546515f6a20"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:47:09.743727 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:09.743702    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5793016-6c2f-4722-81d1-5546515f6a20-kube-api-access-fqmc8" (OuterVolumeSpecName: "kube-api-access-fqmc8") pod "d5793016-6c2f-4722-81d1-5546515f6a20" (UID: "d5793016-6c2f-4722-81d1-5546515f6a20"). InnerVolumeSpecName "kube-api-access-fqmc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:47:09.746933 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:09.746899    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5793016-6c2f-4722-81d1-5546515f6a20-util" (OuterVolumeSpecName: "util") pod "d5793016-6c2f-4722-81d1-5546515f6a20" (UID: "d5793016-6c2f-4722-81d1-5546515f6a20"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:47:09.842161 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:09.842133    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d5793016-6c2f-4722-81d1-5546515f6a20-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:47:09.842161 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:09.842154    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fqmc8\" (UniqueName: \"kubernetes.io/projected/d5793016-6c2f-4722-81d1-5546515f6a20-kube-api-access-fqmc8\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:47:09.842161 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:09.842164    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d5793016-6c2f-4722-81d1-5546515f6a20-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:47:10.528666 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:10.528641    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs"
Sep 18 19:47:10.528808 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:10.528667    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzbgcs" event={"ID":"d5793016-6c2f-4722-81d1-5546515f6a20","Type":"ContainerDied","Data":"0418c10a3bd955ae8a0008cdd910d005a54a1a8bd768ad4a3336a90116dac344"}
Sep 18 19:47:10.528808 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:10.528705    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0418c10a3bd955ae8a0008cdd910d005a54a1a8bd768ad4a3336a90116dac344"
Sep 18 19:47:15.137563 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.137529    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"]
Sep 18 19:47:15.138001 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.137826    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5793016-6c2f-4722-81d1-5546515f6a20" containerName="util"
Sep 18 19:47:15.138001 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.137836    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5793016-6c2f-4722-81d1-5546515f6a20" containerName="util"
Sep 18 19:47:15.138001 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.137848    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5793016-6c2f-4722-81d1-5546515f6a20" containerName="extract"
Sep 18 19:47:15.138001 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.137854    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5793016-6c2f-4722-81d1-5546515f6a20" containerName="extract"
Sep 18 19:47:15.138001 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.137864    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5793016-6c2f-4722-81d1-5546515f6a20" containerName="pull"
Sep 18 19:47:15.138001 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.137870    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5793016-6c2f-4722-81d1-5546515f6a20" containerName="pull"
Sep 18 19:47:15.138001 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.137932    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5793016-6c2f-4722-81d1-5546515f6a20" containerName="extract"
Sep 18 19:47:15.140695 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.140674    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"
Sep 18 19:47:15.143367 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.143347    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r2tvv\""
Sep 18 19:47:15.143478 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.143354    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 19:47:15.144332 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.144320    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 19:47:15.154028 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.154008    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"]
Sep 18 19:47:15.184862 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.184829    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54d82741-ade4-4845-a9ee-362dd2cee4c7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf\" (UID: \"54d82741-ade4-4845-a9ee-362dd2cee4c7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"
Sep 18 19:47:15.184999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.184888    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxdmx\" (UniqueName: \"kubernetes.io/projected/54d82741-ade4-4845-a9ee-362dd2cee4c7-kube-api-access-pxdmx\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf\" (UID: \"54d82741-ade4-4845-a9ee-362dd2cee4c7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"
Sep 18 19:47:15.184999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.184909    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54d82741-ade4-4845-a9ee-362dd2cee4c7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf\" (UID: \"54d82741-ade4-4845-a9ee-362dd2cee4c7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"
Sep 18 19:47:15.286190 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.286156    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxdmx\" (UniqueName: \"kubernetes.io/projected/54d82741-ade4-4845-a9ee-362dd2cee4c7-kube-api-access-pxdmx\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf\" (UID: \"54d82741-ade4-4845-a9ee-362dd2cee4c7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"
Sep 18 19:47:15.286190 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.286194    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54d82741-ade4-4845-a9ee-362dd2cee4c7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf\" (UID: \"54d82741-ade4-4845-a9ee-362dd2cee4c7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"
Sep 18 19:47:15.286382 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.286234    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54d82741-ade4-4845-a9ee-362dd2cee4c7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf\" (UID: \"54d82741-ade4-4845-a9ee-362dd2cee4c7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"
Sep 18 19:47:15.286570 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.286554    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54d82741-ade4-4845-a9ee-362dd2cee4c7-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf\" (UID: \"54d82741-ade4-4845-a9ee-362dd2cee4c7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"
Sep 18 19:47:15.286605 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.286583    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54d82741-ade4-4845-a9ee-362dd2cee4c7-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf\" (UID: \"54d82741-ade4-4845-a9ee-362dd2cee4c7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"
Sep 18 19:47:15.293965 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.293944    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxdmx\" (UniqueName: \"kubernetes.io/projected/54d82741-ade4-4845-a9ee-362dd2cee4c7-kube-api-access-pxdmx\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf\" (UID: \"54d82741-ade4-4845-a9ee-362dd2cee4c7\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"
Sep 18 19:47:15.450350 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.450267    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"
Sep 18 19:47:15.720834 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.720752    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"]
Sep 18 19:47:15.723623 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:47:15.723595    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d82741_ade4_4845_a9ee_362dd2cee4c7.slice/crio-76fc869576039051ad95fbd9e3bbc3d29d58d2dcf71858f1435eb081a1c1c21d WatchSource:0}: Error finding container 76fc869576039051ad95fbd9e3bbc3d29d58d2dcf71858f1435eb081a1c1c21d: Status 404 returned error can't find the container with id 76fc869576039051ad95fbd9e3bbc3d29d58d2dcf71858f1435eb081a1c1c21d
Sep 18 19:47:15.914668 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:15.914639    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:16.013656 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.013583    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:16.276955 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.276858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:16.556984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.556899    2583 generic.go:356] "Generic (PLEG): container finished" podID="54d82741-ade4-4845-a9ee-362dd2cee4c7" containerID="86647f3869b39344b84c74e144f627e8338b3cfba6cd1e2a2ac099f2771048b6" exitCode=0
Sep 18 19:47:16.557146 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.556990    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf" event={"ID":"54d82741-ade4-4845-a9ee-362dd2cee4c7","Type":"ContainerDied","Data":"86647f3869b39344b84c74e144f627e8338b3cfba6cd1e2a2ac099f2771048b6"}
Sep 18 19:47:16.557146 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.557058    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf" event={"ID":"54d82741-ade4-4845-a9ee-362dd2cee4c7","Type":"ContainerStarted","Data":"76fc869576039051ad95fbd9e3bbc3d29d58d2dcf71858f1435eb081a1c1c21d"}
Sep 18 19:47:16.790280 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.790254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:16.894918 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.894888    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:16.946723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.946692    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"]
Sep 18 19:47:16.950661 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.950642    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:16.954380 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.954356    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 18 19:47:16.954786 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.954755    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bdx4v\""
Sep 18 19:47:16.954888 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.954815    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 18 19:47:16.954888 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.954883    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 18 19:47:16.957652 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.957633    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 18 19:47:16.976284 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:16.976263    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"]
Sep 18 19:47:17.000818 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.000784    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brd25\" (UniqueName: \"kubernetes.io/projected/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-kube-api-access-brd25\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.000975 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.000827    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-manifests\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.000975 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.000853    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-tmp\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.000975 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.000882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.001145 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.000986    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.101614 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.101580    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.101837 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.101644    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.101837 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.101683    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brd25\" (UniqueName: \"kubernetes.io/projected/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-kube-api-access-brd25\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.101837 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.101719    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-manifests\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.101837 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.101749    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-tmp\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.102246 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.102218    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-manifests\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.103958 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.103939    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-tmp\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.104159 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.104139    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.104242 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.104228    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-webhook-cert\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.112320 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.112292    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brd25\" (UniqueName: \"kubernetes.io/projected/a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8-kube-api-access-brd25\") pod \"opendatahub-operator-controller-manager-bd4fcf9c7-smtdb\" (UID: \"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8\") " pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.187605 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.187581    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:17.260358 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.260333    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:17.300093 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.300059    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:17.389324 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.389290    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:17.490055 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.489963    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:17.549269 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.548443    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"]
Sep 18 19:47:17.555544 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:47:17.555501    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6d4d0fc_c3ce_4a76_8721_d3d9507a60e8.slice/crio-49c667b6d1a9a5aaacd1e289b3e995d99a674b2c66c9e427c4db02b84afbd324 WatchSource:0}: Error finding container 49c667b6d1a9a5aaacd1e289b3e995d99a674b2c66c9e427c4db02b84afbd324: Status 404 returned error can't find the container with id 49c667b6d1a9a5aaacd1e289b3e995d99a674b2c66c9e427c4db02b84afbd324
Sep 18 19:47:17.567851 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.567809    2583 generic.go:356] "Generic (PLEG): container finished" podID="54d82741-ade4-4845-a9ee-362dd2cee4c7" containerID="44adf22d439a443e63e9683b306068189155cec3fde962981cfd2d715953ae5d" exitCode=0
Sep 18 19:47:17.568115 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.568082    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf" event={"ID":"54d82741-ade4-4845-a9ee-362dd2cee4c7","Type":"ContainerDied","Data":"44adf22d439a443e63e9683b306068189155cec3fde962981cfd2d715953ae5d"}
Sep 18 19:47:17.572273 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.572228    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb" event={"ID":"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8","Type":"ContainerStarted","Data":"49c667b6d1a9a5aaacd1e289b3e995d99a674b2c66c9e427c4db02b84afbd324"}
Sep 18 19:47:17.593226 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:17.591859    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:18.580627 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:18.580597    2583 generic.go:356] "Generic (PLEG): container finished" podID="54d82741-ade4-4845-a9ee-362dd2cee4c7" containerID="04526fd272d15017f3b5b2c92b282070c1e1ab32e794cfc4c8f977031af29692" exitCode=0
Sep 18 19:47:18.581077 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:18.580688    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf" event={"ID":"54d82741-ade4-4845-a9ee-362dd2cee4c7","Type":"ContainerDied","Data":"04526fd272d15017f3b5b2c92b282070c1e1ab32e794cfc4c8f977031af29692"}
Sep 18 19:47:20.413882 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.413853    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"
Sep 18 19:47:20.531459 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.531436    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxdmx\" (UniqueName: \"kubernetes.io/projected/54d82741-ade4-4845-a9ee-362dd2cee4c7-kube-api-access-pxdmx\") pod \"54d82741-ade4-4845-a9ee-362dd2cee4c7\" (UID: \"54d82741-ade4-4845-a9ee-362dd2cee4c7\") "
Sep 18 19:47:20.531573 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.531512    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54d82741-ade4-4845-a9ee-362dd2cee4c7-util\") pod \"54d82741-ade4-4845-a9ee-362dd2cee4c7\" (UID: \"54d82741-ade4-4845-a9ee-362dd2cee4c7\") "
Sep 18 19:47:20.531573 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.531557    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54d82741-ade4-4845-a9ee-362dd2cee4c7-bundle\") pod \"54d82741-ade4-4845-a9ee-362dd2cee4c7\" (UID: \"54d82741-ade4-4845-a9ee-362dd2cee4c7\") "
Sep 18 19:47:20.532241 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.532214    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54d82741-ade4-4845-a9ee-362dd2cee4c7-bundle" (OuterVolumeSpecName: "bundle") pod "54d82741-ade4-4845-a9ee-362dd2cee4c7" (UID: "54d82741-ade4-4845-a9ee-362dd2cee4c7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:47:20.533439 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.533412    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54d82741-ade4-4845-a9ee-362dd2cee4c7-kube-api-access-pxdmx" (OuterVolumeSpecName: "kube-api-access-pxdmx") pod "54d82741-ade4-4845-a9ee-362dd2cee4c7" (UID: "54d82741-ade4-4845-a9ee-362dd2cee4c7"). InnerVolumeSpecName "kube-api-access-pxdmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:47:20.536932 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.536911    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54d82741-ade4-4845-a9ee-362dd2cee4c7-util" (OuterVolumeSpecName: "util") pod "54d82741-ade4-4845-a9ee-362dd2cee4c7" (UID: "54d82741-ade4-4845-a9ee-362dd2cee4c7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:47:20.593707 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.593670    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf" event={"ID":"54d82741-ade4-4845-a9ee-362dd2cee4c7","Type":"ContainerDied","Data":"76fc869576039051ad95fbd9e3bbc3d29d58d2dcf71858f1435eb081a1c1c21d"}
Sep 18 19:47:20.593872 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.593732    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76fc869576039051ad95fbd9e3bbc3d29d58d2dcf71858f1435eb081a1c1c21d"
Sep 18 19:47:20.593872 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.593684    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b05zsdf"
Sep 18 19:47:20.595442 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.595420    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb" event={"ID":"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8","Type":"ContainerStarted","Data":"14324e1b93c6c4fa0fd20e1a1eca80710095ffbaaf860f6a4f5a184469dc9b5b"}
Sep 18 19:47:20.633075 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.633046    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxdmx\" (UniqueName: \"kubernetes.io/projected/54d82741-ade4-4845-a9ee-362dd2cee4c7-kube-api-access-pxdmx\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:47:20.633075 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.633077    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54d82741-ade4-4845-a9ee-362dd2cee4c7-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:47:20.633224 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.633088    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54d82741-ade4-4845-a9ee-362dd2cee4c7-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:47:20.673993 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.673850    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:20.770694 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:20.770663    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:21.603635 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:21.603602    2583 generic.go:356] "Generic (PLEG): container finished" podID="a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8" containerID="14324e1b93c6c4fa0fd20e1a1eca80710095ffbaaf860f6a4f5a184469dc9b5b" exitCode=0
Sep 18 19:47:21.604070 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:21.603648    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb" event={"ID":"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8","Type":"ContainerDied","Data":"14324e1b93c6c4fa0fd20e1a1eca80710095ffbaaf860f6a4f5a184469dc9b5b"}
Sep 18 19:47:22.610310 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:22.610270    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb" event={"ID":"a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8","Type":"ContainerStarted","Data":"4a21b3bfc25c48c1a8e920ccffadb7dc96d188f8451cc6c03e5204a9c45be3a1"}
Sep 18 19:47:22.610653 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:22.610425    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:22.632015 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:22.631967    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb" podStartSLOduration=2.37862142 podStartE2EDuration="6.631952863s" totalImagesPullingTime="3.249034042s" totalInitContainerRuntime="1.004297401s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:22.630386244 +0000 UTC m=+484.957480021" watchObservedRunningTime="2026-09-18 19:47:22.631952863 +0000 UTC m=+484.959046626"
Sep 18 19:47:33.617623 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:33.617592    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-bd4fcf9c7-smtdb"
Sep 18 19:47:35.907266 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:35.907235    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:36.026546 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:36.026515    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:36.237378 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:36.237301    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:36.401688 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:36.401638    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:37.080798 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.080760    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"]
Sep 18 19:47:37.081187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.081112    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d82741-ade4-4845-a9ee-362dd2cee4c7" containerName="extract"
Sep 18 19:47:37.081187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.081127    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d82741-ade4-4845-a9ee-362dd2cee4c7" containerName="extract"
Sep 18 19:47:37.081187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.081146    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d82741-ade4-4845-a9ee-362dd2cee4c7" containerName="util"
Sep 18 19:47:37.081187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.081152    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d82741-ade4-4845-a9ee-362dd2cee4c7" containerName="util"
Sep 18 19:47:37.081187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.081165    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d82741-ade4-4845-a9ee-362dd2cee4c7" containerName="pull"
Sep 18 19:47:37.081187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.081170    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d82741-ade4-4845-a9ee-362dd2cee4c7" containerName="pull"
Sep 18 19:47:37.081409 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.081234    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="54d82741-ade4-4845-a9ee-362dd2cee4c7" containerName="extract"
Sep 18 19:47:37.085189 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.085169    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:37.088708 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.088687    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9nshn\""
Sep 18 19:47:37.088797 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.088687    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 18 19:47:37.088797 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.088688    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 18 19:47:37.088797 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.088697    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 18 19:47:37.100914 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.100891    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"]
Sep 18 19:47:37.170943 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.170902    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/628b59fe-16f3-4355-b177-a3045b4b0b34-metrics-cert\") pod \"lws-controller-manager-5947d9d788-5jv2c\" (UID: \"628b59fe-16f3-4355-b177-a3045b4b0b34\") " pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:37.171121 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.170985    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44smh\" (UniqueName: \"kubernetes.io/projected/628b59fe-16f3-4355-b177-a3045b4b0b34-kube-api-access-44smh\") pod \"lws-controller-manager-5947d9d788-5jv2c\" (UID: \"628b59fe-16f3-4355-b177-a3045b4b0b34\") " pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:37.171121 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.171057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/628b59fe-16f3-4355-b177-a3045b4b0b34-manager-config\") pod \"lws-controller-manager-5947d9d788-5jv2c\" (UID: \"628b59fe-16f3-4355-b177-a3045b4b0b34\") " pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:37.171121 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.171081    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/628b59fe-16f3-4355-b177-a3045b4b0b34-cert\") pod \"lws-controller-manager-5947d9d788-5jv2c\" (UID: \"628b59fe-16f3-4355-b177-a3045b4b0b34\") " pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:37.272519 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.272488    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44smh\" (UniqueName: \"kubernetes.io/projected/628b59fe-16f3-4355-b177-a3045b4b0b34-kube-api-access-44smh\") pod \"lws-controller-manager-5947d9d788-5jv2c\" (UID: \"628b59fe-16f3-4355-b177-a3045b4b0b34\") " pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:37.272709 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.272536    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/628b59fe-16f3-4355-b177-a3045b4b0b34-manager-config\") pod \"lws-controller-manager-5947d9d788-5jv2c\" (UID: \"628b59fe-16f3-4355-b177-a3045b4b0b34\") " pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:37.272709 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.272558    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/628b59fe-16f3-4355-b177-a3045b4b0b34-cert\") pod \"lws-controller-manager-5947d9d788-5jv2c\" (UID: \"628b59fe-16f3-4355-b177-a3045b4b0b34\") " pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:37.272709 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.272619    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/628b59fe-16f3-4355-b177-a3045b4b0b34-metrics-cert\") pod \"lws-controller-manager-5947d9d788-5jv2c\" (UID: \"628b59fe-16f3-4355-b177-a3045b4b0b34\") " pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:37.273475 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.273441    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/628b59fe-16f3-4355-b177-a3045b4b0b34-manager-config\") pod \"lws-controller-manager-5947d9d788-5jv2c\" (UID: \"628b59fe-16f3-4355-b177-a3045b4b0b34\") " pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:37.275482 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.275450    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/628b59fe-16f3-4355-b177-a3045b4b0b34-cert\") pod \"lws-controller-manager-5947d9d788-5jv2c\" (UID: \"628b59fe-16f3-4355-b177-a3045b4b0b34\") " pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:37.275597 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.275456    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/628b59fe-16f3-4355-b177-a3045b4b0b34-metrics-cert\") pod \"lws-controller-manager-5947d9d788-5jv2c\" (UID: \"628b59fe-16f3-4355-b177-a3045b4b0b34\") " pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:37.288468 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.288446    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44smh\" (UniqueName: \"kubernetes.io/projected/628b59fe-16f3-4355-b177-a3045b4b0b34-kube-api-access-44smh\") pod \"lws-controller-manager-5947d9d788-5jv2c\" (UID: \"628b59fe-16f3-4355-b177-a3045b4b0b34\") " pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:37.394662 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.394621    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:37.575410 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.575379    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:37.670901 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.670822    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"]
Sep 18 19:47:37.673722 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.673696    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:37.674133 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:47:37.674107    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod628b59fe_16f3_4355_b177_a3045b4b0b34.slice/crio-5132852b5428ce18ede825ddb9165dab619431529247b20703615d3b0d7fb0a3 WatchSource:0}: Error finding container 5132852b5428ce18ede825ddb9165dab619431529247b20703615d3b0d7fb0a3: Status 404 returned error can't find the container with id 5132852b5428ce18ede825ddb9165dab619431529247b20703615d3b0d7fb0a3
Sep 18 19:47:37.688677 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:37.688655    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c" event={"ID":"628b59fe-16f3-4355-b177-a3045b4b0b34","Type":"ContainerStarted","Data":"5132852b5428ce18ede825ddb9165dab619431529247b20703615d3b0d7fb0a3"}
Sep 18 19:47:38.625673 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:38.625634    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:39.700920 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:39.700890    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c" event={"ID":"628b59fe-16f3-4355-b177-a3045b4b0b34","Type":"ContainerStarted","Data":"2f01cead1cacca16058769d34bd3b3763fb93b846ac89219bb3fca9130b21656"}
Sep 18 19:47:39.701313 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:39.700943    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:39.717322 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:39.717274    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c" podStartSLOduration=1.138242594 podStartE2EDuration="2.71725825s" totalImagesPullingTime="1.579015656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:39.716374274 +0000 UTC m=+502.043468038" watchObservedRunningTime="2026-09-18 19:47:39.71725825 +0000 UTC m=+502.044352014"
Sep 18 19:47:42.280739 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:42.280711    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:42.384485 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:42.384456    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:42.853192 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:42.853161    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"]
Sep 18 19:47:42.857912 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:42.857883    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:42.860369 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:42.860345    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-f9xbg\""
Sep 18 19:47:42.860369 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:42.860366    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 18 19:47:42.873892 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:42.873870    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"]
Sep 18 19:47:42.890716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:42.890684    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:43.021928 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.021879    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.022153 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.021960    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc62143b-2654-44c3-96fb-1f14212e2eea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.022153 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.021996    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j49pp\" (UniqueName: \"kubernetes.io/projected/dc62143b-2654-44c3-96fb-1f14212e2eea-kube-api-access-j49pp\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.022153 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.022026    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.022335 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.022156    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.022335 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.022222    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc62143b-2654-44c3-96fb-1f14212e2eea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.022335 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.022320    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.022490 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.022351    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.022490 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.022380    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc62143b-2654-44c3-96fb-1f14212e2eea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.075744 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.075711    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:43.123362 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.123290    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc62143b-2654-44c3-96fb-1f14212e2eea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.123362 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.123324    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.123362 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.123340    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.123362 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.123358    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc62143b-2654-44c3-96fb-1f14212e2eea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.123659 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.123496    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.123659 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.123553    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc62143b-2654-44c3-96fb-1f14212e2eea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.123659 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.123594    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j49pp\" (UniqueName: \"kubernetes.io/projected/dc62143b-2654-44c3-96fb-1f14212e2eea-kube-api-access-j49pp\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.123659 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.123618    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.123868 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.123661    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.123868 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.123752    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.123968 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.123917    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.124021 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.124012    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.124113 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.124098    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc62143b-2654-44c3-96fb-1f14212e2eea-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.124175 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.124101    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.126574 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.126553    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc62143b-2654-44c3-96fb-1f14212e2eea-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.126715 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.126698    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc62143b-2654-44c3-96fb-1f14212e2eea-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.130808 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.130788    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc62143b-2654-44c3-96fb-1f14212e2eea-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.131018 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.131002    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j49pp\" (UniqueName: \"kubernetes.io/projected/dc62143b-2654-44c3-96fb-1f14212e2eea-kube-api-access-j49pp\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v\" (UID: \"dc62143b-2654-44c3-96fb-1f14212e2eea\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.168076 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.168046    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:43.174991 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.174955    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:43.446247 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.446224    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"]
Sep 18 19:47:43.448197 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:47:43.448168    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc62143b_2654_44c3_96fb_1f14212e2eea.slice/crio-1cdf679ef894acc822fc5fd77c4f02ab0fb25881a405d2b764fce0ca3901ffd0 WatchSource:0}: Error finding container 1cdf679ef894acc822fc5fd77c4f02ab0fb25881a405d2b764fce0ca3901ffd0: Status 404 returned error can't find the container with id 1cdf679ef894acc822fc5fd77c4f02ab0fb25881a405d2b764fce0ca3901ffd0
Sep 18 19:47:43.720076 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:43.719963    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v" event={"ID":"dc62143b-2654-44c3-96fb-1f14212e2eea","Type":"ContainerStarted","Data":"1cdf679ef894acc822fc5fd77c4f02ab0fb25881a405d2b764fce0ca3901ffd0"}
Sep 18 19:47:46.113425 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:46.113388    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:47:46.113716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:46.113460    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:47:46.113716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:46.113492    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:47:46.738699 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:46.738665    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v" event={"ID":"dc62143b-2654-44c3-96fb-1f14212e2eea","Type":"ContainerStarted","Data":"2208b8a7ec3b2944ffd4f46fe2f097556808316c4939972ed3f947ae37d52bcc"}
Sep 18 19:47:46.768885 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:46.768815    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v" podStartSLOduration=2.105936397 podStartE2EDuration="4.76879315s" totalImagesPullingTime="2.662856753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:46.764799543 +0000 UTC m=+509.091893308" watchObservedRunningTime="2026-09-18 19:47:46.76879315 +0000 UTC m=+509.095886918"
Sep 18 19:47:47.091942 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:47.091911    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:47.168808 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:47.168776    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:47.174593 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:47.174562    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:47.192450 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:47.192419    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:47.253187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:47.253147    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:47.616801 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:47.616765    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:47.737266 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:47.737237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:47.747005 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:47.746977    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:47.748022 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:47.748005    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v"
Sep 18 19:47:48.095446 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:48.095417    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:50.708136 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:50.708107    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5947d9d788-5jv2c"
Sep 18 19:47:53.623361 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.623324    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"]
Sep 18 19:47:53.632153 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.632118    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.636323 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.636298    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 18 19:47:53.636323 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.636304    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 18 19:47:53.636694 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.636672    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 18 19:47:53.636831 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.636753    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dgxz2\""
Sep 18 19:47:53.645130 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.645101    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"]
Sep 18 19:47:53.815026 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.814996    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aac4f276-f608-45b1-afe6-9c766feef714-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.815225 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.815117    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aac4f276-f608-45b1-afe6-9c766feef714-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.815225 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.815139    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aac4f276-f608-45b1-afe6-9c766feef714-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.815225 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.815190    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aac4f276-f608-45b1-afe6-9c766feef714-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.815225 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.815221    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aac4f276-f608-45b1-afe6-9c766feef714-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.815389 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.815251    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aac4f276-f608-45b1-afe6-9c766feef714-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.815389 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.815267    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck2xt\" (UniqueName: \"kubernetes.io/projected/aac4f276-f608-45b1-afe6-9c766feef714-kube-api-access-ck2xt\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.916588 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.916494    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aac4f276-f608-45b1-afe6-9c766feef714-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.916588 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.916567    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aac4f276-f608-45b1-afe6-9c766feef714-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.916588 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.916591    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aac4f276-f608-45b1-afe6-9c766feef714-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.916868 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.916607    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aac4f276-f608-45b1-afe6-9c766feef714-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.916868 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.916625    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aac4f276-f608-45b1-afe6-9c766feef714-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.916868 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.916642    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aac4f276-f608-45b1-afe6-9c766feef714-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.916868 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.916656    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck2xt\" (UniqueName: \"kubernetes.io/projected/aac4f276-f608-45b1-afe6-9c766feef714-kube-api-access-ck2xt\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.917806 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.917779    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/aac4f276-f608-45b1-afe6-9c766feef714-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.919033 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.918999    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/aac4f276-f608-45b1-afe6-9c766feef714-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.919188 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.919169    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aac4f276-f608-45b1-afe6-9c766feef714-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.919259 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.919241    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/aac4f276-f608-45b1-afe6-9c766feef714-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.919316 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.919259    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/aac4f276-f608-45b1-afe6-9c766feef714-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.926981 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.926959    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aac4f276-f608-45b1-afe6-9c766feef714-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.927219 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.927202    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck2xt\" (UniqueName: \"kubernetes.io/projected/aac4f276-f608-45b1-afe6-9c766feef714-kube-api-access-ck2xt\") pod \"istiod-openshift-gateway-5677ccb49b-kzpkn\" (UID: \"aac4f276-f608-45b1-afe6-9c766feef714\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:53.944018 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:53.943991    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:54.241361 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:54.240991    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"]
Sep 18 19:47:54.786649 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:54.786613    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn" event={"ID":"aac4f276-f608-45b1-afe6-9c766feef714","Type":"ContainerStarted","Data":"5bab9045a9ee2b3a8e7ed8e1d86e61e520af831e93157294cf1fdc022b01e954"}
Sep 18 19:47:56.256244 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:56.256202    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:56.357158 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:56.357114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:56.519220 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:56.519143    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:56.534939 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:56.534903    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:47:56.535072 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:56.534980    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:47:56.683840 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:56.683755    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:56.802255 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:56.802162    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn" event={"ID":"aac4f276-f608-45b1-afe6-9c766feef714","Type":"ContainerStarted","Data":"273afaa0d3d386f0fbb6918f7f00c3cfc9fda9ff4aa2bb223c25ce8027271e29"}
Sep 18 19:47:56.802975 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:56.802952    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:47:56.830012 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:56.829961    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn" podStartSLOduration=1.543680846 podStartE2EDuration="3.829943975s" totalImagesPullingTime="2.286263129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:47:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:47:56.82829404 +0000 UTC m=+519.155387805" watchObservedRunningTime="2026-09-18 19:47:56.829943975 +0000 UTC m=+519.157037739"
Sep 18 19:47:57.543345 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:57.543314    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:57.641470 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:57.641396    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:57.699463 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:57.699438    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:47:57.816968 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:47:57.816939    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-kzpkn"
Sep 18 19:48:25.801579 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:25.801544    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:48:25.856628 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:25.856601    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:48:48.088353 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:48.088322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:48:48.205296 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:48.205265    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:48:51.684437 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.684405    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"]
Sep 18 19:48:51.688144 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.688122    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"
Sep 18 19:48:51.690512 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.690494    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 18 19:48:51.690670 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.690652    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 18 19:48:51.691581 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.691566    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-r2tvv\""
Sep 18 19:48:51.696725 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.696708    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"]
Sep 18 19:48:51.782150 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.782105    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b82294f4-7eff-4ae6-8671-422adccd8825-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4\" (UID: \"b82294f4-7eff-4ae6-8671-422adccd8825\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"
Sep 18 19:48:51.782322 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.782161    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4vn9\" (UniqueName: \"kubernetes.io/projected/b82294f4-7eff-4ae6-8671-422adccd8825-kube-api-access-r4vn9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4\" (UID: \"b82294f4-7eff-4ae6-8671-422adccd8825\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"
Sep 18 19:48:51.782322 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.782257    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b82294f4-7eff-4ae6-8671-422adccd8825-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4\" (UID: \"b82294f4-7eff-4ae6-8671-422adccd8825\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"
Sep 18 19:48:51.783918 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.783893    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"]
Sep 18 19:48:51.793719 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.793693    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"
Sep 18 19:48:51.794820 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.794797    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"]
Sep 18 19:48:51.882841 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.882807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hcrh\" (UniqueName: \"kubernetes.io/projected/2526775b-5a0a-46c3-a21e-71af6bd3375a-kube-api-access-6hcrh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks\" (UID: \"2526775b-5a0a-46c3-a21e-71af6bd3375a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"
Sep 18 19:48:51.883058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.882891    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b82294f4-7eff-4ae6-8671-422adccd8825-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4\" (UID: \"b82294f4-7eff-4ae6-8671-422adccd8825\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"
Sep 18 19:48:51.883058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.882909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4vn9\" (UniqueName: \"kubernetes.io/projected/b82294f4-7eff-4ae6-8671-422adccd8825-kube-api-access-r4vn9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4\" (UID: \"b82294f4-7eff-4ae6-8671-422adccd8825\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"
Sep 18 19:48:51.883058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.882934    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2526775b-5a0a-46c3-a21e-71af6bd3375a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks\" (UID: \"2526775b-5a0a-46c3-a21e-71af6bd3375a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"
Sep 18 19:48:51.883058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.882950    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2526775b-5a0a-46c3-a21e-71af6bd3375a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks\" (UID: \"2526775b-5a0a-46c3-a21e-71af6bd3375a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"
Sep 18 19:48:51.883058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.882968    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b82294f4-7eff-4ae6-8671-422adccd8825-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4\" (UID: \"b82294f4-7eff-4ae6-8671-422adccd8825\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"
Sep 18 19:48:51.883356 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.883338    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b82294f4-7eff-4ae6-8671-422adccd8825-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4\" (UID: \"b82294f4-7eff-4ae6-8671-422adccd8825\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"
Sep 18 19:48:51.883390 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.883372    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b82294f4-7eff-4ae6-8671-422adccd8825-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4\" (UID: \"b82294f4-7eff-4ae6-8671-422adccd8825\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"
Sep 18 19:48:51.883802 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.883783    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"]
Sep 18 19:48:51.887407 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.887393    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"
Sep 18 19:48:51.891950 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.891918    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4vn9\" (UniqueName: \"kubernetes.io/projected/b82294f4-7eff-4ae6-8671-422adccd8825-kube-api-access-r4vn9\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4\" (UID: \"b82294f4-7eff-4ae6-8671-422adccd8825\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"
Sep 18 19:48:51.894329 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.894306    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"]
Sep 18 19:48:51.984158 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.984067    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hcrh\" (UniqueName: \"kubernetes.io/projected/2526775b-5a0a-46c3-a21e-71af6bd3375a-kube-api-access-6hcrh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks\" (UID: \"2526775b-5a0a-46c3-a21e-71af6bd3375a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"
Sep 18 19:48:51.984158 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.984143    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89d2900d-d013-409a-8ab1-2b0831693a4e-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6\" (UID: \"89d2900d-d013-409a-8ab1-2b0831693a4e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"
Sep 18 19:48:51.984413 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.984179    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89d2900d-d013-409a-8ab1-2b0831693a4e-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6\" (UID: \"89d2900d-d013-409a-8ab1-2b0831693a4e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"
Sep 18 19:48:51.984413 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.984232    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7dtp\" (UniqueName: \"kubernetes.io/projected/89d2900d-d013-409a-8ab1-2b0831693a4e-kube-api-access-v7dtp\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6\" (UID: \"89d2900d-d013-409a-8ab1-2b0831693a4e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"
Sep 18 19:48:51.984413 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.984295    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2526775b-5a0a-46c3-a21e-71af6bd3375a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks\" (UID: \"2526775b-5a0a-46c3-a21e-71af6bd3375a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"
Sep 18 19:48:51.984413 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.984318    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2526775b-5a0a-46c3-a21e-71af6bd3375a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks\" (UID: \"2526775b-5a0a-46c3-a21e-71af6bd3375a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"
Sep 18 19:48:51.984768 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.984744    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2526775b-5a0a-46c3-a21e-71af6bd3375a-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks\" (UID: \"2526775b-5a0a-46c3-a21e-71af6bd3375a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"
Sep 18 19:48:51.984867 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.984829    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2526775b-5a0a-46c3-a21e-71af6bd3375a-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks\" (UID: \"2526775b-5a0a-46c3-a21e-71af6bd3375a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"
Sep 18 19:48:51.986862 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.986842    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"]
Sep 18 19:48:51.990388 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.990371    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"
Sep 18 19:48:51.992641 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.992621    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hcrh\" (UniqueName: \"kubernetes.io/projected/2526775b-5a0a-46c3-a21e-71af6bd3375a-kube-api-access-6hcrh\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks\" (UID: \"2526775b-5a0a-46c3-a21e-71af6bd3375a\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"
Sep 18 19:48:51.997713 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:51.997696    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"
Sep 18 19:48:52.000652 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.000628    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"]
Sep 18 19:48:52.085613 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.085579    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d66j5\" (UniqueName: \"kubernetes.io/projected/44dccd84-d8d5-4092-8ed7-65c137199af3-kube-api-access-d66j5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp\" (UID: \"44dccd84-d8d5-4092-8ed7-65c137199af3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"
Sep 18 19:48:52.085784 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.085641    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89d2900d-d013-409a-8ab1-2b0831693a4e-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6\" (UID: \"89d2900d-d013-409a-8ab1-2b0831693a4e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"
Sep 18 19:48:52.085784 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.085676    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89d2900d-d013-409a-8ab1-2b0831693a4e-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6\" (UID: \"89d2900d-d013-409a-8ab1-2b0831693a4e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"
Sep 18 19:48:52.085784 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.085749    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7dtp\" (UniqueName: \"kubernetes.io/projected/89d2900d-d013-409a-8ab1-2b0831693a4e-kube-api-access-v7dtp\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6\" (UID: \"89d2900d-d013-409a-8ab1-2b0831693a4e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"
Sep 18 19:48:52.085784 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.085778    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44dccd84-d8d5-4092-8ed7-65c137199af3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp\" (UID: \"44dccd84-d8d5-4092-8ed7-65c137199af3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"
Sep 18 19:48:52.086014 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.085831    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44dccd84-d8d5-4092-8ed7-65c137199af3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp\" (UID: \"44dccd84-d8d5-4092-8ed7-65c137199af3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"
Sep 18 19:48:52.086119 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.086102    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89d2900d-d013-409a-8ab1-2b0831693a4e-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6\" (UID: \"89d2900d-d013-409a-8ab1-2b0831693a4e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"
Sep 18 19:48:52.086365 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.086340    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89d2900d-d013-409a-8ab1-2b0831693a4e-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6\" (UID: \"89d2900d-d013-409a-8ab1-2b0831693a4e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"
Sep 18 19:48:52.095249 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.095225    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7dtp\" (UniqueName: \"kubernetes.io/projected/89d2900d-d013-409a-8ab1-2b0831693a4e-kube-api-access-v7dtp\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6\" (UID: \"89d2900d-d013-409a-8ab1-2b0831693a4e\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"
Sep 18 19:48:52.103136 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.103119    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"
Sep 18 19:48:52.186930 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.186901    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d66j5\" (UniqueName: \"kubernetes.io/projected/44dccd84-d8d5-4092-8ed7-65c137199af3-kube-api-access-d66j5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp\" (UID: \"44dccd84-d8d5-4092-8ed7-65c137199af3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"
Sep 18 19:48:52.187076 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.186963    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44dccd84-d8d5-4092-8ed7-65c137199af3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp\" (UID: \"44dccd84-d8d5-4092-8ed7-65c137199af3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"
Sep 18 19:48:52.187076 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.186996    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44dccd84-d8d5-4092-8ed7-65c137199af3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp\" (UID: \"44dccd84-d8d5-4092-8ed7-65c137199af3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"
Sep 18 19:48:52.187360 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.187344    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44dccd84-d8d5-4092-8ed7-65c137199af3-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp\" (UID: \"44dccd84-d8d5-4092-8ed7-65c137199af3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"
Sep 18 19:48:52.187447 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.187425    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44dccd84-d8d5-4092-8ed7-65c137199af3-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp\" (UID: \"44dccd84-d8d5-4092-8ed7-65c137199af3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"
Sep 18 19:48:52.195343 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.195324    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d66j5\" (UniqueName: \"kubernetes.io/projected/44dccd84-d8d5-4092-8ed7-65c137199af3-kube-api-access-d66j5\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp\" (UID: \"44dccd84-d8d5-4092-8ed7-65c137199af3\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"
Sep 18 19:48:52.206199 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.206184    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"
Sep 18 19:48:52.275941 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.275916    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"]
Sep 18 19:48:52.279231 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:48:52.279207    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb82294f4_7eff_4ae6_8671_422adccd8825.slice/crio-5adfb948fca933a18812176f6bba60202c739eb171a5772097487cd14b9051ef WatchSource:0}: Error finding container 5adfb948fca933a18812176f6bba60202c739eb171a5772097487cd14b9051ef: Status 404 returned error can't find the container with id 5adfb948fca933a18812176f6bba60202c739eb171a5772097487cd14b9051ef
Sep 18 19:48:52.325937 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.325915    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"
Sep 18 19:48:52.381802 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.381730    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"]
Sep 18 19:48:52.386974 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:48:52.386492    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2526775b_5a0a_46c3_a21e_71af6bd3375a.slice/crio-0959f73a27557275d4e2ca4fd88883901372310c79535f21d741c7d944a36415 WatchSource:0}: Error finding container 0959f73a27557275d4e2ca4fd88883901372310c79535f21d741c7d944a36415: Status 404 returned error can't find the container with id 0959f73a27557275d4e2ca4fd88883901372310c79535f21d741c7d944a36415
Sep 18 19:48:52.488107 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.488080    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"]
Sep 18 19:48:52.489426 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:48:52.489401    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d2900d_d013_409a_8ab1_2b0831693a4e.slice/crio-a19c90901345906e83405a679ce9f1e7d7c323a07d8da528ba8e295de3a26cbc WatchSource:0}: Error finding container a19c90901345906e83405a679ce9f1e7d7c323a07d8da528ba8e295de3a26cbc: Status 404 returned error can't find the container with id a19c90901345906e83405a679ce9f1e7d7c323a07d8da528ba8e295de3a26cbc
Sep 18 19:48:52.601719 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:52.601696    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"]
Sep 18 19:48:52.604422 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:48:52.604399    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44dccd84_d8d5_4092_8ed7_65c137199af3.slice/crio-5a59059f5bbb567ac1616031cb1611577546531c412f82a8a4d7ed78a8219d38 WatchSource:0}: Error finding container 5a59059f5bbb567ac1616031cb1611577546531c412f82a8a4d7ed78a8219d38: Status 404 returned error can't find the container with id 5a59059f5bbb567ac1616031cb1611577546531c412f82a8a4d7ed78a8219d38
Sep 18 19:48:53.075755 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:53.075722    2583 generic.go:356] "Generic (PLEG): container finished" podID="44dccd84-d8d5-4092-8ed7-65c137199af3" containerID="18f44ba9fc6071826c15b3c6c6979ace36b3111cac9c759b929cf9dea0152b5d" exitCode=0
Sep 18 19:48:53.076194 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:53.075809    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp" event={"ID":"44dccd84-d8d5-4092-8ed7-65c137199af3","Type":"ContainerDied","Data":"18f44ba9fc6071826c15b3c6c6979ace36b3111cac9c759b929cf9dea0152b5d"}
Sep 18 19:48:53.076194 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:53.075867    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp" event={"ID":"44dccd84-d8d5-4092-8ed7-65c137199af3","Type":"ContainerStarted","Data":"5a59059f5bbb567ac1616031cb1611577546531c412f82a8a4d7ed78a8219d38"}
Sep 18 19:48:53.077581 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:53.077559    2583 generic.go:356] "Generic (PLEG): container finished" podID="2526775b-5a0a-46c3-a21e-71af6bd3375a" containerID="e16e33da3ad0d0378c87c117431178fd7c5c6be0300ed9ab8493a0211c75fd83" exitCode=0
Sep 18 19:48:53.077666 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:53.077644    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks" event={"ID":"2526775b-5a0a-46c3-a21e-71af6bd3375a","Type":"ContainerDied","Data":"e16e33da3ad0d0378c87c117431178fd7c5c6be0300ed9ab8493a0211c75fd83"}
Sep 18 19:48:53.077717 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:53.077687    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks" event={"ID":"2526775b-5a0a-46c3-a21e-71af6bd3375a","Type":"ContainerStarted","Data":"0959f73a27557275d4e2ca4fd88883901372310c79535f21d741c7d944a36415"}
Sep 18 19:48:53.079348 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:53.079321    2583 generic.go:356] "Generic (PLEG): container finished" podID="b82294f4-7eff-4ae6-8671-422adccd8825" containerID="79fad00ed5d7fb7770987980225f5ada6577f70b13c044e15c87dd65ec815b26" exitCode=0
Sep 18 19:48:53.079448 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:53.079404    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4" event={"ID":"b82294f4-7eff-4ae6-8671-422adccd8825","Type":"ContainerDied","Data":"79fad00ed5d7fb7770987980225f5ada6577f70b13c044e15c87dd65ec815b26"}
Sep 18 19:48:53.079514 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:53.079451    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4" event={"ID":"b82294f4-7eff-4ae6-8671-422adccd8825","Type":"ContainerStarted","Data":"5adfb948fca933a18812176f6bba60202c739eb171a5772097487cd14b9051ef"}
Sep 18 19:48:53.081088 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:53.081070    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6" event={"ID":"89d2900d-d013-409a-8ab1-2b0831693a4e","Type":"ContainerDied","Data":"c74bd94b0641a9d2cf4aa11f532495fa51909c153cf5c5aca0cc50b1ae37b325"}
Sep 18 19:48:53.081145 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:53.081073    2583 generic.go:356] "Generic (PLEG): container finished" podID="89d2900d-d013-409a-8ab1-2b0831693a4e" containerID="c74bd94b0641a9d2cf4aa11f532495fa51909c153cf5c5aca0cc50b1ae37b325" exitCode=0
Sep 18 19:48:53.081145 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:53.081132    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6" event={"ID":"89d2900d-d013-409a-8ab1-2b0831693a4e","Type":"ContainerStarted","Data":"a19c90901345906e83405a679ce9f1e7d7c323a07d8da528ba8e295de3a26cbc"}
Sep 18 19:48:54.090667 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:54.090631    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp" event={"ID":"44dccd84-d8d5-4092-8ed7-65c137199af3","Type":"ContainerStarted","Data":"3dd3b06ad395d7b41b965dd05c50e48e0fe753a33de9817ac1c643e6d8edc96b"}
Sep 18 19:48:54.092514 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:54.092489    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6" event={"ID":"89d2900d-d013-409a-8ab1-2b0831693a4e","Type":"ContainerStarted","Data":"b970a07b6d7fe0e5dd346aa320bb7bce2f13362a82d5d19d4f556583f2d08a4e"}
Sep 18 19:48:55.099066 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:55.099010    2583 generic.go:356] "Generic (PLEG): container finished" podID="2526775b-5a0a-46c3-a21e-71af6bd3375a" containerID="66d181006e730973921e5ca86401b1f79eef466608f463e9e2df5bed1e45cbe8" exitCode=0
Sep 18 19:48:55.099497 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:55.099077    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks" event={"ID":"2526775b-5a0a-46c3-a21e-71af6bd3375a","Type":"ContainerDied","Data":"66d181006e730973921e5ca86401b1f79eef466608f463e9e2df5bed1e45cbe8"}
Sep 18 19:48:55.100885 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:55.100866    2583 generic.go:356] "Generic (PLEG): container finished" podID="b82294f4-7eff-4ae6-8671-422adccd8825" containerID="6f40eb80f828c24b2cc2f90977dc353f30bd257754c9f33480cd3ec15db253c6" exitCode=0
Sep 18 19:48:55.100982 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:55.100962    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4" event={"ID":"b82294f4-7eff-4ae6-8671-422adccd8825","Type":"ContainerDied","Data":"6f40eb80f828c24b2cc2f90977dc353f30bd257754c9f33480cd3ec15db253c6"}
Sep 18 19:48:55.102927 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:55.102908    2583 generic.go:356] "Generic (PLEG): container finished" podID="89d2900d-d013-409a-8ab1-2b0831693a4e" containerID="b970a07b6d7fe0e5dd346aa320bb7bce2f13362a82d5d19d4f556583f2d08a4e" exitCode=0
Sep 18 19:48:55.103005 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:55.102967    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6" event={"ID":"89d2900d-d013-409a-8ab1-2b0831693a4e","Type":"ContainerDied","Data":"b970a07b6d7fe0e5dd346aa320bb7bce2f13362a82d5d19d4f556583f2d08a4e"}
Sep 18 19:48:55.104984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:55.104967    2583 generic.go:356] "Generic (PLEG): container finished" podID="44dccd84-d8d5-4092-8ed7-65c137199af3" containerID="3dd3b06ad395d7b41b965dd05c50e48e0fe753a33de9817ac1c643e6d8edc96b" exitCode=0
Sep 18 19:48:55.105079 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:55.105021    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp" event={"ID":"44dccd84-d8d5-4092-8ed7-65c137199af3","Type":"ContainerDied","Data":"3dd3b06ad395d7b41b965dd05c50e48e0fe753a33de9817ac1c643e6d8edc96b"}
Sep 18 19:48:56.111760 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:56.111729    2583 generic.go:356] "Generic (PLEG): container finished" podID="44dccd84-d8d5-4092-8ed7-65c137199af3" containerID="1b558f9ac18c126e58aa6ed7b98d3e5044ad07598bdfb63d7c2dbb28f6d58069" exitCode=0
Sep 18 19:48:56.112169 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:56.111815    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp" event={"ID":"44dccd84-d8d5-4092-8ed7-65c137199af3","Type":"ContainerDied","Data":"1b558f9ac18c126e58aa6ed7b98d3e5044ad07598bdfb63d7c2dbb28f6d58069"}
Sep 18 19:48:56.113936 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:56.113913    2583 generic.go:356] "Generic (PLEG): container finished" podID="2526775b-5a0a-46c3-a21e-71af6bd3375a" containerID="a2ede539081534bebafd2f1bcce91a18e6fe76ba8937035940c710a14b6980e2" exitCode=0
Sep 18 19:48:56.114091 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:56.113990    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks" event={"ID":"2526775b-5a0a-46c3-a21e-71af6bd3375a","Type":"ContainerDied","Data":"a2ede539081534bebafd2f1bcce91a18e6fe76ba8937035940c710a14b6980e2"}
Sep 18 19:48:56.116028 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:56.116006    2583 generic.go:356] "Generic (PLEG): container finished" podID="b82294f4-7eff-4ae6-8671-422adccd8825" containerID="1ccc50bcedc478bc4ce40c6553d2652ee23a8fe9939c549427ec091be8778a45" exitCode=0
Sep 18 19:48:56.116162 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:56.116093    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4" event={"ID":"b82294f4-7eff-4ae6-8671-422adccd8825","Type":"ContainerDied","Data":"1ccc50bcedc478bc4ce40c6553d2652ee23a8fe9939c549427ec091be8778a45"}
Sep 18 19:48:56.118161 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:56.118142    2583 generic.go:356] "Generic (PLEG): container finished" podID="89d2900d-d013-409a-8ab1-2b0831693a4e" containerID="3e0ec9419f2dc80b890e2277feac76b6a9acdd9d57c93147241d0fa5760f5cee" exitCode=0
Sep 18 19:48:56.118273 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:56.118201    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6" event={"ID":"89d2900d-d013-409a-8ab1-2b0831693a4e","Type":"ContainerDied","Data":"3e0ec9419f2dc80b890e2277feac76b6a9acdd9d57c93147241d0fa5760f5cee"}
Sep 18 19:48:57.281724 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.281699    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"
Sep 18 19:48:57.300177 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.300153    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"
Sep 18 19:48:57.331188 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.331160    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"
Sep 18 19:48:57.337664 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.337644    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"
Sep 18 19:48:57.434683 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.434604    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4vn9\" (UniqueName: \"kubernetes.io/projected/b82294f4-7eff-4ae6-8671-422adccd8825-kube-api-access-r4vn9\") pod \"b82294f4-7eff-4ae6-8671-422adccd8825\" (UID: \"b82294f4-7eff-4ae6-8671-422adccd8825\") "
Sep 18 19:48:57.434683 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.434633    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7dtp\" (UniqueName: \"kubernetes.io/projected/89d2900d-d013-409a-8ab1-2b0831693a4e-kube-api-access-v7dtp\") pod \"89d2900d-d013-409a-8ab1-2b0831693a4e\" (UID: \"89d2900d-d013-409a-8ab1-2b0831693a4e\") "
Sep 18 19:48:57.434683 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.434682    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b82294f4-7eff-4ae6-8671-422adccd8825-bundle\") pod \"b82294f4-7eff-4ae6-8671-422adccd8825\" (UID: \"b82294f4-7eff-4ae6-8671-422adccd8825\") "
Sep 18 19:48:57.434906 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.434697    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hcrh\" (UniqueName: \"kubernetes.io/projected/2526775b-5a0a-46c3-a21e-71af6bd3375a-kube-api-access-6hcrh\") pod \"2526775b-5a0a-46c3-a21e-71af6bd3375a\" (UID: \"2526775b-5a0a-46c3-a21e-71af6bd3375a\") "
Sep 18 19:48:57.434906 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.434713    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89d2900d-d013-409a-8ab1-2b0831693a4e-util\") pod \"89d2900d-d013-409a-8ab1-2b0831693a4e\" (UID: \"89d2900d-d013-409a-8ab1-2b0831693a4e\") "
Sep 18 19:48:57.434906 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.434776    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2526775b-5a0a-46c3-a21e-71af6bd3375a-bundle\") pod \"2526775b-5a0a-46c3-a21e-71af6bd3375a\" (UID: \"2526775b-5a0a-46c3-a21e-71af6bd3375a\") "
Sep 18 19:48:57.435083 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.434932    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89d2900d-d013-409a-8ab1-2b0831693a4e-bundle\") pod \"89d2900d-d013-409a-8ab1-2b0831693a4e\" (UID: \"89d2900d-d013-409a-8ab1-2b0831693a4e\") "
Sep 18 19:48:57.435083 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.434984    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b82294f4-7eff-4ae6-8671-422adccd8825-util\") pod \"b82294f4-7eff-4ae6-8671-422adccd8825\" (UID: \"b82294f4-7eff-4ae6-8671-422adccd8825\") "
Sep 18 19:48:57.435083 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.435013    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2526775b-5a0a-46c3-a21e-71af6bd3375a-util\") pod \"2526775b-5a0a-46c3-a21e-71af6bd3375a\" (UID: \"2526775b-5a0a-46c3-a21e-71af6bd3375a\") "
Sep 18 19:48:57.435684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.435650    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b82294f4-7eff-4ae6-8671-422adccd8825-bundle" (OuterVolumeSpecName: "bundle") pod "b82294f4-7eff-4ae6-8671-422adccd8825" (UID: "b82294f4-7eff-4ae6-8671-422adccd8825"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:48:57.435958 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.435904    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d2900d-d013-409a-8ab1-2b0831693a4e-bundle" (OuterVolumeSpecName: "bundle") pod "89d2900d-d013-409a-8ab1-2b0831693a4e" (UID: "89d2900d-d013-409a-8ab1-2b0831693a4e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:48:57.436107 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.436022    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2526775b-5a0a-46c3-a21e-71af6bd3375a-bundle" (OuterVolumeSpecName: "bundle") pod "2526775b-5a0a-46c3-a21e-71af6bd3375a" (UID: "2526775b-5a0a-46c3-a21e-71af6bd3375a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:48:57.437312 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.437286    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89d2900d-d013-409a-8ab1-2b0831693a4e-kube-api-access-v7dtp" (OuterVolumeSpecName: "kube-api-access-v7dtp") pod "89d2900d-d013-409a-8ab1-2b0831693a4e" (UID: "89d2900d-d013-409a-8ab1-2b0831693a4e"). InnerVolumeSpecName "kube-api-access-v7dtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:48:57.437566 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.437314    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2526775b-5a0a-46c3-a21e-71af6bd3375a-kube-api-access-6hcrh" (OuterVolumeSpecName: "kube-api-access-6hcrh") pod "2526775b-5a0a-46c3-a21e-71af6bd3375a" (UID: "2526775b-5a0a-46c3-a21e-71af6bd3375a"). InnerVolumeSpecName "kube-api-access-6hcrh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:48:57.437808 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.437793    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b82294f4-7eff-4ae6-8671-422adccd8825-kube-api-access-r4vn9" (OuterVolumeSpecName: "kube-api-access-r4vn9") pod "b82294f4-7eff-4ae6-8671-422adccd8825" (UID: "b82294f4-7eff-4ae6-8671-422adccd8825"). InnerVolumeSpecName "kube-api-access-r4vn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:48:57.442013 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.441985    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2526775b-5a0a-46c3-a21e-71af6bd3375a-util" (OuterVolumeSpecName: "util") pod "2526775b-5a0a-46c3-a21e-71af6bd3375a" (UID: "2526775b-5a0a-46c3-a21e-71af6bd3375a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:48:57.444274 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.444250    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d2900d-d013-409a-8ab1-2b0831693a4e-util" (OuterVolumeSpecName: "util") pod "89d2900d-d013-409a-8ab1-2b0831693a4e" (UID: "89d2900d-d013-409a-8ab1-2b0831693a4e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:48:57.444507 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.444490    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b82294f4-7eff-4ae6-8671-422adccd8825-util" (OuterVolumeSpecName: "util") pod "b82294f4-7eff-4ae6-8671-422adccd8825" (UID: "b82294f4-7eff-4ae6-8671-422adccd8825"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:48:57.536594 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.536566    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44dccd84-d8d5-4092-8ed7-65c137199af3-util\") pod \"44dccd84-d8d5-4092-8ed7-65c137199af3\" (UID: \"44dccd84-d8d5-4092-8ed7-65c137199af3\") "
Sep 18 19:48:57.536667 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.536600    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44dccd84-d8d5-4092-8ed7-65c137199af3-bundle\") pod \"44dccd84-d8d5-4092-8ed7-65c137199af3\" (UID: \"44dccd84-d8d5-4092-8ed7-65c137199af3\") "
Sep 18 19:48:57.536667 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.536661    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d66j5\" (UniqueName: \"kubernetes.io/projected/44dccd84-d8d5-4092-8ed7-65c137199af3-kube-api-access-d66j5\") pod \"44dccd84-d8d5-4092-8ed7-65c137199af3\" (UID: \"44dccd84-d8d5-4092-8ed7-65c137199af3\") "
Sep 18 19:48:57.536916 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.536900    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b82294f4-7eff-4ae6-8671-422adccd8825-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:48:57.536952 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.536924    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hcrh\" (UniqueName: \"kubernetes.io/projected/2526775b-5a0a-46c3-a21e-71af6bd3375a-kube-api-access-6hcrh\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:48:57.536952 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.536939    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/89d2900d-d013-409a-8ab1-2b0831693a4e-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:48:57.537016 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.536951    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2526775b-5a0a-46c3-a21e-71af6bd3375a-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:48:57.537016 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.536963    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/89d2900d-d013-409a-8ab1-2b0831693a4e-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:48:57.537016 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.536975    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b82294f4-7eff-4ae6-8671-422adccd8825-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:48:57.537016 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.536986    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2526775b-5a0a-46c3-a21e-71af6bd3375a-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:48:57.537016 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.536998    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4vn9\" (UniqueName: \"kubernetes.io/projected/b82294f4-7eff-4ae6-8671-422adccd8825-kube-api-access-r4vn9\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:48:57.537016 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.537011    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7dtp\" (UniqueName: \"kubernetes.io/projected/89d2900d-d013-409a-8ab1-2b0831693a4e-kube-api-access-v7dtp\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:48:57.537243 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.537100    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dccd84-d8d5-4092-8ed7-65c137199af3-bundle" (OuterVolumeSpecName: "bundle") pod "44dccd84-d8d5-4092-8ed7-65c137199af3" (UID: "44dccd84-d8d5-4092-8ed7-65c137199af3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:48:57.538470 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.538450    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44dccd84-d8d5-4092-8ed7-65c137199af3-kube-api-access-d66j5" (OuterVolumeSpecName: "kube-api-access-d66j5") pod "44dccd84-d8d5-4092-8ed7-65c137199af3" (UID: "44dccd84-d8d5-4092-8ed7-65c137199af3"). InnerVolumeSpecName "kube-api-access-d66j5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:48:57.541987 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.541969    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44dccd84-d8d5-4092-8ed7-65c137199af3-util" (OuterVolumeSpecName: "util") pod "44dccd84-d8d5-4092-8ed7-65c137199af3" (UID: "44dccd84-d8d5-4092-8ed7-65c137199af3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:48:57.637330 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.637307    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d66j5\" (UniqueName: \"kubernetes.io/projected/44dccd84-d8d5-4092-8ed7-65c137199af3-kube-api-access-d66j5\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:48:57.637330 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.637328    2583 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44dccd84-d8d5-4092-8ed7-65c137199af3-util\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:48:57.637448 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:57.637337    2583 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44dccd84-d8d5-4092-8ed7-65c137199af3-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:48:58.130380 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:58.130355    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks"
Sep 18 19:48:58.130567 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:58.130346    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7vmhks" event={"ID":"2526775b-5a0a-46c3-a21e-71af6bd3375a","Type":"ContainerDied","Data":"0959f73a27557275d4e2ca4fd88883901372310c79535f21d741c7d944a36415"}
Sep 18 19:48:58.130567 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:58.130485    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0959f73a27557275d4e2ca4fd88883901372310c79535f21d741c7d944a36415"
Sep 18 19:48:58.132447 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:58.132400    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4"
Sep 18 19:48:58.132447 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:58.132410    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6d9lx4" event={"ID":"b82294f4-7eff-4ae6-8671-422adccd8825","Type":"ContainerDied","Data":"5adfb948fca933a18812176f6bba60202c739eb171a5772097487cd14b9051ef"}
Sep 18 19:48:58.132647 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:58.132452    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5adfb948fca933a18812176f6bba60202c739eb171a5772097487cd14b9051ef"
Sep 18 19:48:58.134648 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:58.134627    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6"
Sep 18 19:48:58.134761 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:58.134663    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847arv5q6" event={"ID":"89d2900d-d013-409a-8ab1-2b0831693a4e","Type":"ContainerDied","Data":"a19c90901345906e83405a679ce9f1e7d7c323a07d8da528ba8e295de3a26cbc"}
Sep 18 19:48:58.134761 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:58.134697    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a19c90901345906e83405a679ce9f1e7d7c323a07d8da528ba8e295de3a26cbc"
Sep 18 19:48:58.136732 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:58.136710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp" event={"ID":"44dccd84-d8d5-4092-8ed7-65c137199af3","Type":"ContainerDied","Data":"5a59059f5bbb567ac1616031cb1611577546531c412f82a8a4d7ed78a8219d38"}
Sep 18 19:48:58.136853 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:58.136744    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a59059f5bbb567ac1616031cb1611577546531c412f82a8a4d7ed78a8219d38"
Sep 18 19:48:58.136853 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:48:58.136748    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czg5wp"
Sep 18 19:49:02.148336 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:02.148299    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:02.959015 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:02.958980    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:03.746814 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:03.746784    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:06.027597 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:06.027560    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:06.121116 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:06.121053    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:07.386453 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:07.386422    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:08.405425 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:08.405396    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:09.153122 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:09.153092    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:09.556519 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:09.556438    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:11.430156 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:11.430122    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:12.155737 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:12.155699    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:13.067418 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:13.067385    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:13.201462 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:13.201431    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:14.560621 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:14.560568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:14.994233 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:14.994190    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:17.155818 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:17.155772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:17.220532 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:17.220485    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:17.349617 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:17.349573    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:17.414291 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:17.414197    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:17.550195 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:17.550168    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:17.609938 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:17.609910    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:17.962890 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:17.962852    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:18.029200 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:18.029171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:19.709206 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:19.709178    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 19:49:19.709722 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:19.709394    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 19:49:23.749183 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:23.749150    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:23.850164 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:23.850125    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:30.172829 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:30.172796    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:31.375535 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:31.375501    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:31.703657 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:31.703532    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:33.168437 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:33.168397    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:33.269521 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:33.269481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:38.382250 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:38.382206    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:38.483463 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:38.483431    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:38.788489 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:38.788409    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:38.891321 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:38.891287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:38.989660 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:38.989628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:39.094391 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:39.094364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:41.812592 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:41.812559    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68c4dfdd56-chnql"]
Sep 18 19:49:41.931763 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:41.931736    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:42.031190 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:42.031160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:42.132835 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:42.132806    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:45.439882 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:45.439853    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:45.498187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:45.498158    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:51.977206 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:51.977174    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:52.077833 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:52.077804    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:54.066923 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:54.066890    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:54.340027 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:54.339998    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:54.974276 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:54.974238    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:55.078766 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:55.078733    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:58.859481 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:58.859446    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:59.011090 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:59.011034    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:59.103654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:59.103623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:59.713169 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:59.713139    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:49:59.815838 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:49:59.815808    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:06.833671 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:06.833610    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-68c4dfdd56-chnql" podUID="b0ccc004-0d6e-44d8-ac73-7b98dd1d201d" containerName="console" containerID="cri-o://86bdc2106c33d808630334145b497b051f7a065b3a137e40c141c3f4d71b5fa0" gracePeriod=15
Sep 18 19:50:07.084707 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.084656    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:50:07.127653 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.127629    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-service-ca\") pod \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") "
Sep 18 19:50:07.127653 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.127657    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-oauth-serving-cert\") pod \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") "
Sep 18 19:50:07.127869 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.127684    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-serving-cert\") pod \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") "
Sep 18 19:50:07.127869 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.127762    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-oauth-config\") pod \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") "
Sep 18 19:50:07.127869 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.127806    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-trusted-ca-bundle\") pod \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") "
Sep 18 19:50:07.127869 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.127835    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vr9w9\" (UniqueName: \"kubernetes.io/projected/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-kube-api-access-vr9w9\") pod \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") "
Sep 18 19:50:07.127869 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.127868    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-config\") pod \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\" (UID: \"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d\") "
Sep 18 19:50:07.128169 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.127988    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b0ccc004-0d6e-44d8-ac73-7b98dd1d201d" (UID: "b0ccc004-0d6e-44d8-ac73-7b98dd1d201d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:50:07.128169 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.128157    2583 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-oauth-serving-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:50:07.128278 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.128193    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-service-ca" (OuterVolumeSpecName: "service-ca") pod "b0ccc004-0d6e-44d8-ac73-7b98dd1d201d" (UID: "b0ccc004-0d6e-44d8-ac73-7b98dd1d201d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:50:07.128384 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.128356    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b0ccc004-0d6e-44d8-ac73-7b98dd1d201d" (UID: "b0ccc004-0d6e-44d8-ac73-7b98dd1d201d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:50:07.128485 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.128401    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-config" (OuterVolumeSpecName: "console-config") pod "b0ccc004-0d6e-44d8-ac73-7b98dd1d201d" (UID: "b0ccc004-0d6e-44d8-ac73-7b98dd1d201d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:50:07.130119 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.130087    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-kube-api-access-vr9w9" (OuterVolumeSpecName: "kube-api-access-vr9w9") pod "b0ccc004-0d6e-44d8-ac73-7b98dd1d201d" (UID: "b0ccc004-0d6e-44d8-ac73-7b98dd1d201d"). InnerVolumeSpecName "kube-api-access-vr9w9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:50:07.130226 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.130206    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b0ccc004-0d6e-44d8-ac73-7b98dd1d201d" (UID: "b0ccc004-0d6e-44d8-ac73-7b98dd1d201d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:50:07.130271 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.130221    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b0ccc004-0d6e-44d8-ac73-7b98dd1d201d" (UID: "b0ccc004-0d6e-44d8-ac73-7b98dd1d201d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 19:50:07.229423 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.229395    2583 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:50:07.229423 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.229417    2583 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-serving-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:50:07.229423 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.229427    2583 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-oauth-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:50:07.229612 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.229436    2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-trusted-ca-bundle\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:50:07.229612 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.229445    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr9w9\" (UniqueName: \"kubernetes.io/projected/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-kube-api-access-vr9w9\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:50:07.229612 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.229452    2583 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d-console-config\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:50:07.496035 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.495950    2583 generic.go:356] "Generic (PLEG): container finished" podID="b0ccc004-0d6e-44d8-ac73-7b98dd1d201d" containerID="86bdc2106c33d808630334145b497b051f7a065b3a137e40c141c3f4d71b5fa0" exitCode=0
Sep 18 19:50:07.496035 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.495996    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68c4dfdd56-chnql"
Sep 18 19:50:07.496035 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.496015    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c4dfdd56-chnql" event={"ID":"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d","Type":"ContainerDied","Data":"86bdc2106c33d808630334145b497b051f7a065b3a137e40c141c3f4d71b5fa0"}
Sep 18 19:50:07.496346 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.496068    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68c4dfdd56-chnql" event={"ID":"b0ccc004-0d6e-44d8-ac73-7b98dd1d201d","Type":"ContainerDied","Data":"7679c6da23183e7f653d77cb15f1a95650d2a4dc9b6be7e362af62331f517c5f"}
Sep 18 19:50:07.496346 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.496092    2583 scope.go:117] "RemoveContainer" containerID="86bdc2106c33d808630334145b497b051f7a065b3a137e40c141c3f4d71b5fa0"
Sep 18 19:50:07.505048 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.505023    2583 scope.go:117] "RemoveContainer" containerID="86bdc2106c33d808630334145b497b051f7a065b3a137e40c141c3f4d71b5fa0"
Sep 18 19:50:07.505313 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:50:07.505297    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86bdc2106c33d808630334145b497b051f7a065b3a137e40c141c3f4d71b5fa0\": container with ID starting with 86bdc2106c33d808630334145b497b051f7a065b3a137e40c141c3f4d71b5fa0 not found: ID does not exist" containerID="86bdc2106c33d808630334145b497b051f7a065b3a137e40c141c3f4d71b5fa0"
Sep 18 19:50:07.505353 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.505323    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86bdc2106c33d808630334145b497b051f7a065b3a137e40c141c3f4d71b5fa0"} err="failed to get container status \"86bdc2106c33d808630334145b497b051f7a065b3a137e40c141c3f4d71b5fa0\": rpc error: code = NotFound desc = could not find container \"86bdc2106c33d808630334145b497b051f7a065b3a137e40c141c3f4d71b5fa0\": container with ID starting with 86bdc2106c33d808630334145b497b051f7a065b3a137e40c141c3f4d71b5fa0 not found: ID does not exist"
Sep 18 19:50:07.518216 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.518193    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68c4dfdd56-chnql"]
Sep 18 19:50:07.521595 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.521576    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68c4dfdd56-chnql"]
Sep 18 19:50:07.816136 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:07.816059    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ccc004-0d6e-44d8-ac73-7b98dd1d201d" path="/var/lib/kubelet/pods/b0ccc004-0d6e-44d8-ac73-7b98dd1d201d/volumes"
Sep 18 19:50:14.958824 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:14.958790    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:15.052972 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:15.052942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:15.449555 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:15.449523    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:27.304952 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:27.304920    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:27.637550 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:27.637520    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:34.077727 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:34.077690    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:34.186392 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:34.186360    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:34.257587 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:34.257556    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:34.384299 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:34.384269    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:34.485311 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:34.485262    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:35.151947 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:35.151917    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:37.683436 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:37.683402    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:37.785188 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:37.785157    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:41.372953 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:41.372920    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:50:41.474579 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:50:41.474545    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:09.216860 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:09.216823    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:09.318387 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:09.318338    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:10.676168 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:10.676137    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:10.776594 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:10.776563    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:11.043511 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:11.043438    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:11.247142 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:11.247108    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:11.346873 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:11.346846    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:11.438688 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:11.438650    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:19.279010 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:19.278973    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:19.333275 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:19.333242    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:22.272953 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:22.272923    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:22.337232 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:22.337200    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:32.680522 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680488    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"]
Sep 18 19:51:32.680898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680838    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44dccd84-d8d5-4092-8ed7-65c137199af3" containerName="util"
Sep 18 19:51:32.680898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680851    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="44dccd84-d8d5-4092-8ed7-65c137199af3" containerName="util"
Sep 18 19:51:32.680898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680859    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44dccd84-d8d5-4092-8ed7-65c137199af3" containerName="extract"
Sep 18 19:51:32.680898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680864    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="44dccd84-d8d5-4092-8ed7-65c137199af3" containerName="extract"
Sep 18 19:51:32.680898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680875    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ccc004-0d6e-44d8-ac73-7b98dd1d201d" containerName="console"
Sep 18 19:51:32.680898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680880    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ccc004-0d6e-44d8-ac73-7b98dd1d201d" containerName="console"
Sep 18 19:51:32.680898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680886    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89d2900d-d013-409a-8ab1-2b0831693a4e" containerName="pull"
Sep 18 19:51:32.680898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680893    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="89d2900d-d013-409a-8ab1-2b0831693a4e" containerName="pull"
Sep 18 19:51:32.680898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680898    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82294f4-7eff-4ae6-8671-422adccd8825" containerName="extract"
Sep 18 19:51:32.680898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680903    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82294f4-7eff-4ae6-8671-422adccd8825" containerName="extract"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680912    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82294f4-7eff-4ae6-8671-422adccd8825" containerName="util"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680918    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82294f4-7eff-4ae6-8671-422adccd8825" containerName="util"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680926    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b82294f4-7eff-4ae6-8671-422adccd8825" containerName="pull"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680930    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b82294f4-7eff-4ae6-8671-422adccd8825" containerName="pull"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680937    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44dccd84-d8d5-4092-8ed7-65c137199af3" containerName="pull"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680942    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="44dccd84-d8d5-4092-8ed7-65c137199af3" containerName="pull"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680947    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2526775b-5a0a-46c3-a21e-71af6bd3375a" containerName="pull"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680952    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2526775b-5a0a-46c3-a21e-71af6bd3375a" containerName="pull"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680958    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89d2900d-d013-409a-8ab1-2b0831693a4e" containerName="util"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680963    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="89d2900d-d013-409a-8ab1-2b0831693a4e" containerName="util"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680970    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2526775b-5a0a-46c3-a21e-71af6bd3375a" containerName="util"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680974    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2526775b-5a0a-46c3-a21e-71af6bd3375a" containerName="util"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680981    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89d2900d-d013-409a-8ab1-2b0831693a4e" containerName="extract"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680986    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="89d2900d-d013-409a-8ab1-2b0831693a4e" containerName="extract"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680993    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2526775b-5a0a-46c3-a21e-71af6bd3375a" containerName="extract"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.680998    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2526775b-5a0a-46c3-a21e-71af6bd3375a" containerName="extract"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.681071    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b82294f4-7eff-4ae6-8671-422adccd8825" containerName="extract"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.681081    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ccc004-0d6e-44d8-ac73-7b98dd1d201d" containerName="console"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.681086    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2526775b-5a0a-46c3-a21e-71af6bd3375a" containerName="extract"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.681092    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="44dccd84-d8d5-4092-8ed7-65c137199af3" containerName="extract"
Sep 18 19:51:32.681248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.681097    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="89d2900d-d013-409a-8ab1-2b0831693a4e" containerName="extract"
Sep 18 19:51:32.684098 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.684082    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.687574 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.687549    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 18 19:51:32.687726 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.687615    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 18 19:51:32.687726 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.687631    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 18 19:51:32.687726 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.687634    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2md6r\""
Sep 18 19:51:32.693470 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.693446    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"]
Sep 18 19:51:32.704097 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.704052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:32.847648 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.847609    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d1c6d04-a770-446d-8f03-fd1883e4d36d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.847821 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.847661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jl52\" (UniqueName: \"kubernetes.io/projected/1d1c6d04-a770-446d-8f03-fd1883e4d36d-kube-api-access-6jl52\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.847821 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.847681    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d1c6d04-a770-446d-8f03-fd1883e4d36d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.847821 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.847703    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1c6d04-a770-446d-8f03-fd1883e4d36d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.847821 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.847748    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d1c6d04-a770-446d-8f03-fd1883e4d36d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.847821 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.847781    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d1c6d04-a770-446d-8f03-fd1883e4d36d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.948539 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.948452    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d1c6d04-a770-446d-8f03-fd1883e4d36d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.948539 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.948494    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1c6d04-a770-446d-8f03-fd1883e4d36d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.948735 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.948619    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d1c6d04-a770-446d-8f03-fd1883e4d36d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.948735 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.948664    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d1c6d04-a770-446d-8f03-fd1883e4d36d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.948840 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.948732    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d1c6d04-a770-446d-8f03-fd1883e4d36d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.948897 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.948873    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jl52\" (UniqueName: \"kubernetes.io/projected/1d1c6d04-a770-446d-8f03-fd1883e4d36d-kube-api-access-6jl52\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.948948 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.948906    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d1c6d04-a770-446d-8f03-fd1883e4d36d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.949006 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.948981    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d1c6d04-a770-446d-8f03-fd1883e4d36d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.949152 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.949133    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d1c6d04-a770-446d-8f03-fd1883e4d36d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.950892 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.950867    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d1c6d04-a770-446d-8f03-fd1883e4d36d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.951133 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.951117    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1c6d04-a770-446d-8f03-fd1883e4d36d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.956246 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.956222    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jl52\" (UniqueName: \"kubernetes.io/projected/1d1c6d04-a770-446d-8f03-fd1883e4d36d-kube-api-access-6jl52\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl\" (UID: \"1d1c6d04-a770-446d-8f03-fd1883e4d36d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:32.995910 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:32.995871    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:33.276159 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:33.276131    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"]
Sep 18 19:51:33.277731 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:51:33.277710    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d1c6d04_a770_446d_8f03_fd1883e4d36d.slice/crio-9116cd0ca2a696d7a76331a89639f2d3be9468f5a3c0c086aa2490324b4154b9 WatchSource:0}: Error finding container 9116cd0ca2a696d7a76331a89639f2d3be9468f5a3c0c086aa2490324b4154b9: Status 404 returned error can't find the container with id 9116cd0ca2a696d7a76331a89639f2d3be9468f5a3c0c086aa2490324b4154b9
Sep 18 19:51:33.278988 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:33.278972    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 19:51:33.934532 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:33.934493    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl" event={"ID":"1d1c6d04-a770-446d-8f03-fd1883e4d36d","Type":"ContainerStarted","Data":"9116cd0ca2a696d7a76331a89639f2d3be9468f5a3c0c086aa2490324b4154b9"}
Sep 18 19:51:34.941525 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:34.941489    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl" event={"ID":"1d1c6d04-a770-446d-8f03-fd1883e4d36d","Type":"ContainerStarted","Data":"f5e51853ff50633e48c6c88d75a8fabb101eca771723e8684f064cf4940a427a"}
Sep 18 19:51:34.959154 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:34.959106    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl" podStartSLOduration=1.829270111 podStartE2EDuration="2.959089294s" totalImagesPullingTime="1.129819183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:51:34.957375383 +0000 UTC m=+737.284469148" watchObservedRunningTime="2026-09-18 19:51:34.959089294 +0000 UTC m=+737.286183058"
Sep 18 19:51:36.693316 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:36.693285    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:41.470018 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.469985    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"]
Sep 18 19:51:41.474138 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.474113    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.477213 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.477188    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 18 19:51:41.486715 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.486676    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"]
Sep 18 19:51:41.501741 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.501700    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:51:41.524122 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.524092    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.524284 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.524146    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.524284 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.524190    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.524284 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.524230    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmcpm\" (UniqueName: \"kubernetes.io/projected/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-kube-api-access-rmcpm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.524284 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.524287    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.524518 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.524319    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.625366 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.625329    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.625366 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.625376    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.625633 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.625394    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmcpm\" (UniqueName: \"kubernetes.io/projected/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-kube-api-access-rmcpm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.625633 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.625413    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.625633 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.625440    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.625633 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.625468    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.625842 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.625788    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.625842 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.625802    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.625932 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.625874    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.627716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.627686    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.627954 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.627939    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.633205 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.633185    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmcpm\" (UniqueName: \"kubernetes.io/projected/f1c0f1bc-78e5-4868-9825-751b16a2a5a3-kube-api-access-rmcpm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd\" (UID: \"f1c0f1bc-78e5-4868-9825-751b16a2a5a3\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:41.787617 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:41.787519    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:42.060635 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:42.060605    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"]
Sep 18 19:51:42.062311 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:51:42.062286    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c0f1bc_78e5_4868_9825_751b16a2a5a3.slice/crio-f29b82bdfc9c9e0558dd74517679e1c5e11c317655d33c30b8b3429842d74d45 WatchSource:0}: Error finding container f29b82bdfc9c9e0558dd74517679e1c5e11c317655d33c30b8b3429842d74d45: Status 404 returned error can't find the container with id f29b82bdfc9c9e0558dd74517679e1c5e11c317655d33c30b8b3429842d74d45
Sep 18 19:51:42.985476 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:42.985443    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd" event={"ID":"f1c0f1bc-78e5-4868-9825-751b16a2a5a3","Type":"ContainerStarted","Data":"48e19c9867ebca9d65e9accff9b873b7044a18f99c8bcd5427855cac3b013b2f"}
Sep 18 19:51:42.985961 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:42.985490    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd" event={"ID":"f1c0f1bc-78e5-4868-9825-751b16a2a5a3","Type":"ContainerStarted","Data":"f29b82bdfc9c9e0558dd74517679e1c5e11c317655d33c30b8b3429842d74d45"}
Sep 18 19:51:42.996095 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:42.996070    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:42.996216 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:42.996116    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:43.008832 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:43.008810    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:43.010422 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:43.010383    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd" podStartSLOduration=1.8196210069999998 podStartE2EDuration="2.010370514s" totalImagesPullingTime="190.749507ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:51:43.009687898 +0000 UTC m=+745.336781664" watchObservedRunningTime="2026-09-18 19:51:43.010370514 +0000 UTC m=+745.337464323"
Sep 18 19:51:44.001077 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:44.001049    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl"
Sep 18 19:51:51.787866 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:51.787814    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:51.788287 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:51.787927    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:51.800396 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:51.800374    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:51:52.054006 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:51:52.053928    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd"
Sep 18 19:52:07.807487 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:52:07.807448    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:52:24.596654 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:52:24.596625    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:52:36.981060 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:52:36.980967    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:52:39.707235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:52:39.707201    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:52:54.471267 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:52:54.471237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:53:23.070204 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:53:23.070173    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:53:23.124748 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:53:23.124721    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:53:59.669018 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:53:59.668986    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:53:59.781405 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:53:59.781373    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:00.704467 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:00.704436    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:00.805501 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:00.805469    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:17.979317 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:17.979283    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:18.040240 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.040208    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:18.102645 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.102613    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:18.280480 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.280410    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"]
Sep 18 19:54:18.283905 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.283890    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.286651 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.286632    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-674263-openshift-default-dockercfg-6swtn\""
Sep 18 19:54:18.298280 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.298259    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"]
Sep 18 19:54:18.310190 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.310162    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:18.359296 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.359263    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"]
Sep 18 19:54:18.362697 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.362678    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.365438 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.365417    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d6291d-openshift-default-dockercfg-wwc5l\""
Sep 18 19:54:18.378666 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.378643    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"]
Sep 18 19:54:18.381276 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.381255    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-credential-socket\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.381378 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.381350    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59dd6c56-1408-480d-847c-ca28e133e492-istio-podinfo\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.381434 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.381396    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59dd6c56-1408-480d-847c-ca28e133e492-istiod-ca-cert\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.381483 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.381464    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-istio-data\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.381523 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.381493    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59dd6c56-1408-480d-847c-ca28e133e492-istio-token\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.381558 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.381522    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-workload-socket\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.381558 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.381542    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-workload-certs\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.381621 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.381563    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-istio-envoy\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.381621 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.381589    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nsmf\" (UniqueName: \"kubernetes.io/projected/59dd6c56-1408-480d-847c-ca28e133e492-kube-api-access-7nsmf\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.406705 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.406680    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:18.455831 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.455801    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"]
Sep 18 19:54:18.459235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.459216    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.464641 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.464606    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-d94b9e-openshift-default-dockercfg-tpzlr\""
Sep 18 19:54:18.473538 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.473504    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"]
Sep 18 19:54:18.482562 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.482540    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-workload-socket\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.482664 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.482571    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-credential-socket\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.482664 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.482605    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59dd6c56-1408-480d-847c-ca28e133e492-istiod-ca-cert\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.482796 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.482669    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m9bl\" (UniqueName: \"kubernetes.io/projected/346b626a-3590-441b-bdfd-77ce92b3de45-kube-api-access-5m9bl\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.482796 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.482708    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-istio-data\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.482796 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.482726    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59dd6c56-1408-480d-847c-ca28e133e492-istio-token\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.482796 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.482747    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-workload-socket\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.482796 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.482768    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-workload-certs\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.482796 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.482782    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-istio-envoy\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.483141 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.482800    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nsmf\" (UniqueName: \"kubernetes.io/projected/59dd6c56-1408-480d-847c-ca28e133e492-kube-api-access-7nsmf\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.483141 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.482824    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-istio-envoy\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.483141 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.482852    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-istio-data\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.483141 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.482985    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-credential-socket\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.483141 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.483030    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-istio-data\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.483141 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.483107    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/346b626a-3590-441b-bdfd-77ce92b3de45-istio-token\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.483465 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.483175    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/346b626a-3590-441b-bdfd-77ce92b3de45-istiod-ca-cert\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.483465 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.483185    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-workload-certs\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.483465 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.483226    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-workload-certs\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.483465 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.483280    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59dd6c56-1408-480d-847c-ca28e133e492-istio-podinfo\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.483465 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.483306    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/346b626a-3590-441b-bdfd-77ce92b3de45-istio-podinfo\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.483465 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.483397    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59dd6c56-1408-480d-847c-ca28e133e492-istiod-ca-cert\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.483465 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.483425    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-workload-socket\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.483465 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.483454    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-credential-socket\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.485829 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.485808    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-istio-envoy\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.486173 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.486154    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59dd6c56-1408-480d-847c-ca28e133e492-istio-podinfo\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.500089 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.500067    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nsmf\" (UniqueName: \"kubernetes.io/projected/59dd6c56-1408-480d-847c-ca28e133e492-kube-api-access-7nsmf\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.504487 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.504462    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59dd6c56-1408-480d-847c-ca28e133e492-istio-token\") pod \"e2e-worker-w4-674263-openshift-default-6644996b96-mpjct\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") " pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.511342 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.511317    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:18.576646 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.576550    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:18.584714 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.584686    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxdm7\" (UniqueName: \"kubernetes.io/projected/321193d0-1af6-4ab1-a058-8a551ea80092-kube-api-access-rxdm7\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.584855 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.584722    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-istio-envoy\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.584855 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.584748    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-istio-envoy\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.584855 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.584810    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-istio-data\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.584971 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.584852    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/321193d0-1af6-4ab1-a058-8a551ea80092-istio-token\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.584971 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.584918    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/346b626a-3590-441b-bdfd-77ce92b3de45-istio-token\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.584971 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.584945    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-istio-data\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.585111 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.584976    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/346b626a-3590-441b-bdfd-77ce92b3de45-istiod-ca-cert\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.585111 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.585059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-workload-certs\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.585211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.585113    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/346b626a-3590-441b-bdfd-77ce92b3de45-istio-podinfo\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.585211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.585138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-workload-socket\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.585211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.585171    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-credential-socket\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.585211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.585198    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-credential-socket\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.585488 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.585253    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-istio-data\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.585565 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.585530    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-workload-socket\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.585672 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.585651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-workload-certs\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.585763 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.585676    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/346b626a-3590-441b-bdfd-77ce92b3de45-istiod-ca-cert\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.585763 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.585749    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-workload-socket\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.585876 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.585772    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-workload-certs\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.585876 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.585781    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/321193d0-1af6-4ab1-a058-8a551ea80092-istio-podinfo\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.585876 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.585844    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m9bl\" (UniqueName: \"kubernetes.io/projected/346b626a-3590-441b-bdfd-77ce92b3de45-kube-api-access-5m9bl\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.586069 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.585886    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/321193d0-1af6-4ab1-a058-8a551ea80092-istiod-ca-cert\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.586945 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.586920    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-credential-socket\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.587490 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.587468    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-istio-envoy\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.588170 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.588148    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/346b626a-3590-441b-bdfd-77ce92b3de45-istio-podinfo\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.595361 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.594949    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/346b626a-3590-441b-bdfd-77ce92b3de45-istio-token\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.595361 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.595179    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:18.596907 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.596887    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m9bl\" (UniqueName: \"kubernetes.io/projected/346b626a-3590-441b-bdfd-77ce92b3de45-kube-api-access-5m9bl\") pod \"e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") " pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.674491 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.674463    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:18.686985 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.686962    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-credential-socket\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.687182 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.687001    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-workload-certs\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.687182 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.687157    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-workload-socket\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.687314 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.687199    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/321193d0-1af6-4ab1-a058-8a551ea80092-istio-podinfo\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.687314 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.687229    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/321193d0-1af6-4ab1-a058-8a551ea80092-istiod-ca-cert\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.687314 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.687277    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxdm7\" (UniqueName: \"kubernetes.io/projected/321193d0-1af6-4ab1-a058-8a551ea80092-kube-api-access-rxdm7\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.687314 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.687306    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-istio-envoy\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.687586 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.687340    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/321193d0-1af6-4ab1-a058-8a551ea80092-istio-token\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.687586 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.687399    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-istio-data\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.687586 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.687422    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-workload-certs\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.687586 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.687451    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-credential-socket\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.687586 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.687487    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-workload-socket\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.687846 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.687703    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-istio-data\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.688356 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.688336    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/321193d0-1af6-4ab1-a058-8a551ea80092-istiod-ca-cert\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.689846 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.689822    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-istio-envoy\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.690418 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.690398    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/321193d0-1af6-4ab1-a058-8a551ea80092-istio-podinfo\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.695928 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.695904    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/321193d0-1af6-4ab1-a058-8a551ea80092-istio-token\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.696231 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.696210    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxdm7\" (UniqueName: \"kubernetes.io/projected/321193d0-1af6-4ab1-a058-8a551ea80092-kube-api-access-rxdm7\") pod \"e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") " pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.769866 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.769837    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:18.836745 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.836619    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:18.878288 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.878263    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"]
Sep 18 19:54:18.879631 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:54:18.879605    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59dd6c56_1408_480d_847c_ca28e133e492.slice/crio-bcb96601d5ffaa9e5853cfa592dc84f10bd5e69945097de8cac0528db6fade06 WatchSource:0}: Error finding container bcb96601d5ffaa9e5853cfa592dc84f10bd5e69945097de8cac0528db6fade06: Status 404 returned error can't find the container with id bcb96601d5ffaa9e5853cfa592dc84f10bd5e69945097de8cac0528db6fade06
Sep 18 19:54:18.882023 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.881994    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:18.882136 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.882070    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:18.882136 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.882099    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:18.933907 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.933878    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:18.948150 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.948126    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"]
Sep 18 19:54:18.949320 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:54:18.949293    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod346b626a_3590_441b_bdfd_77ce92b3de45.slice/crio-622ce673c453ef7e93e1c58f4ee03add3ba7ecacf6311695741ad4d87832b5ad WatchSource:0}: Error finding container 622ce673c453ef7e93e1c58f4ee03add3ba7ecacf6311695741ad4d87832b5ad: Status 404 returned error can't find the container with id 622ce673c453ef7e93e1c58f4ee03add3ba7ecacf6311695741ad4d87832b5ad
Sep 18 19:54:18.951590 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.951552    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:18.951684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.951638    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:18.951729 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:18.951681    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:19.047797 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.047767    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"]
Sep 18 19:54:19.049399 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:54:19.049369    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod321193d0_1af6_4ab1_a058_8a551ea80092.slice/crio-3270291258ade57077dd1d50fe86deae7a6e46b5842043a194c289bb4ef98120 WatchSource:0}: Error finding container 3270291258ade57077dd1d50fe86deae7a6e46b5842043a194c289bb4ef98120: Status 404 returned error can't find the container with id 3270291258ade57077dd1d50fe86deae7a6e46b5842043a194c289bb4ef98120
Sep 18 19:54:19.051748 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.051704    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:19.051838 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.051794    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:19.051882 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.051837    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:19.328676 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.328624    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:19.431737 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.431643    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:19.748121 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.748021    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 19:54:19.749614 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.749584    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 19:54:19.754309 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.754284    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:19.811299 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.811266    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" event={"ID":"59dd6c56-1408-480d-847c-ca28e133e492","Type":"ContainerStarted","Data":"8c88b92427faec31130b462ddc3836844fe235fb1e4c677266abe6dbb9d4c20e"}
Sep 18 19:54:19.811438 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.811326    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" event={"ID":"59dd6c56-1408-480d-847c-ca28e133e492","Type":"ContainerStarted","Data":"bcb96601d5ffaa9e5853cfa592dc84f10bd5e69945097de8cac0528db6fade06"}
Sep 18 19:54:19.811438 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.811351    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" event={"ID":"346b626a-3590-441b-bdfd-77ce92b3de45","Type":"ContainerStarted","Data":"b6a3fdb547289613856cd06e76334f2c517e0edc95d8797d8190a947673b919e"}
Sep 18 19:54:19.811438 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.811374    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" event={"ID":"346b626a-3590-441b-bdfd-77ce92b3de45","Type":"ContainerStarted","Data":"622ce673c453ef7e93e1c58f4ee03add3ba7ecacf6311695741ad4d87832b5ad"}
Sep 18 19:54:19.812718 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.812697    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" event={"ID":"321193d0-1af6-4ab1-a058-8a551ea80092","Type":"ContainerStarted","Data":"1db0b5496f219a63632f23dbac4fb12ef25069787f0ca020e6e3440811e2a66f"}
Sep 18 19:54:19.812828 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.812730    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" event={"ID":"321193d0-1af6-4ab1-a058-8a551ea80092","Type":"ContainerStarted","Data":"3270291258ade57077dd1d50fe86deae7a6e46b5842043a194c289bb4ef98120"}
Sep 18 19:54:19.833605 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.833557    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" podStartSLOduration=1.8335432109999998 podStartE2EDuration="1.833543211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:19.831758518 +0000 UTC m=+902.158852282" watchObservedRunningTime="2026-09-18 19:54:19.833543211 +0000 UTC m=+902.160636974"
Sep 18 19:54:19.854058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.853993    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" podStartSLOduration=1.853977242 podStartE2EDuration="1.853977242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:19.852723016 +0000 UTC m=+902.179816865" watchObservedRunningTime="2026-09-18 19:54:19.853977242 +0000 UTC m=+902.181071005"
Sep 18 19:54:19.877989 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:19.877932    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" podStartSLOduration=1.8779158969999998 podStartE2EDuration="1.877915897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:19.87362869 +0000 UTC m=+902.200722454" watchObservedRunningTime="2026-09-18 19:54:19.877915897 +0000 UTC m=+902.205009661"
Sep 18 19:54:20.596118 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:20.596087    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:20.600765 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:20.600740    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:20.675664 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:20.675634    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:20.680201 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:20.680176    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:20.770371 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:20.770338    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:20.775212 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:20.775187    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:20.819355 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:20.819291    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:20.819355 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:20.819341    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:20.819355 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:20.819366    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:20.819983 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:20.819962    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:20.820126 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:20.820114    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:20.820197 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:20.820171    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:21.826847 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:21.826822    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:22.089857 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:22.089828    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:22.231960 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:22.231929    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:22.351874 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:22.351786    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:23.643628 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:23.643597    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:23.746031 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:23.745999    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:23.845268 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:23.845213    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:24.174488 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.174463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:24.275065 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.274990    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:24.287295 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.287241    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"]
Sep 18 19:54:24.290983 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.290965    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"
Sep 18 19:54:24.294140 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.294121    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-d6291d-dockercfg-nd2pp\""
Sep 18 19:54:24.294495 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.294478    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-d6291d\""
Sep 18 19:54:24.304653 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.304629    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"]
Sep 18 19:54:24.440458 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.440374    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58a5cba7-e1e6-4101-bc8b-0a974ef75041-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z\" (UID: \"58a5cba7-e1e6-4101-bc8b-0a974ef75041\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"
Sep 18 19:54:24.440458 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.440420    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5rzq\" (UniqueName: \"kubernetes.io/projected/58a5cba7-e1e6-4101-bc8b-0a974ef75041-kube-api-access-s5rzq\") pod \"payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z\" (UID: \"58a5cba7-e1e6-4101-bc8b-0a974ef75041\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"
Sep 18 19:54:24.541404 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.541371    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58a5cba7-e1e6-4101-bc8b-0a974ef75041-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z\" (UID: \"58a5cba7-e1e6-4101-bc8b-0a974ef75041\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"
Sep 18 19:54:24.541576 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.541412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5rzq\" (UniqueName: \"kubernetes.io/projected/58a5cba7-e1e6-4101-bc8b-0a974ef75041-kube-api-access-s5rzq\") pod \"payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z\" (UID: \"58a5cba7-e1e6-4101-bc8b-0a974ef75041\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"
Sep 18 19:54:24.542161 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.542141    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58a5cba7-e1e6-4101-bc8b-0a974ef75041-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z\" (UID: \"58a5cba7-e1e6-4101-bc8b-0a974ef75041\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"
Sep 18 19:54:24.549821 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.549802    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5rzq\" (UniqueName: \"kubernetes.io/projected/58a5cba7-e1e6-4101-bc8b-0a974ef75041-kube-api-access-s5rzq\") pod \"payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z\" (UID: \"58a5cba7-e1e6-4101-bc8b-0a974ef75041\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"
Sep 18 19:54:24.602211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.602173    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"
Sep 18 19:54:24.698344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.698228    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:24.798972 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.798927    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:24.880234 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.880203    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"]
Sep 18 19:54:24.881592 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:24.881496    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:24.881776 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:54:24.881753    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58a5cba7_e1e6_4101_bc8b_0a974ef75041.slice/crio-389cc7c442530b6e864dff0c14b38e8bc2e27ac201e5d7dd71c56e1f8dcb6868 WatchSource:0}: Error finding container 389cc7c442530b6e864dff0c14b38e8bc2e27ac201e5d7dd71c56e1f8dcb6868: Status 404 returned error can't find the container with id 389cc7c442530b6e864dff0c14b38e8bc2e27ac201e5d7dd71c56e1f8dcb6868
Sep 18 19:54:25.274675 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.274645    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:25.364657 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.364627    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:25.380300 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.380268    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"]
Sep 18 19:54:25.384897 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.384873    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"
Sep 18 19:54:25.387671 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.387645    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-674263\""
Sep 18 19:54:25.387879 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.387866    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-674263-dockercfg-9zfvk\""
Sep 18 19:54:25.394267 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.394244    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"]
Sep 18 19:54:25.450425 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.450395    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9fpq\" (UniqueName: \"kubernetes.io/projected/30f387e2-bba9-4cc8-a083-c76caf24002d-kube-api-access-j9fpq\") pod \"payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl\" (UID: \"30f387e2-bba9-4cc8-a083-c76caf24002d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"
Sep 18 19:54:25.450606 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.450433    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30f387e2-bba9-4cc8-a083-c76caf24002d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl\" (UID: \"30f387e2-bba9-4cc8-a083-c76caf24002d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"
Sep 18 19:54:25.551206 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.550946    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9fpq\" (UniqueName: \"kubernetes.io/projected/30f387e2-bba9-4cc8-a083-c76caf24002d-kube-api-access-j9fpq\") pod \"payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl\" (UID: \"30f387e2-bba9-4cc8-a083-c76caf24002d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"
Sep 18 19:54:25.551206 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.551009    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30f387e2-bba9-4cc8-a083-c76caf24002d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl\" (UID: \"30f387e2-bba9-4cc8-a083-c76caf24002d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"
Sep 18 19:54:25.551941 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.551915    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30f387e2-bba9-4cc8-a083-c76caf24002d-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl\" (UID: \"30f387e2-bba9-4cc8-a083-c76caf24002d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"
Sep 18 19:54:25.559766 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.559741    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9fpq\" (UniqueName: \"kubernetes.io/projected/30f387e2-bba9-4cc8-a083-c76caf24002d-kube-api-access-j9fpq\") pod \"payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl\" (UID: \"30f387e2-bba9-4cc8-a083-c76caf24002d\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"
Sep 18 19:54:25.697609 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.697577    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"
Sep 18 19:54:25.817327 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.817241    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:25.846235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.846200    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z" event={"ID":"58a5cba7-e1e6-4101-bc8b-0a974ef75041","Type":"ContainerStarted","Data":"389cc7c442530b6e864dff0c14b38e8bc2e27ac201e5d7dd71c56e1f8dcb6868"}
Sep 18 19:54:25.886813 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.886762    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:25.990684 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:25.990658    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"]
Sep 18 19:54:26.047789 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.047761    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:26.277196 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:54:26.277158    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30f387e2_bba9_4cc8_a083_c76caf24002d.slice/crio-b276227d402f1ddd2bf7c8622d1a550f046bc7bce0adc67ca4bf47dc19864a46 WatchSource:0}: Error finding container b276227d402f1ddd2bf7c8622d1a550f046bc7bce0adc67ca4bf47dc19864a46: Status 404 returned error can't find the container with id b276227d402f1ddd2bf7c8622d1a550f046bc7bce0adc67ca4bf47dc19864a46
Sep 18 19:54:26.401998 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.401970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:26.496514 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.496444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:26.595074 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.595051    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:26.767512 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.767477    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:26.853140 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.853068    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"]
Sep 18 19:54:26.856791 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.856771    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"
Sep 18 19:54:26.856930 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.856799    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"
Sep 18 19:54:26.856930 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.856818    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl" event={"ID":"30f387e2-bba9-4cc8-a083-c76caf24002d","Type":"ContainerStarted","Data":"73d350d8bc3e8543194b77458d51969b4017c40158c472ece627cfeb165fa150"}
Sep 18 19:54:26.856930 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.856843    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl" event={"ID":"30f387e2-bba9-4cc8-a083-c76caf24002d","Type":"ContainerStarted","Data":"b276227d402f1ddd2bf7c8622d1a550f046bc7bce0adc67ca4bf47dc19864a46"}
Sep 18 19:54:26.856930 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.856865    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z" event={"ID":"58a5cba7-e1e6-4101-bc8b-0a974ef75041","Type":"ContainerStarted","Data":"a7e82e4f3905efb693214af97b453cc31b2903b7b850040a26d45b34c6e7c055"}
Sep 18 19:54:26.856930 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.856881    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:26.859647 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.859625    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-1d073e-openshift-default-dockercfg-fvldn\""
Sep 18 19:54:26.886794 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.886770    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"]
Sep 18 19:54:26.931865 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.931821    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl" podStartSLOduration=1.5480848520000001 podStartE2EDuration="1.931807645s" totalImagesPullingTime="383.722793ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:26.888131395 +0000 UTC m=+909.215225160" watchObservedRunningTime="2026-09-18 19:54:26.931807645 +0000 UTC m=+909.258901413"
Sep 18 19:54:26.962338 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.962308    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:26.963125 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.963087    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z" podStartSLOduration=1.522539061 podStartE2EDuration="2.9630733s" totalImagesPullingTime="1.440534239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:26.96133586 +0000 UTC m=+909.288429632" watchObservedRunningTime="2026-09-18 19:54:26.9630733 +0000 UTC m=+909.290167064"
Sep 18 19:54:26.964526 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.964499    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-credential-socket\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:26.964637 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.964552    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-data\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:26.964637 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.964615    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-workload-certs\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:26.964714 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.964661    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istiod-ca-cert\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:26.964750 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.964709    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-envoy\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:26.964750 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.964735    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-podinfo\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:26.964827 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.964761    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dhq5\" (UniqueName: \"kubernetes.io/projected/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-kube-api-access-6dhq5\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:26.964827 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.964786    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-workload-socket\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:26.964979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:26.964956    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-token\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.065667 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.065607    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"]
Sep 18 19:54:27.066064 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.066017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-data\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.066185 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.066114    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-workload-certs\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.066185 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.066142    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istiod-ca-cert\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.066185 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.066176    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-envoy\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.066389 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.066199    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-podinfo\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.066389 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.066228    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dhq5\" (UniqueName: \"kubernetes.io/projected/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-kube-api-access-6dhq5\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.066389 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.066255    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-workload-socket\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.066389 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.066304    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-token\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.066389 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.066373    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-credential-socket\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.067022 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.066802    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-credential-socket\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.067154 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.067064    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-workload-socket\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.067541 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.067446    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-workload-certs\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.067644 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.067603    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-data\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.068298 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.068251    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istiod-ca-cert\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.068926 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.068895    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:27.069532 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.069510    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-envoy\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.069998 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.069961    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-podinfo\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.071659 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.071639    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.074399 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.074379    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-6c083038-openshift-default-dockercfg-xxk59\""
Sep 18 19:54:27.082332 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.082305    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"]
Sep 18 19:54:27.083468 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.083447    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-token\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.085011 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.084987    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dhq5\" (UniqueName: \"kubernetes.io/projected/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-kube-api-access-6dhq5\") pod \"e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") " pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.160443 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.160412    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:27.166540 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.166513    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:27.166888 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.166867    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-workload-socket\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.166973 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.166939    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzxzr\" (UniqueName: \"kubernetes.io/projected/46a9c749-d04c-4471-a0be-062813c96b03-kube-api-access-pzxzr\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.167088 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.167064    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46a9c749-d04c-4471-a0be-062813c96b03-istio-podinfo\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.167272 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.167111    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-credential-socket\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.167272 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.167138    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-istio-envoy\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.167272 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.167163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46a9c749-d04c-4471-a0be-062813c96b03-istiod-ca-cert\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.167272 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.167191    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-workload-certs\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.167272 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.167213    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-istio-data\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.167778 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.167501    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46a9c749-d04c-4471-a0be-062813c96b03-istio-token\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.258466 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.258432    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:27.269162 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.269079    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-workload-socket\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.269162 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.269127    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzxzr\" (UniqueName: \"kubernetes.io/projected/46a9c749-d04c-4471-a0be-062813c96b03-kube-api-access-pzxzr\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.269394 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.269332    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46a9c749-d04c-4471-a0be-062813c96b03-istio-podinfo\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.269394 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.269384    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-credential-socket\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.269503 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.269411    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-istio-envoy\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.269503 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.269447    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46a9c749-d04c-4471-a0be-062813c96b03-istiod-ca-cert\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.269503 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.269485    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-workload-certs\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.269668 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.269511    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-istio-data\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.269668 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.269541    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46a9c749-d04c-4471-a0be-062813c96b03-istio-token\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.269668 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.269657    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-workload-socket\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.271026 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.270024    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-workload-certs\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.271026 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.270138    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-istio-data\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.271026 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.270361    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-credential-socket\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.271289 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.271138    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46a9c749-d04c-4471-a0be-062813c96b03-istiod-ca-cert\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.275741 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.275718    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46a9c749-d04c-4471-a0be-062813c96b03-istio-podinfo\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.276465 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.276424    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-istio-envoy\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.280288 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.280248    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46a9c749-d04c-4471-a0be-062813c96b03-istio-token\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.282312 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.282286    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzxzr\" (UniqueName: \"kubernetes.io/projected/46a9c749-d04c-4471-a0be-062813c96b03-kube-api-access-pzxzr\") pod \"e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") " pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.412033 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.411943    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:27.448967 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:54:27.448934    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7e1bb1_dd14_47b0_829d_2a648ca9e8e5.slice/crio-07ff2bb4a1104b40d49d3f03fc5a5cb6bba9d219f6bb7561382825753cab1c66 WatchSource:0}: Error finding container 07ff2bb4a1104b40d49d3f03fc5a5cb6bba9d219f6bb7561382825753cab1c66: Status 404 returned error can't find the container with id 07ff2bb4a1104b40d49d3f03fc5a5cb6bba9d219f6bb7561382825753cab1c66
Sep 18 19:54:27.449779 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.449750    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"]
Sep 18 19:54:27.451879 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.451830    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:27.451983 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.451913    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:27.451983 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.451963    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:27.697326 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.697296    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"]
Sep 18 19:54:27.702786 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.702750    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:27.702879 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.702831    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:27.702879 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.702867    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:27.764779 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.764728    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:27.867766 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.867729    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6" event={"ID":"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5","Type":"ContainerStarted","Data":"43eb11a82e953e7ce0ac8316f06393905b6c4144e2eb15b45092a64bbc8a6893"}
Sep 18 19:54:27.868252 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.867796    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6" event={"ID":"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5","Type":"ContainerStarted","Data":"07ff2bb4a1104b40d49d3f03fc5a5cb6bba9d219f6bb7561382825753cab1c66"}
Sep 18 19:54:27.871202 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.871172    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" event={"ID":"46a9c749-d04c-4471-a0be-062813c96b03","Type":"ContainerStarted","Data":"93bdcb174bdc0c9ee0c494842907186f99a00f9b2c47c5af0818506cbe6851a0"}
Sep 18 19:54:27.871368 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.871224    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" event={"ID":"46a9c749-d04c-4471-a0be-062813c96b03","Type":"ContainerStarted","Data":"5719f4098b8c6674e3d9f4799c1399618b8dafc4cdec7a19d4ef215e0f01220e"}
Sep 18 19:54:27.888508 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.888452    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6" podStartSLOduration=1.8884318869999999 podStartE2EDuration="1.888431887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:27.887286022 +0000 UTC m=+910.214379799" watchObservedRunningTime="2026-09-18 19:54:27.888431887 +0000 UTC m=+910.215525652"
Sep 18 19:54:27.910228 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:27.910164    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" podStartSLOduration=0.910142294 podStartE2EDuration="910.142294ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:27.908005792 +0000 UTC m=+910.235099557" watchObservedRunningTime="2026-09-18 19:54:27.910142294 +0000 UTC m=+910.237236059"
Sep 18 19:54:28.166708 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:28.166676    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:28.171417 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:28.171391    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:28.412504 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:28.412473    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:28.417892 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:28.417830    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:28.610918 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:28.610889    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:28.876462 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:28.876428    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:28.876903 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:28.876613    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:28.877363 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:28.877344    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:28.877586 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:28.877569    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:29.302109 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:29.302019    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:29.405660 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:29.405541    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:29.894655 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:29.894630    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:30.059114 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:30.059088    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:30.916339 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:30.916291    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:31.715217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:31.715182    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:33.061553 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:33.061511    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:33.175384 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:33.175346    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:33.297307 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:33.297270    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:33.679223 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:33.679170    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:34.535062 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:34.534853    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:34.600555 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:34.600522    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:34.653595 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:34.653555    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:35.003062 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:34.994439    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:35.087074 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.081847    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:35.093062 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.092854    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"]
Sep 18 19:54:35.101441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.101416    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"
Sep 18 19:54:35.104955 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.104931    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-6c083038\""
Sep 18 19:54:35.105739 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.105717    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-6c083038-dockercfg-tl56t\""
Sep 18 19:54:35.134186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.134113    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"]
Sep 18 19:54:35.183839 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.183662    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7fnq\" (UniqueName: \"kubernetes.io/projected/672e571c-04d7-4e9d-b108-dac598af9766-kube-api-access-g7fnq\") pod \"payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6\" (UID: \"672e571c-04d7-4e9d-b108-dac598af9766\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"
Sep 18 19:54:35.183839 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.183746    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/672e571c-04d7-4e9d-b108-dac598af9766-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6\" (UID: \"672e571c-04d7-4e9d-b108-dac598af9766\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"
Sep 18 19:54:35.285997 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.284429    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7fnq\" (UniqueName: \"kubernetes.io/projected/672e571c-04d7-4e9d-b108-dac598af9766-kube-api-access-g7fnq\") pod \"payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6\" (UID: \"672e571c-04d7-4e9d-b108-dac598af9766\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"
Sep 18 19:54:35.285997 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.284526    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/672e571c-04d7-4e9d-b108-dac598af9766-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6\" (UID: \"672e571c-04d7-4e9d-b108-dac598af9766\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"
Sep 18 19:54:35.285997 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.285588    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/672e571c-04d7-4e9d-b108-dac598af9766-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6\" (UID: \"672e571c-04d7-4e9d-b108-dac598af9766\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"
Sep 18 19:54:35.308821 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.308790    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7fnq\" (UniqueName: \"kubernetes.io/projected/672e571c-04d7-4e9d-b108-dac598af9766-kube-api-access-g7fnq\") pod \"payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6\" (UID: \"672e571c-04d7-4e9d-b108-dac598af9766\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"
Sep 18 19:54:35.426072 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.426019    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"
Sep 18 19:54:35.488093 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.487965    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:35.815121 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.814930    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"]
Sep 18 19:54:35.826505 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:54:35.826454    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672e571c_04d7_4e9d_b108_dac598af9766.slice/crio-58b910b3a38585c3c80eb3d79dc404defd845da8d527a5a17ec3f1e60cfbf933 WatchSource:0}: Error finding container 58b910b3a38585c3c80eb3d79dc404defd845da8d527a5a17ec3f1e60cfbf933: Status 404 returned error can't find the container with id 58b910b3a38585c3c80eb3d79dc404defd845da8d527a5a17ec3f1e60cfbf933
Sep 18 19:54:35.943065 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:35.942550    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6" event={"ID":"672e571c-04d7-4e9d-b108-dac598af9766","Type":"ContainerStarted","Data":"58b910b3a38585c3c80eb3d79dc404defd845da8d527a5a17ec3f1e60cfbf933"}
Sep 18 19:54:36.303969 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:36.303915    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:36.475153 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:36.474988    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:36.593121 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:36.588767    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:36.881327 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:36.881287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:36.953397 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:36.953341    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6" event={"ID":"672e571c-04d7-4e9d-b108-dac598af9766","Type":"ContainerStarted","Data":"b5b33a4d5baef14a2b91e80b687351c1a340a48626c68f7dadaf64fa5bcc8fe7"}
Sep 18 19:54:36.954290 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:36.954258    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"
Sep 18 19:54:36.979461 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:36.979399    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6" podStartSLOduration=1.979379184 podStartE2EDuration="1.979379184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:36.974817011 +0000 UTC m=+919.301910773" watchObservedRunningTime="2026-09-18 19:54:36.979379184 +0000 UTC m=+919.306472949"
Sep 18 19:54:36.981375 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:36.981353    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:37.080086 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.079737    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:37.147443 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.147401    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"]
Sep 18 19:54:37.154350 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.152879    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.156809 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.156537    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-d5f7da-openshift-default-dockercfg-x85zq\""
Sep 18 19:54:37.167356 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.167327    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"]
Sep 18 19:54:37.194536 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.194504    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:37.213919 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.213849    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-envoy\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.214308 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.214194    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-workload-certs\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.214308 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.214272    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwvnh\" (UniqueName: \"kubernetes.io/projected/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-kube-api-access-mwvnh\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.214616 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.214575    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-podinfo\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.214848 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.214810    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-credential-socket\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.215004 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.214970    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-data\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.215217 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.215165    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istiod-ca-cert\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.215376 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.215326    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-token\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.215611 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.215514    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-workload-socket\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.316980 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.316947    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-workload-certs\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.317187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.316995    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwvnh\" (UniqueName: \"kubernetes.io/projected/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-kube-api-access-mwvnh\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.317187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.317033    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-podinfo\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.317187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.317113    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-credential-socket\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.317187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.317138    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-data\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.317187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.317160    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istiod-ca-cert\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.317457 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.317189    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-token\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.317457 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.317231    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-workload-socket\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.317457 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.317292    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-envoy\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.317610 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.317495    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-workload-certs\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.317723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.317698    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-data\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.317808 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.317763    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-workload-socket\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.317988 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.317966    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-credential-socket\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.318310 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.318284    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istiod-ca-cert\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.320570 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.320527    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-envoy\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.320872 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.320828    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-podinfo\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.328400 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.328372    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:37.330586 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.330501    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-token\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.331491 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.331464    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwvnh\" (UniqueName: \"kubernetes.io/projected/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-kube-api-access-mwvnh\") pod \"e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") " pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.429353 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.429280    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:37.470419 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.470155    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:37.784241 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.784211    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"]
Sep 18 19:54:37.786473 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:54:37.786416    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fc34eb7_5aff_4cac_9d32_2e4a3aa608f5.slice/crio-28e4a4639670da4552c85cec39f7ef173a6703744fbcb81b146867ceb5866473 WatchSource:0}: Error finding container 28e4a4639670da4552c85cec39f7ef173a6703744fbcb81b146867ceb5866473: Status 404 returned error can't find the container with id 28e4a4639670da4552c85cec39f7ef173a6703744fbcb81b146867ceb5866473
Sep 18 19:54:37.791417 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.790284    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:37.791417 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.790378    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:37.791417 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.790419    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:37.873422 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.873379    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"
Sep 18 19:54:37.874582 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.873934    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"
Sep 18 19:54:37.978677 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.978636    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v" event={"ID":"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5","Type":"ContainerStarted","Data":"1215094e59078896ef7e9435e9d4c45f9220b0cddd45553b6df0481666b9adbb"}
Sep 18 19:54:37.979905 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:37.978703    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v" event={"ID":"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5","Type":"ContainerStarted","Data":"28e4a4639670da4552c85cec39f7ef173a6703744fbcb81b146867ceb5866473"}
Sep 18 19:54:38.470826 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:38.470785    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:38.476990 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:38.476963    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:38.503254 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:38.503190    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v" podStartSLOduration=1.503162783 podStartE2EDuration="1.503162783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:38.041241432 +0000 UTC m=+920.368335195" watchObservedRunningTime="2026-09-18 19:54:38.503162783 +0000 UTC m=+920.830256559"
Sep 18 19:54:38.511342 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:38.511293    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:38.933109 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:38.933071    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:38.985607 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:38.985573    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:38.987183 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:38.987156    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:54:39.021059 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:39.020750    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:39.164621 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:39.164592    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:39.416663 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:39.416627    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:39.832327 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:39.832300    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:39.977513 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:39.977477    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:40.119748 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:40.119657    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:40.573421 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:40.259245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:40.573421 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:40.458240    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:40.573421 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:40.551199    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:41.427825 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:41.427801    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:42.006438 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.006412    2583 generic.go:356] "Generic (PLEG): container finished" podID="59dd6c56-1408-480d-847c-ca28e133e492" containerID="8c88b92427faec31130b462ddc3836844fe235fb1e4c677266abe6dbb9d4c20e" exitCode=0
Sep 18 19:54:42.006564 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.006477    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" event={"ID":"59dd6c56-1408-480d-847c-ca28e133e492","Type":"ContainerDied","Data":"8c88b92427faec31130b462ddc3836844fe235fb1e4c677266abe6dbb9d4c20e"}
Sep 18 19:54:42.006922 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.006897    2583 scope.go:117] "RemoveContainer" containerID="8c88b92427faec31130b462ddc3836844fe235fb1e4c677266abe6dbb9d4c20e"
Sep 18 19:54:42.008227 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.008195    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:42.008307 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.008255    2583 generic.go:356] "Generic (PLEG): container finished" podID="346b626a-3590-441b-bdfd-77ce92b3de45" containerID="b6a3fdb547289613856cd06e76334f2c517e0edc95d8797d8190a947673b919e" exitCode=0
Sep 18 19:54:42.008307 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.008290    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:42.008392 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.008326    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" event={"ID":"346b626a-3590-441b-bdfd-77ce92b3de45","Type":"ContainerDied","Data":"b6a3fdb547289613856cd06e76334f2c517e0edc95d8797d8190a947673b919e"}
Sep 18 19:54:42.008392 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.008336    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:42.008643 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.008629    2583 scope.go:117] "RemoveContainer" containerID="b6a3fdb547289613856cd06e76334f2c517e0edc95d8797d8190a947673b919e"
Sep 18 19:54:42.009952 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.009801    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:42.009952 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.009880    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:42.009952 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.009939    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:42.010152 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.010136    2583 generic.go:356] "Generic (PLEG): container finished" podID="321193d0-1af6-4ab1-a058-8a551ea80092" containerID="1db0b5496f219a63632f23dbac4fb12ef25069787f0ca020e6e3440811e2a66f" exitCode=0
Sep 18 19:54:42.010221 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.010211    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" event={"ID":"321193d0-1af6-4ab1-a058-8a551ea80092","Type":"ContainerDied","Data":"1db0b5496f219a63632f23dbac4fb12ef25069787f0ca020e6e3440811e2a66f"}
Sep 18 19:54:42.010603 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.010513    2583 scope.go:117] "RemoveContainer" containerID="1db0b5496f219a63632f23dbac4fb12ef25069787f0ca020e6e3440811e2a66f"
Sep 18 19:54:42.011713 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.011681    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:42.011815 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.011760    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:42.011815 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.011802    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:42.334018 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.333858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:42.879186 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:42.879154    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:43.024149 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:43.024116    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" event={"ID":"321193d0-1af6-4ab1-a058-8a551ea80092","Type":"ContainerStarted","Data":"bfab0dcc1270bf27fc0a3f1f9f911a88c6a3e90c2e520d7af3b94f262fb9bcf6"}
Sep 18 19:54:43.028750 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:43.028457    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" event={"ID":"59dd6c56-1408-480d-847c-ca28e133e492","Type":"ContainerStarted","Data":"85667c0e34aa2716fe5013a94d88871f0fa42346b0f4edda30e9014ec1c545e1"}
Sep 18 19:54:43.032365 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:43.032336    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" event={"ID":"346b626a-3590-441b-bdfd-77ce92b3de45","Type":"ContainerStarted","Data":"068492a50b32e249aec3afeb8abd962c08d95537151b76ae2f607659137763ca"}
Sep 18 19:54:43.211406 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:43.211261    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:43.596382 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:43.596340    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:43.596604 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:43.596480    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 18 19:54:43.596604 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:43.596528    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 18 19:54:43.675460 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:43.675419    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:43.675660 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:43.675580    2583 patch_prober.go:28] interesting pod/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 18 19:54:43.675660 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:43.675640    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 18 19:54:43.770673 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:43.770262    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:43.770899 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:43.770871    2583 patch_prober.go:28] interesting pod/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 18 19:54:43.771001 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:43.770948    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 18 19:54:44.074126 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:44.073993    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:44.596914 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:44.596863    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 18 19:54:44.597158 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:44.596938    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 18 19:54:44.675321 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:44.675272    2583 patch_prober.go:28] interesting pod/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 18 19:54:44.675541 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:44.675350    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 18 19:54:44.771296 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:44.771251    2583 patch_prober.go:28] interesting pod/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 18 19:54:44.771505 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:44.771325    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 18 19:54:44.915120 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:44.914620    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:45.010612 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.010577    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:45.497063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.494409    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:45.583693 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.583661    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:45.596483 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.596449    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 18 19:54:45.596774 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.596739    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 18 19:54:45.630334 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.630295    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"]
Sep 18 19:54:45.649890 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.649857    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"]
Sep 18 19:54:45.650251 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.650229    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"
Sep 18 19:54:45.658825 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.658797    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-d5f7da\""
Sep 18 19:54:45.673073 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.660061    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-d5f7da-dockercfg-t4rq8\""
Sep 18 19:54:45.680451 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.675959    2583 patch_prober.go:28] interesting pod/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 18 19:54:45.680451 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.676016    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 18 19:54:45.763867 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.763752    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwgvb\" (UniqueName: \"kubernetes.io/projected/67bccc9d-681e-4966-ae5a-429c4c323b11-kube-api-access-xwgvb\") pod \"payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s\" (UID: \"67bccc9d-681e-4966-ae5a-429c4c323b11\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"
Sep 18 19:54:45.764281 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.764257    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67bccc9d-681e-4966-ae5a-429c4c323b11-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s\" (UID: \"67bccc9d-681e-4966-ae5a-429c4c323b11\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"
Sep 18 19:54:45.777063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.770441    2583 patch_prober.go:28] interesting pod/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 18 19:54:45.777063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.770501    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 18 19:54:45.866064 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.865375    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwgvb\" (UniqueName: \"kubernetes.io/projected/67bccc9d-681e-4966-ae5a-429c4c323b11-kube-api-access-xwgvb\") pod \"payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s\" (UID: \"67bccc9d-681e-4966-ae5a-429c4c323b11\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"
Sep 18 19:54:45.866064 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.865950    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67bccc9d-681e-4966-ae5a-429c4c323b11-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s\" (UID: \"67bccc9d-681e-4966-ae5a-429c4c323b11\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"
Sep 18 19:54:45.867401 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.867356    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67bccc9d-681e-4966-ae5a-429c4c323b11-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s\" (UID: \"67bccc9d-681e-4966-ae5a-429c4c323b11\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"
Sep 18 19:54:45.879059 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.877531    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwgvb\" (UniqueName: \"kubernetes.io/projected/67bccc9d-681e-4966-ae5a-429c4c323b11-kube-api-access-xwgvb\") pod \"payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s\" (UID: \"67bccc9d-681e-4966-ae5a-429c4c323b11\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"
Sep 18 19:54:45.904023 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.903971    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:45.992061 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:45.992002    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"
Sep 18 19:54:46.055804 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:46.055710    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:46.162119 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:46.162020    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:46.257860 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:46.257765    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:46.412743 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:46.412577    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:46.566400 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:46.564141    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"]
Sep 18 19:54:46.603061 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:46.602691    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 18 19:54:46.603061 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:46.602744    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 18 19:54:46.677065 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:46.674956    2583 patch_prober.go:28] interesting pod/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 18 19:54:46.677065 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:46.675016    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 18 19:54:46.721084 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:46.721028    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:46.775062 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:46.774458    2583 patch_prober.go:28] interesting pod/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 18 19:54:46.775062 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:46.774517    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 18 19:54:46.820611 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:46.820516    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:47.089098 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:47.086875    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s" event={"ID":"67bccc9d-681e-4966-ae5a-429c4c323b11","Type":"ContainerStarted","Data":"b48627c88676e2c058c1ee7691e5e2789841175f331ccf60c33e1684390ca430"}
Sep 18 19:54:47.089098 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:47.086993    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s" event={"ID":"67bccc9d-681e-4966-ae5a-429c4c323b11","Type":"ContainerStarted","Data":"9c720055f41359db7320bb83eca89075eb70fb9d132de23860e4b7a57b9491f7"}
Sep 18 19:54:47.089098 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:47.088004    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"
Sep 18 19:54:47.110066 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:47.109933    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s" podStartSLOduration=2.109909856 podStartE2EDuration="2.109909856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:54:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:54:47.106222265 +0000 UTC m=+929.433316029" watchObservedRunningTime="2026-09-18 19:54:47.109909856 +0000 UTC m=+929.437003621"
Sep 18 19:54:47.204658 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:47.204608    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:47.296108 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:47.296072    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:47.395374 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:47.395261    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:47.598300 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:47.597790    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 18 19:54:47.598300 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:47.597852    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 18 19:54:47.675723 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:47.675626    2583 patch_prober.go:28] interesting pod/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 18 19:54:47.675985 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:47.675955    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 18 19:54:47.770874 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:47.770839    2583 patch_prober.go:28] interesting pod/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 18 19:54:47.771179 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:47.771151    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 18 19:54:47.796689 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:47.796652    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:48.498418 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:48.498280    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:48.596936 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:48.596479    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 18 19:54:48.596936 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:48.596544    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 18 19:54:48.675480 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:48.675442    2583 patch_prober.go:28] interesting pod/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 18 19:54:48.676090 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:48.676021    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 18 19:54:48.771220 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:48.771112    2583 patch_prober.go:28] interesting pod/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 18 19:54:48.771481 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:48.771452    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 18 19:54:48.990264 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:48.989252    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"
Sep 18 19:54:49.202333 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:49.202258    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:49.595374 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:49.595317    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:49.595873 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:49.595845    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 18 19:54:49.596001 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:49.595927    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 18 19:54:49.676141 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:49.675666    2583 patch_prober.go:28] interesting pod/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 18 19:54:49.676141 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:49.675733    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 18 19:54:49.771330 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:49.771236    2583 patch_prober.go:28] interesting pod/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 18 19:54:49.771330 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:49.771310    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 18 19:54:50.079228 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:50.079055    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:50.596773 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:50.596728    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused" start-of-body=
Sep 18 19:54:50.596988 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:50.596798    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.41:15021/healthz/ready\": dial tcp 10.132.0.41:15021: connect: connection refused"
Sep 18 19:54:50.675462 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:50.675405    2583 patch_prober.go:28] interesting pod/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 18 19:54:50.675646 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:50.675480    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 18 19:54:50.772027 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:50.771992    2583 patch_prober.go:28] interesting pod/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 18 19:54:50.772579 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:50.772548    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 18 19:54:50.820886 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:50.819979    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:50.821188 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:50.821168    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:50.822327 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:50.822297    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:50.904392 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:50.904237    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:51.600869 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:51.600841    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:51.601866 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:51.601843    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 19:54:51.681226 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:51.681193    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:51.682367 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:51.682345    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 19:54:51.797612 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:51.795576    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:51.797612 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:51.797517    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 19:54:52.119693 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:52.119664    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:52.990489 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:52.990454    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:53.700312 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:53.700273    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:53.801600 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:53.801571    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:53.908455 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:53.908426    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:54.154201 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:54.154167    2583 generic.go:356] "Generic (PLEG): container finished" podID="46a9c749-d04c-4471-a0be-062813c96b03" containerID="93bdcb174bdc0c9ee0c494842907186f99a00f9b2c47c5af0818506cbe6851a0" exitCode=0
Sep 18 19:54:54.154618 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:54.154244    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" event={"ID":"46a9c749-d04c-4471-a0be-062813c96b03","Type":"ContainerDied","Data":"93bdcb174bdc0c9ee0c494842907186f99a00f9b2c47c5af0818506cbe6851a0"}
Sep 18 19:54:54.154728 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:54.154693    2583 scope.go:117] "RemoveContainer" containerID="93bdcb174bdc0c9ee0c494842907186f99a00f9b2c47c5af0818506cbe6851a0"
Sep 18 19:54:54.156145 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:54.156112    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:54.156279 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:54.156230    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:54.156279 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:54.156256    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6" event={"ID":"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5","Type":"ContainerDied","Data":"43eb11a82e953e7ce0ac8316f06393905b6c4144e2eb15b45092a64bbc8a6893"}
Sep 18 19:54:54.156403 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:54.156287    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:54.156682 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:54.156234    2583 generic.go:356] "Generic (PLEG): container finished" podID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerID="43eb11a82e953e7ce0ac8316f06393905b6c4144e2eb15b45092a64bbc8a6893" exitCode=0
Sep 18 19:54:54.156792 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:54.156707    2583 scope.go:117] "RemoveContainer" containerID="43eb11a82e953e7ce0ac8316f06393905b6c4144e2eb15b45092a64bbc8a6893"
Sep 18 19:54:54.158132 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:54.158101    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:54.158363 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:54.158338    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:54.158501 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:54.158479    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:54:54.698710 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:54.698677    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:55.169486 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:55.169449    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" event={"ID":"46a9c749-d04c-4471-a0be-062813c96b03","Type":"ContainerStarted","Data":"e64fe5de182ce84b860fbed91209d12d082fe5729c8f28c96a26ad4c0264acb6"}
Sep 18 19:54:55.171542 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:55.171516    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6" event={"ID":"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5","Type":"ContainerStarted","Data":"3de92b1538ef6d1431c9caa5941bb4e0bfdb4e15d74e27b2f0cbb3839b988ccf"}
Sep 18 19:54:55.412638 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:55.412599    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:55.413957 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:55.413921    2583 patch_prober.go:28] interesting pod/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 18 19:54:55.414096 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:55.413994    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" podUID="46a9c749-d04c-4471-a0be-062813c96b03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 18 19:54:55.616505 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:55.616442    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:56.168254 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:56.167114    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:56.168581 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:56.168559    2583 patch_prober.go:28] interesting pod/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 18 19:54:56.168795 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:56.168769    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6" podUID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 18 19:54:56.301919 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:56.301860    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:56.413270 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:56.413235    2583 patch_prober.go:28] interesting pod/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 18 19:54:56.413539 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:56.413509    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" podUID="46a9c749-d04c-4471-a0be-062813c96b03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 18 19:54:56.949320 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:56.949256    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:57.167198 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:57.167153    2583 patch_prober.go:28] interesting pod/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 18 19:54:57.167414 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:57.167228    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6" podUID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 18 19:54:57.416076 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:57.415558    2583 patch_prober.go:28] interesting pod/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 18 19:54:57.416076 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:57.415634    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" podUID="46a9c749-d04c-4471-a0be-062813c96b03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 18 19:54:57.789480 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:57.789389    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:58.168080 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:58.168007    2583 patch_prober.go:28] interesting pod/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 18 19:54:58.168312 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:58.168106    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6" podUID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 18 19:54:58.413092 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:58.413023    2583 patch_prober.go:28] interesting pod/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 18 19:54:58.413308 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:58.413117    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" podUID="46a9c749-d04c-4471-a0be-062813c96b03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 18 19:54:58.540049 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:58.539928    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:58.877006 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:58.876967    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:54:58.878307 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:58.878284    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:54:59.114266 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:59.114227    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"
Sep 18 19:54:59.174121 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:59.170525    2583 patch_prober.go:28] interesting pod/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 18 19:54:59.174121 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:59.170587    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6" podUID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 18 19:54:59.200063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:59.198463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:54:59.413060 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:59.413002    2583 patch_prober.go:28] interesting pod/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 18 19:54:59.413269 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:54:59.413095    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" podUID="46a9c749-d04c-4471-a0be-062813c96b03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 18 19:55:00.072586 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:00.072533    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:00.167497 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:00.167450    2583 patch_prober.go:28] interesting pod/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 18 19:55:00.167695 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:00.167523    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6" podUID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 18 19:55:00.412579 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:00.412529    2583 patch_prober.go:28] interesting pod/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 18 19:55:00.412817 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:00.412601    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" podUID="46a9c749-d04c-4471-a0be-062813c96b03" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 18 19:55:00.820422 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:00.820232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:01.172454 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:01.172420    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:55:01.173598 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:01.173575    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:55:01.416607 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:01.416573    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:55:01.417525 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:01.417505    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:55:01.501152 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:01.501032    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:02.417520 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:02.417488    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:03.113248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:03.113208    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:03.239596 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:03.239570    2583 generic.go:356] "Generic (PLEG): container finished" podID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" containerID="1215094e59078896ef7e9435e9d4c45f9220b0cddd45553b6df0481666b9adbb" exitCode=0
Sep 18 19:55:03.239720 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:03.239638    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v" event={"ID":"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5","Type":"ContainerDied","Data":"1215094e59078896ef7e9435e9d4c45f9220b0cddd45553b6df0481666b9adbb"}
Sep 18 19:55:03.240034 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:03.240018    2583 scope.go:117] "RemoveContainer" containerID="1215094e59078896ef7e9435e9d4c45f9220b0cddd45553b6df0481666b9adbb"
Sep 18 19:55:03.241176 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:03.241148    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:55:03.241252 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:03.241211    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:55:03.241252 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:03.241242    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:55:04.038371 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:04.038339    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:04.247802 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:04.247766    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v" event={"ID":"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5","Type":"ContainerStarted","Data":"de7c364fa335be3e4ef44226333e214d75dcdca6522f898ea552e40b27c71212"}
Sep 18 19:55:04.471610 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:04.471569    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:55:04.472908 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:04.472862    2583 patch_prober.go:28] interesting pod/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 18 19:55:04.472979 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:04.472934    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v" podUID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 18 19:55:04.709156 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:04.709116    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:04.916396 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:04.916364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:05.410602 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:05.410574    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:05.471248 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:05.471214    2583 patch_prober.go:28] interesting pod/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 18 19:55:05.471539 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:05.471510    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v" podUID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 18 19:55:06.211437 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:06.211405    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:06.471441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:06.471353    2583 patch_prober.go:28] interesting pod/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 18 19:55:06.471441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:06.471417    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v" podUID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 18 19:55:07.471275 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:07.471242    2583 patch_prober.go:28] interesting pod/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 18 19:55:07.471454 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:07.471291    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v" podUID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 18 19:55:08.471473 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:08.471434    2583 patch_prober.go:28] interesting pod/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 18 19:55:08.471844 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:08.471491    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v" podUID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 18 19:55:08.985615 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:08.985580    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:55:09.474852 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:09.474823    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:55:09.475771 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:09.475754    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 19:55:10.666267 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:10.666234    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:11.276378 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.276334    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:11.311785 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.311733    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"]
Sep 18 19:55:11.312089 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.312029    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6" podUID="672e571c-04d7-4e9d-b108-dac598af9766" containerName="payload-pre-processing" containerID="cri-o://b5b33a4d5baef14a2b91e80b687351c1a340a48626c68f7dadaf64fa5bcc8fe7" gracePeriod=30
Sep 18 19:55:11.354459 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.354428    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:11.455581 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.455545    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:11.534956 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.534872    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:11.575967 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.575944    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"
Sep 18 19:55:11.652965 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.652925    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"]
Sep 18 19:55:11.653178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.653155    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" podUID="46a9c749-d04c-4471-a0be-062813c96b03" containerName="istio-proxy" containerID="cri-o://e64fe5de182ce84b860fbed91209d12d082fe5729c8f28c96a26ad4c0264acb6" gracePeriod=30
Sep 18 19:55:11.665333 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.665302    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:11.721301 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.721268    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7fnq\" (UniqueName: \"kubernetes.io/projected/672e571c-04d7-4e9d-b108-dac598af9766-kube-api-access-g7fnq\") pod \"672e571c-04d7-4e9d-b108-dac598af9766\" (UID: \"672e571c-04d7-4e9d-b108-dac598af9766\") "
Sep 18 19:55:11.721670 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.721457    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/672e571c-04d7-4e9d-b108-dac598af9766-plugins-config-volume\") pod \"672e571c-04d7-4e9d-b108-dac598af9766\" (UID: \"672e571c-04d7-4e9d-b108-dac598af9766\") "
Sep 18 19:55:11.721871 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.721848    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/672e571c-04d7-4e9d-b108-dac598af9766-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "672e571c-04d7-4e9d-b108-dac598af9766" (UID: "672e571c-04d7-4e9d-b108-dac598af9766"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:55:11.723569 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.723542    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672e571c-04d7-4e9d-b108-dac598af9766-kube-api-access-g7fnq" (OuterVolumeSpecName: "kube-api-access-g7fnq") pod "672e571c-04d7-4e9d-b108-dac598af9766" (UID: "672e571c-04d7-4e9d-b108-dac598af9766"). InnerVolumeSpecName "kube-api-access-g7fnq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:55:11.822897 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.822862    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7fnq\" (UniqueName: \"kubernetes.io/projected/672e571c-04d7-4e9d-b108-dac598af9766-kube-api-access-g7fnq\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:11.823019 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.822906    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/672e571c-04d7-4e9d-b108-dac598af9766-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:11.930509 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:11.930474    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:12.143860 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:12.143795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:12.241646 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:12.241611    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:12.302952 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:12.302915    2583 generic.go:356] "Generic (PLEG): container finished" podID="672e571c-04d7-4e9d-b108-dac598af9766" containerID="b5b33a4d5baef14a2b91e80b687351c1a340a48626c68f7dadaf64fa5bcc8fe7" exitCode=0
Sep 18 19:55:12.303161 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:12.302984    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"
Sep 18 19:55:12.303161 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:12.303017    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6" event={"ID":"672e571c-04d7-4e9d-b108-dac598af9766","Type":"ContainerDied","Data":"b5b33a4d5baef14a2b91e80b687351c1a340a48626c68f7dadaf64fa5bcc8fe7"}
Sep 18 19:55:12.303161 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:12.303102    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6" event={"ID":"672e571c-04d7-4e9d-b108-dac598af9766","Type":"ContainerDied","Data":"58b910b3a38585c3c80eb3d79dc404defd845da8d527a5a17ec3f1e60cfbf933"}
Sep 18 19:55:12.303161 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:12.303148    2583 scope.go:117] "RemoveContainer" containerID="b5b33a4d5baef14a2b91e80b687351c1a340a48626c68f7dadaf64fa5bcc8fe7"
Sep 18 19:55:12.312505 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:12.312483    2583 scope.go:117] "RemoveContainer" containerID="b5b33a4d5baef14a2b91e80b687351c1a340a48626c68f7dadaf64fa5bcc8fe7"
Sep 18 19:55:12.312808 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:55:12.312789    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5b33a4d5baef14a2b91e80b687351c1a340a48626c68f7dadaf64fa5bcc8fe7\": container with ID starting with b5b33a4d5baef14a2b91e80b687351c1a340a48626c68f7dadaf64fa5bcc8fe7 not found: ID does not exist" containerID="b5b33a4d5baef14a2b91e80b687351c1a340a48626c68f7dadaf64fa5bcc8fe7"
Sep 18 19:55:12.312860 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:12.312816    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5b33a4d5baef14a2b91e80b687351c1a340a48626c68f7dadaf64fa5bcc8fe7"} err="failed to get container status \"b5b33a4d5baef14a2b91e80b687351c1a340a48626c68f7dadaf64fa5bcc8fe7\": rpc error: code = NotFound desc = could not find container \"b5b33a4d5baef14a2b91e80b687351c1a340a48626c68f7dadaf64fa5bcc8fe7\": container with ID starting with b5b33a4d5baef14a2b91e80b687351c1a340a48626c68f7dadaf64fa5bcc8fe7 not found: ID does not exist"
Sep 18 19:55:12.330287 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:12.330262    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"]
Sep 18 19:55:12.338724 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:12.338703    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-6c083038-6566f8f54b-vzkb6"]
Sep 18 19:55:12.365298 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:12.365272    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:12.729153 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:12.729123    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:12.981562 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:12.981472    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:13.097823 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:13.097799    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:13.741563 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:13.741531    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:13.815172 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:13.815139    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="672e571c-04d7-4e9d-b108-dac598af9766" path="/var/lib/kubelet/pods/672e571c-04d7-4e9d-b108-dac598af9766/volumes"
Sep 18 19:55:14.701330 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:14.701302    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:15.164187 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:15.164158    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:15.261635 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:15.261605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:15.596804 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:15.596771    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:16.406895 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.406860    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:16.419995 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.419961    2583 patch_prober.go:28] interesting pod/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 18 19:55:16.420159 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.420019    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" podUID="46a9c749-d04c-4471-a0be-062813c96b03" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:55:16.908646 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.908621    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:55:16.978234 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.978160    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-credential-socket\") pod \"46a9c749-d04c-4471-a0be-062813c96b03\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") "
Sep 18 19:55:16.978396 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.978261    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46a9c749-d04c-4471-a0be-062813c96b03-istiod-ca-cert\") pod \"46a9c749-d04c-4471-a0be-062813c96b03\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") "
Sep 18 19:55:16.978396 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.978285    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-istio-envoy\") pod \"46a9c749-d04c-4471-a0be-062813c96b03\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") "
Sep 18 19:55:16.978396 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.978300    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46a9c749-d04c-4471-a0be-062813c96b03-istio-token\") pod \"46a9c749-d04c-4471-a0be-062813c96b03\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") "
Sep 18 19:55:16.978396 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.978338    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-istio-data\") pod \"46a9c749-d04c-4471-a0be-062813c96b03\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") "
Sep 18 19:55:16.978396 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.978381    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-workload-socket\") pod \"46a9c749-d04c-4471-a0be-062813c96b03\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") "
Sep 18 19:55:16.978673 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.978413    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-workload-certs\") pod \"46a9c749-d04c-4471-a0be-062813c96b03\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") "
Sep 18 19:55:16.978673 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.978441    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46a9c749-d04c-4471-a0be-062813c96b03-istio-podinfo\") pod \"46a9c749-d04c-4471-a0be-062813c96b03\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") "
Sep 18 19:55:16.978673 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.978456    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "46a9c749-d04c-4471-a0be-062813c96b03" (UID: "46a9c749-d04c-4471-a0be-062813c96b03"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:55:16.978673 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.978465    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzxzr\" (UniqueName: \"kubernetes.io/projected/46a9c749-d04c-4471-a0be-062813c96b03-kube-api-access-pzxzr\") pod \"46a9c749-d04c-4471-a0be-062813c96b03\" (UID: \"46a9c749-d04c-4471-a0be-062813c96b03\") "
Sep 18 19:55:16.978880 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.978726    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "46a9c749-d04c-4471-a0be-062813c96b03" (UID: "46a9c749-d04c-4471-a0be-062813c96b03"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:55:16.978880 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.978732    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46a9c749-d04c-4471-a0be-062813c96b03-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "46a9c749-d04c-4471-a0be-062813c96b03" (UID: "46a9c749-d04c-4471-a0be-062813c96b03"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:55:16.978880 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.978861    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-istio-data" (OuterVolumeSpecName: "istio-data") pod "46a9c749-d04c-4471-a0be-062813c96b03" (UID: "46a9c749-d04c-4471-a0be-062813c96b03"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:55:16.979072 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.979000    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/46a9c749-d04c-4471-a0be-062813c96b03-istiod-ca-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:16.979072 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.979020    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-istio-data\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:16.979072 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.979033    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-workload-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:16.979239 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.979073    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-credential-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:16.979239 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.979133    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "46a9c749-d04c-4471-a0be-062813c96b03" (UID: "46a9c749-d04c-4471-a0be-062813c96b03"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:55:16.980596 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.980567    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "46a9c749-d04c-4471-a0be-062813c96b03" (UID: "46a9c749-d04c-4471-a0be-062813c96b03"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:55:16.980596 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.980579    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46a9c749-d04c-4471-a0be-062813c96b03-kube-api-access-pzxzr" (OuterVolumeSpecName: "kube-api-access-pzxzr") pod "46a9c749-d04c-4471-a0be-062813c96b03" (UID: "46a9c749-d04c-4471-a0be-062813c96b03"). InnerVolumeSpecName "kube-api-access-pzxzr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:55:16.980733 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.980597    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46a9c749-d04c-4471-a0be-062813c96b03-istio-token" (OuterVolumeSpecName: "istio-token") pod "46a9c749-d04c-4471-a0be-062813c96b03" (UID: "46a9c749-d04c-4471-a0be-062813c96b03"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:55:16.980772 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:16.980753    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/46a9c749-d04c-4471-a0be-062813c96b03-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "46a9c749-d04c-4471-a0be-062813c96b03" (UID: "46a9c749-d04c-4471-a0be-062813c96b03"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 19:55:17.080156 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.080114    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-workload-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:17.080156 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.080154    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/46a9c749-d04c-4471-a0be-062813c96b03-istio-podinfo\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:17.080156 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.080165    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzxzr\" (UniqueName: \"kubernetes.io/projected/46a9c749-d04c-4471-a0be-062813c96b03-kube-api-access-pzxzr\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:17.080387 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.080174    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/46a9c749-d04c-4471-a0be-062813c96b03-istio-envoy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:17.080387 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.080182    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/46a9c749-d04c-4471-a0be-062813c96b03-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:17.133924 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.133879    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:17.234270 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.234173    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:17.335214 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.335180    2583 generic.go:356] "Generic (PLEG): container finished" podID="46a9c749-d04c-4471-a0be-062813c96b03" containerID="e64fe5de182ce84b860fbed91209d12d082fe5729c8f28c96a26ad4c0264acb6" exitCode=0
Sep 18 19:55:17.335378 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.335222    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"
Sep 18 19:55:17.335378 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.335252    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" event={"ID":"46a9c749-d04c-4471-a0be-062813c96b03","Type":"ContainerDied","Data":"e64fe5de182ce84b860fbed91209d12d082fe5729c8f28c96a26ad4c0264acb6"}
Sep 18 19:55:17.335378 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.335301    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n" event={"ID":"46a9c749-d04c-4471-a0be-062813c96b03","Type":"ContainerDied","Data":"5719f4098b8c6674e3d9f4799c1399618b8dafc4cdec7a19d4ef215e0f01220e"}
Sep 18 19:55:17.335378 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.335323    2583 scope.go:117] "RemoveContainer" containerID="e64fe5de182ce84b860fbed91209d12d082fe5729c8f28c96a26ad4c0264acb6"
Sep 18 19:55:17.345393 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.345378    2583 scope.go:117] "RemoveContainer" containerID="93bdcb174bdc0c9ee0c494842907186f99a00f9b2c47c5af0818506cbe6851a0"
Sep 18 19:55:17.353850 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.353834    2583 scope.go:117] "RemoveContainer" containerID="e64fe5de182ce84b860fbed91209d12d082fe5729c8f28c96a26ad4c0264acb6"
Sep 18 19:55:17.354187 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:55:17.354169    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e64fe5de182ce84b860fbed91209d12d082fe5729c8f28c96a26ad4c0264acb6\": container with ID starting with e64fe5de182ce84b860fbed91209d12d082fe5729c8f28c96a26ad4c0264acb6 not found: ID does not exist" containerID="e64fe5de182ce84b860fbed91209d12d082fe5729c8f28c96a26ad4c0264acb6"
Sep 18 19:55:17.354240 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.354196    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e64fe5de182ce84b860fbed91209d12d082fe5729c8f28c96a26ad4c0264acb6"} err="failed to get container status \"e64fe5de182ce84b860fbed91209d12d082fe5729c8f28c96a26ad4c0264acb6\": rpc error: code = NotFound desc = could not find container \"e64fe5de182ce84b860fbed91209d12d082fe5729c8f28c96a26ad4c0264acb6\": container with ID starting with e64fe5de182ce84b860fbed91209d12d082fe5729c8f28c96a26ad4c0264acb6 not found: ID does not exist"
Sep 18 19:55:17.354240 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.354213    2583 scope.go:117] "RemoveContainer" containerID="93bdcb174bdc0c9ee0c494842907186f99a00f9b2c47c5af0818506cbe6851a0"
Sep 18 19:55:17.354457 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:55:17.354436    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93bdcb174bdc0c9ee0c494842907186f99a00f9b2c47c5af0818506cbe6851a0\": container with ID starting with 93bdcb174bdc0c9ee0c494842907186f99a00f9b2c47c5af0818506cbe6851a0 not found: ID does not exist" containerID="93bdcb174bdc0c9ee0c494842907186f99a00f9b2c47c5af0818506cbe6851a0"
Sep 18 19:55:17.354539 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.354460    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93bdcb174bdc0c9ee0c494842907186f99a00f9b2c47c5af0818506cbe6851a0"} err="failed to get container status \"93bdcb174bdc0c9ee0c494842907186f99a00f9b2c47c5af0818506cbe6851a0\": rpc error: code = NotFound desc = could not find container \"93bdcb174bdc0c9ee0c494842907186f99a00f9b2c47c5af0818506cbe6851a0\": container with ID starting with 93bdcb174bdc0c9ee0c494842907186f99a00f9b2c47c5af0818506cbe6851a0 not found: ID does not exist"
Sep 18 19:55:17.358159 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.358132    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"]
Sep 18 19:55:17.367870 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.367845    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-6c083038-openshift-default-7cb89d84c8-8ks8n"]
Sep 18 19:55:17.599336 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.599307    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:17.713089 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.713059    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:17.812691 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.812659    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46a9c749-d04c-4471-a0be-062813c96b03" path="/var/lib/kubelet/pods/46a9c749-d04c-4471-a0be-062813c96b03/volumes"
Sep 18 19:55:17.813515 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.813497    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:17.830181 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.830150    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"]
Sep 18 19:55:17.830571 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.830556    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672e571c-04d7-4e9d-b108-dac598af9766" containerName="payload-pre-processing"
Sep 18 19:55:17.830623 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.830573    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="672e571c-04d7-4e9d-b108-dac598af9766" containerName="payload-pre-processing"
Sep 18 19:55:17.830623 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.830591    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46a9c749-d04c-4471-a0be-062813c96b03" containerName="istio-proxy"
Sep 18 19:55:17.830623 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.830598    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="46a9c749-d04c-4471-a0be-062813c96b03" containerName="istio-proxy"
Sep 18 19:55:17.830623 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.830605    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46a9c749-d04c-4471-a0be-062813c96b03" containerName="istio-proxy"
Sep 18 19:55:17.830623 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.830611    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="46a9c749-d04c-4471-a0be-062813c96b03" containerName="istio-proxy"
Sep 18 19:55:17.830775 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.830688    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="672e571c-04d7-4e9d-b108-dac598af9766" containerName="payload-pre-processing"
Sep 18 19:55:17.830775 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.830699    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="46a9c749-d04c-4471-a0be-062813c96b03" containerName="istio-proxy"
Sep 18 19:55:17.830775 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.830705    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="46a9c749-d04c-4471-a0be-062813c96b03" containerName="istio-proxy"
Sep 18 19:55:17.833647 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.833628    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"
Sep 18 19:55:17.838254 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.838235    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-64cc2d85\""
Sep 18 19:55:17.838365 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.838286    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-64cc2d85-dockercfg-vh5xj\""
Sep 18 19:55:17.845373 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.845349    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"]
Sep 18 19:55:17.863062 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.862967    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"]
Sep 18 19:55:17.865396 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.865380    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"
Sep 18 19:55:17.877736 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.877707    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"]
Sep 18 19:55:17.887805 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.887779    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fllfm\" (UniqueName: \"kubernetes.io/projected/f745ea94-1c36-42ed-b00c-be2acc4f953c-kube-api-access-fllfm\") pod \"payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc\" (UID: \"f745ea94-1c36-42ed-b00c-be2acc4f953c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"
Sep 18 19:55:17.887912 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.887874    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f745ea94-1c36-42ed-b00c-be2acc4f953c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc\" (UID: \"f745ea94-1c36-42ed-b00c-be2acc4f953c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"
Sep 18 19:55:17.989142 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.989105    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/681326ed-5d64-4ba9-942a-8c60159a57d1-plugins-config-volume\") pod \"payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn\" (UID: \"681326ed-5d64-4ba9-942a-8c60159a57d1\") " pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"
Sep 18 19:55:17.989333 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.989164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f745ea94-1c36-42ed-b00c-be2acc4f953c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc\" (UID: \"f745ea94-1c36-42ed-b00c-be2acc4f953c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"
Sep 18 19:55:17.989333 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.989274    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xn5s\" (UniqueName: \"kubernetes.io/projected/681326ed-5d64-4ba9-942a-8c60159a57d1-kube-api-access-5xn5s\") pod \"payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn\" (UID: \"681326ed-5d64-4ba9-942a-8c60159a57d1\") " pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"
Sep 18 19:55:17.989429 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.989351    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fllfm\" (UniqueName: \"kubernetes.io/projected/f745ea94-1c36-42ed-b00c-be2acc4f953c-kube-api-access-fllfm\") pod \"payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc\" (UID: \"f745ea94-1c36-42ed-b00c-be2acc4f953c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"
Sep 18 19:55:17.989780 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.989763    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f745ea94-1c36-42ed-b00c-be2acc4f953c-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc\" (UID: \"f745ea94-1c36-42ed-b00c-be2acc4f953c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"
Sep 18 19:55:17.998762 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:17.998735    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fllfm\" (UniqueName: \"kubernetes.io/projected/f745ea94-1c36-42ed-b00c-be2acc4f953c-kube-api-access-fllfm\") pod \"payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc\" (UID: \"f745ea94-1c36-42ed-b00c-be2acc4f953c\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"
Sep 18 19:55:18.090113 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:18.090078    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xn5s\" (UniqueName: \"kubernetes.io/projected/681326ed-5d64-4ba9-942a-8c60159a57d1-kube-api-access-5xn5s\") pod \"payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn\" (UID: \"681326ed-5d64-4ba9-942a-8c60159a57d1\") " pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"
Sep 18 19:55:18.090309 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:18.090158    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/681326ed-5d64-4ba9-942a-8c60159a57d1-plugins-config-volume\") pod \"payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn\" (UID: \"681326ed-5d64-4ba9-942a-8c60159a57d1\") " pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"
Sep 18 19:55:18.090803 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:18.090785    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/681326ed-5d64-4ba9-942a-8c60159a57d1-plugins-config-volume\") pod \"payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn\" (UID: \"681326ed-5d64-4ba9-942a-8c60159a57d1\") " pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"
Sep 18 19:55:18.099565 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:18.099535    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xn5s\" (UniqueName: \"kubernetes.io/projected/681326ed-5d64-4ba9-942a-8c60159a57d1-kube-api-access-5xn5s\") pod \"payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn\" (UID: \"681326ed-5d64-4ba9-942a-8c60159a57d1\") " pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"
Sep 18 19:55:18.133206 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:18.133122    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:18.145232 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:18.145198    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"
Sep 18 19:55:18.176102 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:18.176071    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"
Sep 18 19:55:18.426838 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:18.426759    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"]
Sep 18 19:55:18.429204 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:55:18.429173    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf745ea94_1c36_42ed_b00c_be2acc4f953c.slice/crio-2c762df454091c7d83618330dd0b652c4730ac3127309c3d605116140510a174 WatchSource:0}: Error finding container 2c762df454091c7d83618330dd0b652c4730ac3127309c3d605116140510a174: Status 404 returned error can't find the container with id 2c762df454091c7d83618330dd0b652c4730ac3127309c3d605116140510a174
Sep 18 19:55:18.463591 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:18.463566    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"]
Sep 18 19:55:18.464477 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:55:18.464452    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681326ed_5d64_4ba9_942a_8c60159a57d1.slice/crio-e35ad54ea5fedea9b9e9a1146900db9cf99d941ddeaf73f5fc5434cf90403650 WatchSource:0}: Error finding container e35ad54ea5fedea9b9e9a1146900db9cf99d941ddeaf73f5fc5434cf90403650: Status 404 returned error can't find the container with id e35ad54ea5fedea9b9e9a1146900db9cf99d941ddeaf73f5fc5434cf90403650
Sep 18 19:55:19.119701 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:19.119669    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:19.353599 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:19.353563    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn" event={"ID":"681326ed-5d64-4ba9-942a-8c60159a57d1","Type":"ContainerStarted","Data":"9a402b5d92964adafa3803097b80a06b4a4caab98307178a1ce34ae63bd7483c"}
Sep 18 19:55:19.353802 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:19.353619    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn" event={"ID":"681326ed-5d64-4ba9-942a-8c60159a57d1","Type":"ContainerStarted","Data":"e35ad54ea5fedea9b9e9a1146900db9cf99d941ddeaf73f5fc5434cf90403650"}
Sep 18 19:55:19.353802 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:19.353673    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"
Sep 18 19:55:19.355353 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:19.355328    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc" event={"ID":"f745ea94-1c36-42ed-b00c-be2acc4f953c","Type":"ContainerStarted","Data":"cd445af8b0fe9641d7758b5a3960523fb109c349011b93287adb27137f2cecd3"}
Sep 18 19:55:19.355480 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:19.355368    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc" event={"ID":"f745ea94-1c36-42ed-b00c-be2acc4f953c","Type":"ContainerStarted","Data":"2c762df454091c7d83618330dd0b652c4730ac3127309c3d605116140510a174"}
Sep 18 19:55:19.355480 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:19.355421    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"
Sep 18 19:55:19.375894 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:19.375802    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn" podStartSLOduration=2.375781734 podStartE2EDuration="2.375781734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:55:19.371224906 +0000 UTC m=+961.698318672" watchObservedRunningTime="2026-09-18 19:55:19.375781734 +0000 UTC m=+961.702875499"
Sep 18 19:55:19.392472 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:19.392425    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc" podStartSLOduration=2.39241089 podStartE2EDuration="2.39241089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:55:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:55:19.390079863 +0000 UTC m=+961.717173628" watchObservedRunningTime="2026-09-18 19:55:19.39241089 +0000 UTC m=+961.719504654"
Sep 18 19:55:19.830395 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:19.830308    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:20.625429 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:20.625396    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:25.875251 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:25.875221    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:30.363927 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:30.363898    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"
Sep 18 19:55:30.364340 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:30.364079    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"
Sep 18 19:55:39.444667 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:39.444577    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:40.027762 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:40.027732    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb"]
Sep 18 19:55:40.030356 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:40.030341    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb"
Sep 18 19:55:40.033004 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:40.032985    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 19:55:40.033004 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:40.032985    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 19:55:40.040579 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:40.040557    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb"]
Sep 18 19:55:40.106573 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:40.106547    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f4075c9-3a67-48de-a9d4-7c783dfc9b10-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb\" (UID: \"9f4075c9-3a67-48de-a9d4-7c783dfc9b10\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb"
Sep 18 19:55:40.207716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:40.207688    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f4075c9-3a67-48de-a9d4-7c783dfc9b10-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb\" (UID: \"9f4075c9-3a67-48de-a9d4-7c783dfc9b10\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb"
Sep 18 19:55:40.208390 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:40.208369    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f4075c9-3a67-48de-a9d4-7c783dfc9b10-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb\" (UID: \"9f4075c9-3a67-48de-a9d4-7c783dfc9b10\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb"
Sep 18 19:55:40.343125 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:40.343098    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb"
Sep 18 19:55:40.409074 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:40.408885    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:40.614225 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:40.614194    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb"]
Sep 18 19:55:40.615354 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:55:40.615331    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f4075c9_3a67_48de_a9d4_7c783dfc9b10.slice/crio-3f0dc2a45ced38134e1f74918267f3043f4669fe1570ee1fee40c6bc6f386eb0 WatchSource:0}: Error finding container 3f0dc2a45ced38134e1f74918267f3043f4669fe1570ee1fee40c6bc6f386eb0: Status 404 returned error can't find the container with id 3f0dc2a45ced38134e1f74918267f3043f4669fe1570ee1fee40c6bc6f386eb0
Sep 18 19:55:40.879840 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:40.879766    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:41.251143 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:41.251070    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:41.492768 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:41.492727    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb" event={"ID":"9f4075c9-3a67-48de-a9d4-7c783dfc9b10","Type":"ContainerStarted","Data":"3f0dc2a45ced38134e1f74918267f3043f4669fe1570ee1fee40c6bc6f386eb0"}
Sep 18 19:55:42.193829 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:42.193795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:43.001638 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:43.001609    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:43.507477 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:43.507447    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb" event={"ID":"9f4075c9-3a67-48de-a9d4-7c783dfc9b10","Type":"ContainerStarted","Data":"cf15b27e99f964e0336e4b8bb6b8543ec3ffecf056909b3d3ae2ed49c380c056"}
Sep 18 19:55:43.529720 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:43.529672    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb" podStartSLOduration=1.003709691 podStartE2EDuration="3.529654016s" totalImagesPullingTime="2.525944325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:55:43.526029351 +0000 UTC m=+985.853123116" watchObservedRunningTime="2026-09-18 19:55:43.529654016 +0000 UTC m=+985.856747781"
Sep 18 19:55:43.805221 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:43.805189    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:44.514994 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:44.514959    2583 generic.go:356] "Generic (PLEG): container finished" podID="9f4075c9-3a67-48de-a9d4-7c783dfc9b10" containerID="cf15b27e99f964e0336e4b8bb6b8543ec3ffecf056909b3d3ae2ed49c380c056" exitCode=0
Sep 18 19:55:44.515472 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:44.515066    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb" event={"ID":"9f4075c9-3a67-48de-a9d4-7c783dfc9b10","Type":"ContainerDied","Data":"cf15b27e99f964e0336e4b8bb6b8543ec3ffecf056909b3d3ae2ed49c380c056"}
Sep 18 19:55:44.611489 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:44.611462    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:45.294623 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:45.294593    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:45.661023 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:45.660999    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb"
Sep 18 19:55:45.762050 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:45.762014    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f4075c9-3a67-48de-a9d4-7c783dfc9b10-maas-api-service-ca\") pod \"9f4075c9-3a67-48de-a9d4-7c783dfc9b10\" (UID: \"9f4075c9-3a67-48de-a9d4-7c783dfc9b10\") "
Sep 18 19:55:45.762435 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:45.762411    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f4075c9-3a67-48de-a9d4-7c783dfc9b10-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9f4075c9-3a67-48de-a9d4-7c783dfc9b10" (UID: "9f4075c9-3a67-48de-a9d4-7c783dfc9b10"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:55:45.863423 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:45.863391    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f4075c9-3a67-48de-a9d4-7c783dfc9b10-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:46.040578 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:46.040543    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:46.527864 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:46.527832    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb" event={"ID":"9f4075c9-3a67-48de-a9d4-7c783dfc9b10","Type":"ContainerDied","Data":"3f0dc2a45ced38134e1f74918267f3043f4669fe1570ee1fee40c6bc6f386eb0"}
Sep 18 19:55:46.527864 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:46.527850    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb"
Sep 18 19:55:46.528094 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:46.527878    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f0dc2a45ced38134e1f74918267f3043f4669fe1570ee1fee40c6bc6f386eb0"
Sep 18 19:55:56.295768 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:56.295737    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:56.874333 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:56.874298    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:56.912056 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:56.912000    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"]
Sep 18 19:55:56.912370 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:56.912249    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn" podUID="681326ed-5d64-4ba9-942a-8c60159a57d1" containerName="payload-processing" containerID="cri-o://9a402b5d92964adafa3803097b80a06b4a4caab98307178a1ce34ae63bd7483c" gracePeriod=30
Sep 18 19:55:56.915639 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:56.915613    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"]
Sep 18 19:55:56.916250 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:56.916185    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc" podUID="f745ea94-1c36-42ed-b00c-be2acc4f953c" containerName="payload-pre-processing" containerID="cri-o://cd445af8b0fe9641d7758b5a3960523fb109c349011b93287adb27137f2cecd3" gracePeriod=30
Sep 18 19:55:56.954851 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:56.954828    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:57.017475 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.017443    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:57.077957 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.077914    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb"]
Sep 18 19:55:57.078353 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.078329    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:57.082140 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.081597    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-64cc2d85-2qjjb"]
Sep 18 19:55:57.141252 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.141177    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:57.199980 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.199951    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"
Sep 18 19:55:57.210375 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.210342    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"
Sep 18 19:55:57.242407 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.242325    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:57.279273 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.279243    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/681326ed-5d64-4ba9-942a-8c60159a57d1-plugins-config-volume\") pod \"681326ed-5d64-4ba9-942a-8c60159a57d1\" (UID: \"681326ed-5d64-4ba9-942a-8c60159a57d1\") "
Sep 18 19:55:57.279432 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.279326    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xn5s\" (UniqueName: \"kubernetes.io/projected/681326ed-5d64-4ba9-942a-8c60159a57d1-kube-api-access-5xn5s\") pod \"681326ed-5d64-4ba9-942a-8c60159a57d1\" (UID: \"681326ed-5d64-4ba9-942a-8c60159a57d1\") "
Sep 18 19:55:57.279432 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.279405    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fllfm\" (UniqueName: \"kubernetes.io/projected/f745ea94-1c36-42ed-b00c-be2acc4f953c-kube-api-access-fllfm\") pod \"f745ea94-1c36-42ed-b00c-be2acc4f953c\" (UID: \"f745ea94-1c36-42ed-b00c-be2acc4f953c\") "
Sep 18 19:55:57.279432 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.279424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f745ea94-1c36-42ed-b00c-be2acc4f953c-plugins-config-volume\") pod \"f745ea94-1c36-42ed-b00c-be2acc4f953c\" (UID: \"f745ea94-1c36-42ed-b00c-be2acc4f953c\") "
Sep 18 19:55:57.279646 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.279618    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/681326ed-5d64-4ba9-942a-8c60159a57d1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "681326ed-5d64-4ba9-942a-8c60159a57d1" (UID: "681326ed-5d64-4ba9-942a-8c60159a57d1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:55:57.279854 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.279835    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f745ea94-1c36-42ed-b00c-be2acc4f953c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f745ea94-1c36-42ed-b00c-be2acc4f953c" (UID: "f745ea94-1c36-42ed-b00c-be2acc4f953c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:55:57.281511 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.281493    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f745ea94-1c36-42ed-b00c-be2acc4f953c-kube-api-access-fllfm" (OuterVolumeSpecName: "kube-api-access-fllfm") pod "f745ea94-1c36-42ed-b00c-be2acc4f953c" (UID: "f745ea94-1c36-42ed-b00c-be2acc4f953c"). InnerVolumeSpecName "kube-api-access-fllfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:55:57.281574 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.281555    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/681326ed-5d64-4ba9-942a-8c60159a57d1-kube-api-access-5xn5s" (OuterVolumeSpecName: "kube-api-access-5xn5s") pod "681326ed-5d64-4ba9-942a-8c60159a57d1" (UID: "681326ed-5d64-4ba9-942a-8c60159a57d1"). InnerVolumeSpecName "kube-api-access-5xn5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:55:57.381254 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.381218    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xn5s\" (UniqueName: \"kubernetes.io/projected/681326ed-5d64-4ba9-942a-8c60159a57d1-kube-api-access-5xn5s\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:57.381254 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.381249    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fllfm\" (UniqueName: \"kubernetes.io/projected/f745ea94-1c36-42ed-b00c-be2acc4f953c-kube-api-access-fllfm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:57.381254 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.381258    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f745ea94-1c36-42ed-b00c-be2acc4f953c-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:57.381683 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.381269    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/681326ed-5d64-4ba9-942a-8c60159a57d1-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:55:57.388915 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.388889    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:57.592052 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.592007    2583 generic.go:356] "Generic (PLEG): container finished" podID="681326ed-5d64-4ba9-942a-8c60159a57d1" containerID="9a402b5d92964adafa3803097b80a06b4a4caab98307178a1ce34ae63bd7483c" exitCode=0
Sep 18 19:55:57.592244 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.592063    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"
Sep 18 19:55:57.592244 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.592075    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn" event={"ID":"681326ed-5d64-4ba9-942a-8c60159a57d1","Type":"ContainerDied","Data":"9a402b5d92964adafa3803097b80a06b4a4caab98307178a1ce34ae63bd7483c"}
Sep 18 19:55:57.592244 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.592132    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn" event={"ID":"681326ed-5d64-4ba9-942a-8c60159a57d1","Type":"ContainerDied","Data":"e35ad54ea5fedea9b9e9a1146900db9cf99d941ddeaf73f5fc5434cf90403650"}
Sep 18 19:55:57.592244 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.592156    2583 scope.go:117] "RemoveContainer" containerID="9a402b5d92964adafa3803097b80a06b4a4caab98307178a1ce34ae63bd7483c"
Sep 18 19:55:57.593643 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.593624    2583 generic.go:356] "Generic (PLEG): container finished" podID="f745ea94-1c36-42ed-b00c-be2acc4f953c" containerID="cd445af8b0fe9641d7758b5a3960523fb109c349011b93287adb27137f2cecd3" exitCode=0
Sep 18 19:55:57.593741 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.593676    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"
Sep 18 19:55:57.593741 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.593709    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc" event={"ID":"f745ea94-1c36-42ed-b00c-be2acc4f953c","Type":"ContainerDied","Data":"cd445af8b0fe9641d7758b5a3960523fb109c349011b93287adb27137f2cecd3"}
Sep 18 19:55:57.593831 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.593764    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc" event={"ID":"f745ea94-1c36-42ed-b00c-be2acc4f953c","Type":"ContainerDied","Data":"2c762df454091c7d83618330dd0b652c4730ac3127309c3d605116140510a174"}
Sep 18 19:55:57.602839 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.602823    2583 scope.go:117] "RemoveContainer" containerID="9a402b5d92964adafa3803097b80a06b4a4caab98307178a1ce34ae63bd7483c"
Sep 18 19:55:57.603180 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:55:57.603156    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a402b5d92964adafa3803097b80a06b4a4caab98307178a1ce34ae63bd7483c\": container with ID starting with 9a402b5d92964adafa3803097b80a06b4a4caab98307178a1ce34ae63bd7483c not found: ID does not exist" containerID="9a402b5d92964adafa3803097b80a06b4a4caab98307178a1ce34ae63bd7483c"
Sep 18 19:55:57.603256 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.603191    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a402b5d92964adafa3803097b80a06b4a4caab98307178a1ce34ae63bd7483c"} err="failed to get container status \"9a402b5d92964adafa3803097b80a06b4a4caab98307178a1ce34ae63bd7483c\": rpc error: code = NotFound desc = could not find container \"9a402b5d92964adafa3803097b80a06b4a4caab98307178a1ce34ae63bd7483c\": container with ID starting with 9a402b5d92964adafa3803097b80a06b4a4caab98307178a1ce34ae63bd7483c not found: ID does not exist"
Sep 18 19:55:57.603256 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.603214    2583 scope.go:117] "RemoveContainer" containerID="cd445af8b0fe9641d7758b5a3960523fb109c349011b93287adb27137f2cecd3"
Sep 18 19:55:57.612582 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.612521    2583 scope.go:117] "RemoveContainer" containerID="cd445af8b0fe9641d7758b5a3960523fb109c349011b93287adb27137f2cecd3"
Sep 18 19:55:57.612955 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:55:57.612932    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd445af8b0fe9641d7758b5a3960523fb109c349011b93287adb27137f2cecd3\": container with ID starting with cd445af8b0fe9641d7758b5a3960523fb109c349011b93287adb27137f2cecd3 not found: ID does not exist" containerID="cd445af8b0fe9641d7758b5a3960523fb109c349011b93287adb27137f2cecd3"
Sep 18 19:55:57.613093 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.612962    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd445af8b0fe9641d7758b5a3960523fb109c349011b93287adb27137f2cecd3"} err="failed to get container status \"cd445af8b0fe9641d7758b5a3960523fb109c349011b93287adb27137f2cecd3\": rpc error: code = NotFound desc = could not find container \"cd445af8b0fe9641d7758b5a3960523fb109c349011b93287adb27137f2cecd3\": container with ID starting with cd445af8b0fe9641d7758b5a3960523fb109c349011b93287adb27137f2cecd3 not found: ID does not exist"
Sep 18 19:55:57.615413 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.615393    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"]
Sep 18 19:55:57.619241 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.619217    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-64cc2d85-59f8574f58-872mn"]
Sep 18 19:55:57.629767 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.629742    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"]
Sep 18 19:55:57.636281 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.636261    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-64cc2d85-6f44588f74-l4tcc"]
Sep 18 19:55:57.651626 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.651607    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:57.811228 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.811200    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="681326ed-5d64-4ba9-942a-8c60159a57d1" path="/var/lib/kubelet/pods/681326ed-5d64-4ba9-942a-8c60159a57d1/volumes"
Sep 18 19:55:57.811551 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.811538    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f4075c9-3a67-48de-a9d4-7c783dfc9b10" path="/var/lib/kubelet/pods/9f4075c9-3a67-48de-a9d4-7c783dfc9b10/volumes"
Sep 18 19:55:57.811855 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.811844    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f745ea94-1c36-42ed-b00c-be2acc4f953c" path="/var/lib/kubelet/pods/f745ea94-1c36-42ed-b00c-be2acc4f953c/volumes"
Sep 18 19:55:57.929890 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.929794    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"]
Sep 18 19:55:57.930386 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.930360    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f4075c9-3a67-48de-a9d4-7c783dfc9b10" containerName="revoke-keys"
Sep 18 19:55:57.930386 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.930386    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f4075c9-3a67-48de-a9d4-7c783dfc9b10" containerName="revoke-keys"
Sep 18 19:55:57.930581 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.930401    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f745ea94-1c36-42ed-b00c-be2acc4f953c" containerName="payload-pre-processing"
Sep 18 19:55:57.930581 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.930410    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f745ea94-1c36-42ed-b00c-be2acc4f953c" containerName="payload-pre-processing"
Sep 18 19:55:57.930581 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.930429    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="681326ed-5d64-4ba9-942a-8c60159a57d1" containerName="payload-processing"
Sep 18 19:55:57.930581 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.930437    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="681326ed-5d64-4ba9-942a-8c60159a57d1" containerName="payload-processing"
Sep 18 19:55:57.930581 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.930520    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f4075c9-3a67-48de-a9d4-7c783dfc9b10" containerName="revoke-keys"
Sep 18 19:55:57.930581 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.930537    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f745ea94-1c36-42ed-b00c-be2acc4f953c" containerName="payload-pre-processing"
Sep 18 19:55:57.930581 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.930548    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="681326ed-5d64-4ba9-942a-8c60159a57d1" containerName="payload-processing"
Sep 18 19:55:57.933628 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.933606    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:57.937185 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.937168    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5b1253e5-openshift-default-dockercfg-gcqhb\""
Sep 18 19:55:57.948424 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.948395    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"]
Sep 18 19:55:57.970670 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.970643    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:57.986898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.986868    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-token\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:57.987064 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.986902    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3beaa9e5-def8-4d33-9abc-514e12e1a762-istiod-ca-cert\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:57.987064 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.986929    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-envoy\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:57.987064 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.987010    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-podinfo\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:57.987215 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.987089    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-data\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:57.987215 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.987126    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-credential-socket\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:57.987215 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.987157    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-workload-socket\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:57.987370 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.987241    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csgm6\" (UniqueName: \"kubernetes.io/projected/3beaa9e5-def8-4d33-9abc-514e12e1a762-kube-api-access-csgm6\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:57.987370 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:57.987302    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-workload-certs\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.088674 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.088635    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-workload-certs\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.088674 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.088678    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-token\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.088896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.088702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3beaa9e5-def8-4d33-9abc-514e12e1a762-istiod-ca-cert\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.088896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.088728    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-envoy\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.088896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.088765    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-podinfo\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.088896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.088792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-data\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.088896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.088812    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-credential-socket\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.088896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.088845    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-workload-socket\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.088896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.088896    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csgm6\" (UniqueName: \"kubernetes.io/projected/3beaa9e5-def8-4d33-9abc-514e12e1a762-kube-api-access-csgm6\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.089305 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.089279    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-data\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.089354 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.089321    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-credential-socket\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.089401 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.089373    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-workload-socket\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.089554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.089526    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-workload-certs\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.089629 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.089613    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3beaa9e5-def8-4d33-9abc-514e12e1a762-istiod-ca-cert\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.091163 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.091142    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-envoy\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.091297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.091278    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-podinfo\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.097660 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.097633    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-token\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.097747 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.097713    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csgm6\" (UniqueName: \"kubernetes.io/projected/3beaa9e5-def8-4d33-9abc-514e12e1a762-kube-api-access-csgm6\") pod \"e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") " pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.186118 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.186020    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:58.246223 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.246189    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:58.287021 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.286005    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:58.532213 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.532182    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"]
Sep 18 19:55:58.533335 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:55:58.533308    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3beaa9e5_def8_4d33_9abc_514e12e1a762.slice/crio-317137ec36ad140cc3e332a08bcf77b9c7b979fd7a44e40a2c41e567e01461a0 WatchSource:0}: Error finding container 317137ec36ad140cc3e332a08bcf77b9c7b979fd7a44e40a2c41e567e01461a0: Status 404 returned error can't find the container with id 317137ec36ad140cc3e332a08bcf77b9c7b979fd7a44e40a2c41e567e01461a0
Sep 18 19:55:58.535545 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.535505    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:55:58.535658 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.535589    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:55:58.535658 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.535633    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:55:58.603626 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.603590    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7" event={"ID":"3beaa9e5-def8-4d33-9abc-514e12e1a762","Type":"ContainerStarted","Data":"2b4d70f4c402fea412adddbc2994ff863a9578d9d2ff08ae76d86dafc36bee8f"}
Sep 18 19:55:58.603803 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.603651    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7" event={"ID":"3beaa9e5-def8-4d33-9abc-514e12e1a762","Type":"ContainerStarted","Data":"317137ec36ad140cc3e332a08bcf77b9c7b979fd7a44e40a2c41e567e01461a0"}
Sep 18 19:55:58.622852 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.622789    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7" podStartSLOduration=1.622767013 podStartE2EDuration="1.622767013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:55:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:55:58.62221057 +0000 UTC m=+1000.949304369" watchObservedRunningTime="2026-09-18 19:55:58.622767013 +0000 UTC m=+1000.949860779"
Sep 18 19:55:58.895410 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:58.895380    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:59.247143 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:59.247035    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:59.252256 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:59.252232    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:59.610387 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:59.610355    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:59.611256 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:59.611237    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:55:59.692210 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:59.692182    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:55:59.965269 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:55:59.965158    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:00.064245 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:00.064198    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:00.686277 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:00.686247    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:01.432215 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:01.432185    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:02.445198 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:02.445155    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:02.556340 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:02.556311    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:02.649353 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:02.649323    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:03.079219 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.079187    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:03.175771 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.175726    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:03.301080 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.301050    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"]
Sep 18 19:56:03.303667 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.303652    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"
Sep 18 19:56:03.309167 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.309150    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-5b1253e5-dockercfg-6cqfl\""
Sep 18 19:56:03.309512 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.309497    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-5b1253e5\""
Sep 18 19:56:03.322297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.322274    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"]
Sep 18 19:56:03.393442 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.393403    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"]
Sep 18 19:56:03.396812 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.396769    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"
Sep 18 19:56:03.432667 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.432635    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"]
Sep 18 19:56:03.447105 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.447075    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d53bddef-7a89-479a-8f7f-c6979776c7fc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn\" (UID: \"d53bddef-7a89-479a-8f7f-c6979776c7fc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"
Sep 18 19:56:03.447480 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.447218    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f97w\" (UniqueName: \"kubernetes.io/projected/d53bddef-7a89-479a-8f7f-c6979776c7fc-kube-api-access-2f97w\") pod \"payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn\" (UID: \"d53bddef-7a89-479a-8f7f-c6979776c7fc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"
Sep 18 19:56:03.547892 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.547855    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bslkk\" (UniqueName: \"kubernetes.io/projected/a56b49ae-12aa-4aff-8652-c2e49d1ea104-kube-api-access-bslkk\") pod \"payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5\" (UID: \"a56b49ae-12aa-4aff-8652-c2e49d1ea104\") " pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"
Sep 18 19:56:03.548118 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.547906    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f97w\" (UniqueName: \"kubernetes.io/projected/d53bddef-7a89-479a-8f7f-c6979776c7fc-kube-api-access-2f97w\") pod \"payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn\" (UID: \"d53bddef-7a89-479a-8f7f-c6979776c7fc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"
Sep 18 19:56:03.548118 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.547928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a56b49ae-12aa-4aff-8652-c2e49d1ea104-plugins-config-volume\") pod \"payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5\" (UID: \"a56b49ae-12aa-4aff-8652-c2e49d1ea104\") " pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"
Sep 18 19:56:03.548233 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.548122    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d53bddef-7a89-479a-8f7f-c6979776c7fc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn\" (UID: \"d53bddef-7a89-479a-8f7f-c6979776c7fc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"
Sep 18 19:56:03.548761 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.548745    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d53bddef-7a89-479a-8f7f-c6979776c7fc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn\" (UID: \"d53bddef-7a89-479a-8f7f-c6979776c7fc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"
Sep 18 19:56:03.561813 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.561786    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f97w\" (UniqueName: \"kubernetes.io/projected/d53bddef-7a89-479a-8f7f-c6979776c7fc-kube-api-access-2f97w\") pod \"payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn\" (UID: \"d53bddef-7a89-479a-8f7f-c6979776c7fc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"
Sep 18 19:56:03.614227 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.614201    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"
Sep 18 19:56:03.649709 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.649632    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a56b49ae-12aa-4aff-8652-c2e49d1ea104-plugins-config-volume\") pod \"payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5\" (UID: \"a56b49ae-12aa-4aff-8652-c2e49d1ea104\") " pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"
Sep 18 19:56:03.649840 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.649752    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bslkk\" (UniqueName: \"kubernetes.io/projected/a56b49ae-12aa-4aff-8652-c2e49d1ea104-kube-api-access-bslkk\") pod \"payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5\" (UID: \"a56b49ae-12aa-4aff-8652-c2e49d1ea104\") " pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"
Sep 18 19:56:03.650326 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.650307    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a56b49ae-12aa-4aff-8652-c2e49d1ea104-plugins-config-volume\") pod \"payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5\" (UID: \"a56b49ae-12aa-4aff-8652-c2e49d1ea104\") " pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"
Sep 18 19:56:03.660497 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.660414    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bslkk\" (UniqueName: \"kubernetes.io/projected/a56b49ae-12aa-4aff-8652-c2e49d1ea104-kube-api-access-bslkk\") pod \"payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5\" (UID: \"a56b49ae-12aa-4aff-8652-c2e49d1ea104\") " pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"
Sep 18 19:56:03.715497 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.715457    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"
Sep 18 19:56:03.756834 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.756806    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:03.895678 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.895653    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"]
Sep 18 19:56:03.897949 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:56:03.897921    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd53bddef_7a89_479a_8f7f_c6979776c7fc.slice/crio-829134144b1d0a5abad46c611267b5c8a6325167e7ee3d823c13a4d5831bbae4 WatchSource:0}: Error finding container 829134144b1d0a5abad46c611267b5c8a6325167e7ee3d823c13a4d5831bbae4: Status 404 returned error can't find the container with id 829134144b1d0a5abad46c611267b5c8a6325167e7ee3d823c13a4d5831bbae4
Sep 18 19:56:03.997439 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:03.997417    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"]
Sep 18 19:56:03.999139 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:56:03.999112    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56b49ae_12aa_4aff_8652_c2e49d1ea104.slice/crio-e0cf40067be76d6716fd56a18537fc8484e152755d1d316f8f9ba2867425eb19 WatchSource:0}: Error finding container e0cf40067be76d6716fd56a18537fc8484e152755d1d316f8f9ba2867425eb19: Status 404 returned error can't find the container with id e0cf40067be76d6716fd56a18537fc8484e152755d1d316f8f9ba2867425eb19
Sep 18 19:56:04.644824 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:04.644787    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn" event={"ID":"d53bddef-7a89-479a-8f7f-c6979776c7fc","Type":"ContainerStarted","Data":"95e641f3c41bdebdfedd0c4c98f5e555ad00df969d229c3a1c2209698e329e76"}
Sep 18 19:56:04.645336 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:04.644849    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn" event={"ID":"d53bddef-7a89-479a-8f7f-c6979776c7fc","Type":"ContainerStarted","Data":"829134144b1d0a5abad46c611267b5c8a6325167e7ee3d823c13a4d5831bbae4"}
Sep 18 19:56:04.645336 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:04.644985    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"
Sep 18 19:56:04.646976 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:04.646948    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5" event={"ID":"a56b49ae-12aa-4aff-8652-c2e49d1ea104","Type":"ContainerStarted","Data":"5980bf60f1fe36bd9b7d8531a7f02a0ee3aa2782676070a1f935181a84628af0"}
Sep 18 19:56:04.647123 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:04.646992    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5" event={"ID":"a56b49ae-12aa-4aff-8652-c2e49d1ea104","Type":"ContainerStarted","Data":"e0cf40067be76d6716fd56a18537fc8484e152755d1d316f8f9ba2867425eb19"}
Sep 18 19:56:04.647123 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:04.647108    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"
Sep 18 19:56:04.675173 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:04.675121    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn" podStartSLOduration=1.675103697 podStartE2EDuration="1.675103697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:56:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:56:04.67036429 +0000 UTC m=+1006.997458048" watchObservedRunningTime="2026-09-18 19:56:04.675103697 +0000 UTC m=+1007.002197461"
Sep 18 19:56:04.701101 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:04.701076    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:05.500049 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:05.500000    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:06.192390 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:06.192358    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:07.082487 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:07.082454    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:15.655263 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:15.655229    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"
Sep 18 19:56:15.655853 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:15.655524    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"
Sep 18 19:56:15.673380 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:15.673333    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5" podStartSLOduration=12.673318758 podStartE2EDuration="12.673318758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:56:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:56:04.694433981 +0000 UTC m=+1007.021527744" watchObservedRunningTime="2026-09-18 19:56:15.673318758 +0000 UTC m=+1018.000412522"
Sep 18 19:56:15.764316 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:15.764285    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:18.481718 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:18.481685    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:22.782637 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:22.782557    2583 generic.go:356] "Generic (PLEG): container finished" podID="3beaa9e5-def8-4d33-9abc-514e12e1a762" containerID="2b4d70f4c402fea412adddbc2994ff863a9578d9d2ff08ae76d86dafc36bee8f" exitCode=0
Sep 18 19:56:22.782637 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:22.782629    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7" event={"ID":"3beaa9e5-def8-4d33-9abc-514e12e1a762","Type":"ContainerDied","Data":"2b4d70f4c402fea412adddbc2994ff863a9578d9d2ff08ae76d86dafc36bee8f"}
Sep 18 19:56:22.783090 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:22.783080    2583 scope.go:117] "RemoveContainer" containerID="2b4d70f4c402fea412adddbc2994ff863a9578d9d2ff08ae76d86dafc36bee8f"
Sep 18 19:56:22.784154 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:22.784127    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:56:22.784211 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:22.784195    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:56:22.784247 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:22.784225    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:56:23.790140 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:23.790105    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7" event={"ID":"3beaa9e5-def8-4d33-9abc-514e12e1a762","Type":"ContainerStarted","Data":"c7e36434155ca56f123d8cebea00688792b55f7b2962ae7c608fccc52b875686"}
Sep 18 19:56:24.247344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:24.247256    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:56:24.247344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:24.247292    2583 patch_prober.go:28] interesting pod/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 18 19:56:24.247344 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:24.247336    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7" podUID="3beaa9e5-def8-4d33-9abc-514e12e1a762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 18 19:56:24.389586 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:24.389555    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:24.904919 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:24.904891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:25.247231 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:25.247146    2583 patch_prober.go:28] interesting pod/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 18 19:56:25.247231 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:25.247207    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7" podUID="3beaa9e5-def8-4d33-9abc-514e12e1a762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 18 19:56:25.713911 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:25.713873    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z"]
Sep 18 19:56:25.717278 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:25.717256    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z"
Sep 18 19:56:25.720374 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:25.720349    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 19:56:25.720640 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:25.720620    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 19:56:25.734764 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:25.734734    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z"]
Sep 18 19:56:25.736718 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:25.736628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:25.775446 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:25.775414    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba54f239-83c7-4e03-b3e6-3de1965ba3e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z\" (UID: \"ba54f239-83c7-4e03-b3e6-3de1965ba3e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z"
Sep 18 19:56:25.876884 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:25.876852    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba54f239-83c7-4e03-b3e6-3de1965ba3e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z\" (UID: \"ba54f239-83c7-4e03-b3e6-3de1965ba3e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z"
Sep 18 19:56:25.877460 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:25.877440    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba54f239-83c7-4e03-b3e6-3de1965ba3e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z\" (UID: \"ba54f239-83c7-4e03-b3e6-3de1965ba3e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z"
Sep 18 19:56:26.040594 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:26.040511    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z"
Sep 18 19:56:26.247521 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:26.247479    2583 patch_prober.go:28] interesting pod/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 18 19:56:26.247703 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:26.247539    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7" podUID="3beaa9e5-def8-4d33-9abc-514e12e1a762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 18 19:56:26.325219 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:26.325122    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z"]
Sep 18 19:56:26.342635 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:56:26.342600    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba54f239_83c7_4e03_b3e6_3de1965ba3e6.slice/crio-452dcbec7310adba741a4abcff83d436eaaea3f73d61cb6efb53afbedcb0078d WatchSource:0}: Error finding container 452dcbec7310adba741a4abcff83d436eaaea3f73d61cb6efb53afbedcb0078d: Status 404 returned error can't find the container with id 452dcbec7310adba741a4abcff83d436eaaea3f73d61cb6efb53afbedcb0078d
Sep 18 19:56:26.543693 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:26.543667    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:26.822753 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:26.821823    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z" event={"ID":"ba54f239-83c7-4e03-b3e6-3de1965ba3e6","Type":"ContainerStarted","Data":"e39311f945f2a2761cb416fa11159a592ac259f87292e7a7810a26d7e7be0dab"}
Sep 18 19:56:26.822753 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:26.821889    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z" event={"ID":"ba54f239-83c7-4e03-b3e6-3de1965ba3e6","Type":"ContainerStarted","Data":"452dcbec7310adba741a4abcff83d436eaaea3f73d61cb6efb53afbedcb0078d"}
Sep 18 19:56:26.840647 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:26.840596    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z" podStartSLOduration=1.8405798469999999 podStartE2EDuration="1.840579847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:56:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:56:26.837802421 +0000 UTC m=+1029.164896186" watchObservedRunningTime="2026-09-18 19:56:26.840579847 +0000 UTC m=+1029.167673611"
Sep 18 19:56:27.246977 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:27.246950    2583 patch_prober.go:28] interesting pod/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 18 19:56:27.247331 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:27.247002    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7" podUID="3beaa9e5-def8-4d33-9abc-514e12e1a762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 18 19:56:27.308180 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:27.308143    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:27.841771 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:27.841729    2583 generic.go:356] "Generic (PLEG): container finished" podID="ba54f239-83c7-4e03-b3e6-3de1965ba3e6" containerID="e39311f945f2a2761cb416fa11159a592ac259f87292e7a7810a26d7e7be0dab" exitCode=0
Sep 18 19:56:27.841946 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:27.841815    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z" event={"ID":"ba54f239-83c7-4e03-b3e6-3de1965ba3e6","Type":"ContainerDied","Data":"e39311f945f2a2761cb416fa11159a592ac259f87292e7a7810a26d7e7be0dab"}
Sep 18 19:56:27.996443 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:27.996413    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:28.246878 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:28.246793    2583 patch_prober.go:28] interesting pod/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 18 19:56:28.246878 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:28.246849    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7" podUID="3beaa9e5-def8-4d33-9abc-514e12e1a762" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 18 19:56:28.889615 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:28.889566    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:29.005029 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:29.005004    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z"
Sep 18 19:56:29.104755 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:29.104658    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba54f239-83c7-4e03-b3e6-3de1965ba3e6-maas-api-service-ca\") pod \"ba54f239-83c7-4e03-b3e6-3de1965ba3e6\" (UID: \"ba54f239-83c7-4e03-b3e6-3de1965ba3e6\") "
Sep 18 19:56:29.105052 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:29.105013    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba54f239-83c7-4e03-b3e6-3de1965ba3e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ba54f239-83c7-4e03-b3e6-3de1965ba3e6" (UID: "ba54f239-83c7-4e03-b3e6-3de1965ba3e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:56:29.206377 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:29.206340    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba54f239-83c7-4e03-b3e6-3de1965ba3e6-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:29.251030 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:29.251003    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:56:29.251564 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:29.251540    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:56:29.252214 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:29.252192    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:56:29.558091 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:29.557983    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:29.856543 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:29.856512    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z"
Sep 18 19:56:29.856716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:29.856541    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z" event={"ID":"ba54f239-83c7-4e03-b3e6-3de1965ba3e6","Type":"ContainerDied","Data":"452dcbec7310adba741a4abcff83d436eaaea3f73d61cb6efb53afbedcb0078d"}
Sep 18 19:56:29.856716 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:29.856587    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="452dcbec7310adba741a4abcff83d436eaaea3f73d61cb6efb53afbedcb0078d"
Sep 18 19:56:30.339871 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:30.339840    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:31.102969 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:31.102941    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:31.741708 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:31.741644    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:31.770428 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:31.770393    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"]
Sep 18 19:56:31.770670 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:31.770641    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5" podUID="a56b49ae-12aa-4aff-8652-c2e49d1ea104" containerName="payload-processing" containerID="cri-o://5980bf60f1fe36bd9b7d8531a7f02a0ee3aa2782676070a1f935181a84628af0" gracePeriod=30
Sep 18 19:56:31.778640 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:31.778284    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"]
Sep 18 19:56:31.778640 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:31.778506    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn" podUID="d53bddef-7a89-479a-8f7f-c6979776c7fc" containerName="payload-pre-processing" containerID="cri-o://95e641f3c41bdebdfedd0c4c98f5e555ad00df969d229c3a1c2209698e329e76" gracePeriod=30
Sep 18 19:56:31.820996 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:31.820965    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:31.877328 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:31.877298    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:31.937593 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:31.937554    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z"]
Sep 18 19:56:31.940294 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:31.940257    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5b1253e5-swm8z"]
Sep 18 19:56:31.941147 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:31.941126    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:32.013261 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.013173    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:32.080903 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.080879    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"
Sep 18 19:56:32.083982 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.083963    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"
Sep 18 19:56:32.145451 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.145421    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a56b49ae-12aa-4aff-8652-c2e49d1ea104-plugins-config-volume\") pod \"a56b49ae-12aa-4aff-8652-c2e49d1ea104\" (UID: \"a56b49ae-12aa-4aff-8652-c2e49d1ea104\") "
Sep 18 19:56:32.145642 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.145467    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d53bddef-7a89-479a-8f7f-c6979776c7fc-plugins-config-volume\") pod \"d53bddef-7a89-479a-8f7f-c6979776c7fc\" (UID: \"d53bddef-7a89-479a-8f7f-c6979776c7fc\") "
Sep 18 19:56:32.145642 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.145551    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f97w\" (UniqueName: \"kubernetes.io/projected/d53bddef-7a89-479a-8f7f-c6979776c7fc-kube-api-access-2f97w\") pod \"d53bddef-7a89-479a-8f7f-c6979776c7fc\" (UID: \"d53bddef-7a89-479a-8f7f-c6979776c7fc\") "
Sep 18 19:56:32.145642 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.145599    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bslkk\" (UniqueName: \"kubernetes.io/projected/a56b49ae-12aa-4aff-8652-c2e49d1ea104-kube-api-access-bslkk\") pod \"a56b49ae-12aa-4aff-8652-c2e49d1ea104\" (UID: \"a56b49ae-12aa-4aff-8652-c2e49d1ea104\") "
Sep 18 19:56:32.145831 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.145814    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d53bddef-7a89-479a-8f7f-c6979776c7fc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d53bddef-7a89-479a-8f7f-c6979776c7fc" (UID: "d53bddef-7a89-479a-8f7f-c6979776c7fc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:56:32.146005 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.145952    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d53bddef-7a89-479a-8f7f-c6979776c7fc-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:32.146628 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.146584    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a56b49ae-12aa-4aff-8652-c2e49d1ea104-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a56b49ae-12aa-4aff-8652-c2e49d1ea104" (UID: "a56b49ae-12aa-4aff-8652-c2e49d1ea104"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:56:32.149021 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.148993    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a56b49ae-12aa-4aff-8652-c2e49d1ea104-kube-api-access-bslkk" (OuterVolumeSpecName: "kube-api-access-bslkk") pod "a56b49ae-12aa-4aff-8652-c2e49d1ea104" (UID: "a56b49ae-12aa-4aff-8652-c2e49d1ea104"). InnerVolumeSpecName "kube-api-access-bslkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:56:32.149161 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.149025    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d53bddef-7a89-479a-8f7f-c6979776c7fc-kube-api-access-2f97w" (OuterVolumeSpecName: "kube-api-access-2f97w") pod "d53bddef-7a89-479a-8f7f-c6979776c7fc" (UID: "d53bddef-7a89-479a-8f7f-c6979776c7fc"). InnerVolumeSpecName "kube-api-access-2f97w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:56:32.246696 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.246664    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f97w\" (UniqueName: \"kubernetes.io/projected/d53bddef-7a89-479a-8f7f-c6979776c7fc-kube-api-access-2f97w\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:32.246696 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.246691    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bslkk\" (UniqueName: \"kubernetes.io/projected/a56b49ae-12aa-4aff-8652-c2e49d1ea104-kube-api-access-bslkk\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:32.246696 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.246703    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a56b49ae-12aa-4aff-8652-c2e49d1ea104-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:32.412865 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.412836    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:32.875660 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.875627    2583 generic.go:356] "Generic (PLEG): container finished" podID="d53bddef-7a89-479a-8f7f-c6979776c7fc" containerID="95e641f3c41bdebdfedd0c4c98f5e555ad00df969d229c3a1c2209698e329e76" exitCode=0
Sep 18 19:56:32.876102 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.875667    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"
Sep 18 19:56:32.876102 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.875712    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn" event={"ID":"d53bddef-7a89-479a-8f7f-c6979776c7fc","Type":"ContainerDied","Data":"95e641f3c41bdebdfedd0c4c98f5e555ad00df969d229c3a1c2209698e329e76"}
Sep 18 19:56:32.876102 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.875768    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn" event={"ID":"d53bddef-7a89-479a-8f7f-c6979776c7fc","Type":"ContainerDied","Data":"829134144b1d0a5abad46c611267b5c8a6325167e7ee3d823c13a4d5831bbae4"}
Sep 18 19:56:32.876102 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.875799    2583 scope.go:117] "RemoveContainer" containerID="95e641f3c41bdebdfedd0c4c98f5e555ad00df969d229c3a1c2209698e329e76"
Sep 18 19:56:32.877094 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.877078    2583 generic.go:356] "Generic (PLEG): container finished" podID="a56b49ae-12aa-4aff-8652-c2e49d1ea104" containerID="5980bf60f1fe36bd9b7d8531a7f02a0ee3aa2782676070a1f935181a84628af0" exitCode=0
Sep 18 19:56:32.877155 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.877126    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"
Sep 18 19:56:32.877193 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.877158    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5" event={"ID":"a56b49ae-12aa-4aff-8652-c2e49d1ea104","Type":"ContainerDied","Data":"5980bf60f1fe36bd9b7d8531a7f02a0ee3aa2782676070a1f935181a84628af0"}
Sep 18 19:56:32.877231 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.877192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5" event={"ID":"a56b49ae-12aa-4aff-8652-c2e49d1ea104","Type":"ContainerDied","Data":"e0cf40067be76d6716fd56a18537fc8484e152755d1d316f8f9ba2867425eb19"}
Sep 18 19:56:32.886597 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.886573    2583 scope.go:117] "RemoveContainer" containerID="95e641f3c41bdebdfedd0c4c98f5e555ad00df969d229c3a1c2209698e329e76"
Sep 18 19:56:32.886898 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:56:32.886870    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95e641f3c41bdebdfedd0c4c98f5e555ad00df969d229c3a1c2209698e329e76\": container with ID starting with 95e641f3c41bdebdfedd0c4c98f5e555ad00df969d229c3a1c2209698e329e76 not found: ID does not exist" containerID="95e641f3c41bdebdfedd0c4c98f5e555ad00df969d229c3a1c2209698e329e76"
Sep 18 19:56:32.886988 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.886912    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95e641f3c41bdebdfedd0c4c98f5e555ad00df969d229c3a1c2209698e329e76"} err="failed to get container status \"95e641f3c41bdebdfedd0c4c98f5e555ad00df969d229c3a1c2209698e329e76\": rpc error: code = NotFound desc = could not find container \"95e641f3c41bdebdfedd0c4c98f5e555ad00df969d229c3a1c2209698e329e76\": container with ID starting with 95e641f3c41bdebdfedd0c4c98f5e555ad00df969d229c3a1c2209698e329e76 not found: ID does not exist"
Sep 18 19:56:32.886988 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.886937    2583 scope.go:117] "RemoveContainer" containerID="5980bf60f1fe36bd9b7d8531a7f02a0ee3aa2782676070a1f935181a84628af0"
Sep 18 19:56:32.895533 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.895511    2583 scope.go:117] "RemoveContainer" containerID="5980bf60f1fe36bd9b7d8531a7f02a0ee3aa2782676070a1f935181a84628af0"
Sep 18 19:56:32.895784 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:56:32.895766    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5980bf60f1fe36bd9b7d8531a7f02a0ee3aa2782676070a1f935181a84628af0\": container with ID starting with 5980bf60f1fe36bd9b7d8531a7f02a0ee3aa2782676070a1f935181a84628af0 not found: ID does not exist" containerID="5980bf60f1fe36bd9b7d8531a7f02a0ee3aa2782676070a1f935181a84628af0"
Sep 18 19:56:32.895834 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.895790    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5980bf60f1fe36bd9b7d8531a7f02a0ee3aa2782676070a1f935181a84628af0"} err="failed to get container status \"5980bf60f1fe36bd9b7d8531a7f02a0ee3aa2782676070a1f935181a84628af0\": rpc error: code = NotFound desc = could not find container \"5980bf60f1fe36bd9b7d8531a7f02a0ee3aa2782676070a1f935181a84628af0\": container with ID starting with 5980bf60f1fe36bd9b7d8531a7f02a0ee3aa2782676070a1f935181a84628af0 not found: ID does not exist"
Sep 18 19:56:32.903046 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.903020    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"]
Sep 18 19:56:32.908925 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.908901    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5b1253e5-7b5d5d7555-gt4b5"]
Sep 18 19:56:32.919424 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.919396    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"]
Sep 18 19:56:32.921783 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:32.921765    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5b1253e5-8545566cd6-7bzjn"]
Sep 18 19:56:33.112105 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:33.112074    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"]
Sep 18 19:56:33.112287 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:33.112268    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7" podUID="3beaa9e5-def8-4d33-9abc-514e12e1a762" containerName="istio-proxy" containerID="cri-o://c7e36434155ca56f123d8cebea00688792b55f7b2962ae7c608fccc52b875686" gracePeriod=30
Sep 18 19:56:33.132274 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:33.132245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:33.257646 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:33.257615    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:33.541848 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:33.541752    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:33.813101 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:33.812998    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a56b49ae-12aa-4aff-8652-c2e49d1ea104" path="/var/lib/kubelet/pods/a56b49ae-12aa-4aff-8652-c2e49d1ea104/volumes"
Sep 18 19:56:33.813550 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:33.813526    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba54f239-83c7-4e03-b3e6-3de1965ba3e6" path="/var/lib/kubelet/pods/ba54f239-83c7-4e03-b3e6-3de1965ba3e6/volumes"
Sep 18 19:56:33.814000 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:33.813980    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d53bddef-7a89-479a-8f7f-c6979776c7fc" path="/var/lib/kubelet/pods/d53bddef-7a89-479a-8f7f-c6979776c7fc/volumes"
Sep 18 19:56:33.863198 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:33.863171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:34.100033 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:34.100004    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:34.200680 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:34.200643    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:34.911615 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:34.911584    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:35.905399 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:35.905371    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:36.422011 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:36.421973    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:36.514580 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:36.514545    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:36.806591 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:36.806507    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:37.505249 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:37.505209    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:38.169663 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.169628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:38.382424 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.382360    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:56:38.513712 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.513678    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-data\") pod \"3beaa9e5-def8-4d33-9abc-514e12e1a762\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") "
Sep 18 19:56:38.513712 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.513715    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-token\") pod \"3beaa9e5-def8-4d33-9abc-514e12e1a762\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") "
Sep 18 19:56:38.514280 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.513756    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-credential-socket\") pod \"3beaa9e5-def8-4d33-9abc-514e12e1a762\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") "
Sep 18 19:56:38.514280 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.513937    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-workload-socket\") pod \"3beaa9e5-def8-4d33-9abc-514e12e1a762\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") "
Sep 18 19:56:38.514280 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.513986    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-podinfo\") pod \"3beaa9e5-def8-4d33-9abc-514e12e1a762\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") "
Sep 18 19:56:38.514280 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.514011    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3beaa9e5-def8-4d33-9abc-514e12e1a762" (UID: "3beaa9e5-def8-4d33-9abc-514e12e1a762"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:56:38.514280 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.514029    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-data" (OuterVolumeSpecName: "istio-data") pod "3beaa9e5-def8-4d33-9abc-514e12e1a762" (UID: "3beaa9e5-def8-4d33-9abc-514e12e1a762"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:56:38.514280 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.514075    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-envoy\") pod \"3beaa9e5-def8-4d33-9abc-514e12e1a762\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") "
Sep 18 19:56:38.514280 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.514098    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3beaa9e5-def8-4d33-9abc-514e12e1a762-istiod-ca-cert\") pod \"3beaa9e5-def8-4d33-9abc-514e12e1a762\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") "
Sep 18 19:56:38.514280 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.514166    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3beaa9e5-def8-4d33-9abc-514e12e1a762" (UID: "3beaa9e5-def8-4d33-9abc-514e12e1a762"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:56:38.514280 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.514193    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-workload-certs\") pod \"3beaa9e5-def8-4d33-9abc-514e12e1a762\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") "
Sep 18 19:56:38.514280 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.514247    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csgm6\" (UniqueName: \"kubernetes.io/projected/3beaa9e5-def8-4d33-9abc-514e12e1a762-kube-api-access-csgm6\") pod \"3beaa9e5-def8-4d33-9abc-514e12e1a762\" (UID: \"3beaa9e5-def8-4d33-9abc-514e12e1a762\") "
Sep 18 19:56:38.514762 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.514397    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3beaa9e5-def8-4d33-9abc-514e12e1a762" (UID: "3beaa9e5-def8-4d33-9abc-514e12e1a762"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:56:38.514762 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.514459    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3beaa9e5-def8-4d33-9abc-514e12e1a762-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3beaa9e5-def8-4d33-9abc-514e12e1a762" (UID: "3beaa9e5-def8-4d33-9abc-514e12e1a762"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:56:38.514762 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.514621    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-workload-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:38.514762 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.514644    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-data\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:38.514762 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.514658    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-credential-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:38.514762 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.514671    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-workload-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:38.514762 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.514684    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3beaa9e5-def8-4d33-9abc-514e12e1a762-istiod-ca-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:38.516283 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.516254    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3beaa9e5-def8-4d33-9abc-514e12e1a762" (UID: "3beaa9e5-def8-4d33-9abc-514e12e1a762"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:56:38.516408 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.516298    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3beaa9e5-def8-4d33-9abc-514e12e1a762" (UID: "3beaa9e5-def8-4d33-9abc-514e12e1a762"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 19:56:38.516541 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.516517    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-token" (OuterVolumeSpecName: "istio-token") pod "3beaa9e5-def8-4d33-9abc-514e12e1a762" (UID: "3beaa9e5-def8-4d33-9abc-514e12e1a762"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:56:38.516626 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.516591    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3beaa9e5-def8-4d33-9abc-514e12e1a762-kube-api-access-csgm6" (OuterVolumeSpecName: "kube-api-access-csgm6") pod "3beaa9e5-def8-4d33-9abc-514e12e1a762" (UID: "3beaa9e5-def8-4d33-9abc-514e12e1a762"). InnerVolumeSpecName "kube-api-access-csgm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:56:38.615506 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.615458    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csgm6\" (UniqueName: \"kubernetes.io/projected/3beaa9e5-def8-4d33-9abc-514e12e1a762-kube-api-access-csgm6\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:38.615506 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.615503    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:38.615506 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.615514    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-podinfo\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:38.615506 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.615522    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3beaa9e5-def8-4d33-9abc-514e12e1a762-istio-envoy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:38.918433 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.918399    2583 generic.go:356] "Generic (PLEG): container finished" podID="3beaa9e5-def8-4d33-9abc-514e12e1a762" containerID="c7e36434155ca56f123d8cebea00688792b55f7b2962ae7c608fccc52b875686" exitCode=0
Sep 18 19:56:38.918611 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.918448    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"
Sep 18 19:56:38.918611 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.918482    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7" event={"ID":"3beaa9e5-def8-4d33-9abc-514e12e1a762","Type":"ContainerDied","Data":"c7e36434155ca56f123d8cebea00688792b55f7b2962ae7c608fccc52b875686"}
Sep 18 19:56:38.918611 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.918533    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7" event={"ID":"3beaa9e5-def8-4d33-9abc-514e12e1a762","Type":"ContainerDied","Data":"317137ec36ad140cc3e332a08bcf77b9c7b979fd7a44e40a2c41e567e01461a0"}
Sep 18 19:56:38.918611 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.918556    2583 scope.go:117] "RemoveContainer" containerID="c7e36434155ca56f123d8cebea00688792b55f7b2962ae7c608fccc52b875686"
Sep 18 19:56:38.928938 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.928922    2583 scope.go:117] "RemoveContainer" containerID="2b4d70f4c402fea412adddbc2994ff863a9578d9d2ff08ae76d86dafc36bee8f"
Sep 18 19:56:38.939822 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.939802    2583 scope.go:117] "RemoveContainer" containerID="c7e36434155ca56f123d8cebea00688792b55f7b2962ae7c608fccc52b875686"
Sep 18 19:56:38.942553 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:56:38.942434    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7e36434155ca56f123d8cebea00688792b55f7b2962ae7c608fccc52b875686\": container with ID starting with c7e36434155ca56f123d8cebea00688792b55f7b2962ae7c608fccc52b875686 not found: ID does not exist" containerID="c7e36434155ca56f123d8cebea00688792b55f7b2962ae7c608fccc52b875686"
Sep 18 19:56:38.942553 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.942471    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7e36434155ca56f123d8cebea00688792b55f7b2962ae7c608fccc52b875686"} err="failed to get container status \"c7e36434155ca56f123d8cebea00688792b55f7b2962ae7c608fccc52b875686\": rpc error: code = NotFound desc = could not find container \"c7e36434155ca56f123d8cebea00688792b55f7b2962ae7c608fccc52b875686\": container with ID starting with c7e36434155ca56f123d8cebea00688792b55f7b2962ae7c608fccc52b875686 not found: ID does not exist"
Sep 18 19:56:38.942553 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.942494    2583 scope.go:117] "RemoveContainer" containerID="2b4d70f4c402fea412adddbc2994ff863a9578d9d2ff08ae76d86dafc36bee8f"
Sep 18 19:56:38.942909 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.942873    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"]
Sep 18 19:56:38.943078 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:56:38.943059    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b4d70f4c402fea412adddbc2994ff863a9578d9d2ff08ae76d86dafc36bee8f\": container with ID starting with 2b4d70f4c402fea412adddbc2994ff863a9578d9d2ff08ae76d86dafc36bee8f not found: ID does not exist" containerID="2b4d70f4c402fea412adddbc2994ff863a9578d9d2ff08ae76d86dafc36bee8f"
Sep 18 19:56:38.943150 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.943085    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b4d70f4c402fea412adddbc2994ff863a9578d9d2ff08ae76d86dafc36bee8f"} err="failed to get container status \"2b4d70f4c402fea412adddbc2994ff863a9578d9d2ff08ae76d86dafc36bee8f\": rpc error: code = NotFound desc = could not find container \"2b4d70f4c402fea412adddbc2994ff863a9578d9d2ff08ae76d86dafc36bee8f\": container with ID starting with 2b4d70f4c402fea412adddbc2994ff863a9578d9d2ff08ae76d86dafc36bee8f not found: ID does not exist"
Sep 18 19:56:38.945410 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:38.945393    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5b1253e5-openshift-default-5cc69869d4-qc2z7"]
Sep 18 19:56:39.020155 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:39.020124    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:39.694433 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:39.694402    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:39.811924 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:39.811894    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3beaa9e5-def8-4d33-9abc-514e12e1a762" path="/var/lib/kubelet/pods/3beaa9e5-def8-4d33-9abc-514e12e1a762/volumes"
Sep 18 19:56:40.401638 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:40.401610    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:40.501978 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:40.501930    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:40.906595 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:40.906568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:41.005921 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.005887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:41.060887 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.060853    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"]
Sep 18 19:56:41.061277 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061264    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d53bddef-7a89-479a-8f7f-c6979776c7fc" containerName="payload-pre-processing"
Sep 18 19:56:41.061331 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061279    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d53bddef-7a89-479a-8f7f-c6979776c7fc" containerName="payload-pre-processing"
Sep 18 19:56:41.061331 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061290    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3beaa9e5-def8-4d33-9abc-514e12e1a762" containerName="istio-proxy"
Sep 18 19:56:41.061331 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061296    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3beaa9e5-def8-4d33-9abc-514e12e1a762" containerName="istio-proxy"
Sep 18 19:56:41.061331 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061315    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3beaa9e5-def8-4d33-9abc-514e12e1a762" containerName="istio-proxy"
Sep 18 19:56:41.061331 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061321    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3beaa9e5-def8-4d33-9abc-514e12e1a762" containerName="istio-proxy"
Sep 18 19:56:41.061487 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061335    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a56b49ae-12aa-4aff-8652-c2e49d1ea104" containerName="payload-processing"
Sep 18 19:56:41.061487 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061341    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a56b49ae-12aa-4aff-8652-c2e49d1ea104" containerName="payload-processing"
Sep 18 19:56:41.061487 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061348    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba54f239-83c7-4e03-b3e6-3de1965ba3e6" containerName="revoke-keys"
Sep 18 19:56:41.061487 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061353    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba54f239-83c7-4e03-b3e6-3de1965ba3e6" containerName="revoke-keys"
Sep 18 19:56:41.061487 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061409    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a56b49ae-12aa-4aff-8652-c2e49d1ea104" containerName="payload-processing"
Sep 18 19:56:41.061487 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061417    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba54f239-83c7-4e03-b3e6-3de1965ba3e6" containerName="revoke-keys"
Sep 18 19:56:41.061487 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061424    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3beaa9e5-def8-4d33-9abc-514e12e1a762" containerName="istio-proxy"
Sep 18 19:56:41.061487 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061431    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3beaa9e5-def8-4d33-9abc-514e12e1a762" containerName="istio-proxy"
Sep 18 19:56:41.061487 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.061439    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d53bddef-7a89-479a-8f7f-c6979776c7fc" containerName="payload-pre-processing"
Sep 18 19:56:41.066096 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.066077    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"
Sep 18 19:56:41.068617 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.068597    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-2c301e6b-dockercfg-lkq2n\""
Sep 18 19:56:41.068841 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.068827    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-2c301e6b\""
Sep 18 19:56:41.076563 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.076539    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:41.076929 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.076908    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"]
Sep 18 19:56:41.091048 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.091016    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"]
Sep 18 19:56:41.094672 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.094655    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"
Sep 18 19:56:41.106762 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.106739    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"]
Sep 18 19:56:41.137342 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.137316    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21a101f8-9986-4e5e-bde9-b178a461b36d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff\" (UID: \"21a101f8-9986-4e5e-bde9-b178a461b36d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"
Sep 18 19:56:41.137494 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.137434    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxbp4\" (UniqueName: \"kubernetes.io/projected/21a101f8-9986-4e5e-bde9-b178a461b36d-kube-api-access-qxbp4\") pod \"payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff\" (UID: \"21a101f8-9986-4e5e-bde9-b178a461b36d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"
Sep 18 19:56:41.238554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.238458    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7mcw\" (UniqueName: \"kubernetes.io/projected/f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc-kube-api-access-v7mcw\") pod \"payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86\" (UID: \"f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc\") " pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"
Sep 18 19:56:41.238554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.238541    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc-plugins-config-volume\") pod \"payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86\" (UID: \"f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc\") " pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"
Sep 18 19:56:41.238791 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.238586    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxbp4\" (UniqueName: \"kubernetes.io/projected/21a101f8-9986-4e5e-bde9-b178a461b36d-kube-api-access-qxbp4\") pod \"payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff\" (UID: \"21a101f8-9986-4e5e-bde9-b178a461b36d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"
Sep 18 19:56:41.238791 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.238697    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21a101f8-9986-4e5e-bde9-b178a461b36d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff\" (UID: \"21a101f8-9986-4e5e-bde9-b178a461b36d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"
Sep 18 19:56:41.239425 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.239399    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21a101f8-9986-4e5e-bde9-b178a461b36d-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff\" (UID: \"21a101f8-9986-4e5e-bde9-b178a461b36d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"
Sep 18 19:56:41.246385 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.246364    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxbp4\" (UniqueName: \"kubernetes.io/projected/21a101f8-9986-4e5e-bde9-b178a461b36d-kube-api-access-qxbp4\") pod \"payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff\" (UID: \"21a101f8-9986-4e5e-bde9-b178a461b36d\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"
Sep 18 19:56:41.339862 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.339828    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7mcw\" (UniqueName: \"kubernetes.io/projected/f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc-kube-api-access-v7mcw\") pod \"payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86\" (UID: \"f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc\") " pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"
Sep 18 19:56:41.339976 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.339887    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc-plugins-config-volume\") pod \"payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86\" (UID: \"f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc\") " pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"
Sep 18 19:56:41.340554 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.340536    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc-plugins-config-volume\") pod \"payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86\" (UID: \"f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc\") " pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"
Sep 18 19:56:41.347891 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.347872    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7mcw\" (UniqueName: \"kubernetes.io/projected/f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc-kube-api-access-v7mcw\") pod \"payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86\" (UID: \"f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc\") " pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"
Sep 18 19:56:41.378427 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.378405    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"
Sep 18 19:56:41.405692 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.405667    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"
Sep 18 19:56:41.651691 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.651665    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"]
Sep 18 19:56:41.653025 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:56:41.652999    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a101f8_9986_4e5e_bde9_b178a461b36d.slice/crio-fb3fb3570becb241691ee14ab86e13301520030488dd87f02de65abdbc7c7b06 WatchSource:0}: Error finding container fb3fb3570becb241691ee14ab86e13301520030488dd87f02de65abdbc7c7b06: Status 404 returned error can't find the container with id fb3fb3570becb241691ee14ab86e13301520030488dd87f02de65abdbc7c7b06
Sep 18 19:56:41.687621 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.687597    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"]
Sep 18 19:56:41.690233 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:56:41.690208    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3cab642_6d25_4c9b_8e04_afeaeb5ce7dc.slice/crio-54a3603bff71b95da413ec42819ef2c431b4013ec5ff8e5dd80234ed744d2da9 WatchSource:0}: Error finding container 54a3603bff71b95da413ec42819ef2c431b4013ec5ff8e5dd80234ed744d2da9: Status 404 returned error can't find the container with id 54a3603bff71b95da413ec42819ef2c431b4013ec5ff8e5dd80234ed744d2da9
Sep 18 19:56:41.939358 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.939255    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff" event={"ID":"21a101f8-9986-4e5e-bde9-b178a461b36d","Type":"ContainerStarted","Data":"4bf328ecc17aa0c0b709b13ed9541180c1237218a528d3c3311c68f4bfa71cfa"}
Sep 18 19:56:41.939358 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.939322    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff" event={"ID":"21a101f8-9986-4e5e-bde9-b178a461b36d","Type":"ContainerStarted","Data":"fb3fb3570becb241691ee14ab86e13301520030488dd87f02de65abdbc7c7b06"}
Sep 18 19:56:41.939895 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.939471    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"
Sep 18 19:56:41.941276 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.941251    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86" event={"ID":"f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc","Type":"ContainerStarted","Data":"0c9580954480b2dd4fe7fc23a9d7c1a11e35d8f7e365d07dbc9c305ca124f808"}
Sep 18 19:56:41.941410 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.941305    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"
Sep 18 19:56:41.941410 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.941331    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86" event={"ID":"f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc","Type":"ContainerStarted","Data":"54a3603bff71b95da413ec42819ef2c431b4013ec5ff8e5dd80234ed744d2da9"}
Sep 18 19:56:41.959528 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.959467    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff" podStartSLOduration=0.959447042 podStartE2EDuration="959.447042ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:56:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:56:41.955209263 +0000 UTC m=+1044.282303029" watchObservedRunningTime="2026-09-18 19:56:41.959447042 +0000 UTC m=+1044.286540809"
Sep 18 19:56:41.976392 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:41.976348    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86" podStartSLOduration=0.976333521 podStartE2EDuration="976.333521ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:56:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:56:41.973394232 +0000 UTC m=+1044.300488000" watchObservedRunningTime="2026-09-18 19:56:41.976333521 +0000 UTC m=+1044.303427288"
Sep 18 19:56:48.308871 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:48.308836    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8"]
Sep 18 19:56:48.312454 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:48.312438    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8"
Sep 18 19:56:48.315283 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:48.315254    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 19:56:48.315374 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:48.315266    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 19:56:48.321134 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:48.321065    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8"]
Sep 18 19:56:48.416501 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:48.416465    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f4f9d4-97d9-4aa9-83fa-3d4b801e1416-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-1d073e-5lkj8\" (UID: \"22f4f9d4-97d9-4aa9-83fa-3d4b801e1416\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8"
Sep 18 19:56:48.518098 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:48.518066    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f4f9d4-97d9-4aa9-83fa-3d4b801e1416-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-1d073e-5lkj8\" (UID: \"22f4f9d4-97d9-4aa9-83fa-3d4b801e1416\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8"
Sep 18 19:56:48.518672 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:48.518645    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f4f9d4-97d9-4aa9-83fa-3d4b801e1416-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-1d073e-5lkj8\" (UID: \"22f4f9d4-97d9-4aa9-83fa-3d4b801e1416\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8"
Sep 18 19:56:48.626521 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:48.626489    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8"
Sep 18 19:56:48.686894 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:48.686796    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:48.898387 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:48.898361    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8"]
Sep 18 19:56:48.899875 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:56:48.899850    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f4f9d4_97d9_4aa9_83fa_3d4b801e1416.slice/crio-5ad48e272b7d83908d4736a02a47b959fa60e89a422117d0b621b630becaf36d WatchSource:0}: Error finding container 5ad48e272b7d83908d4736a02a47b959fa60e89a422117d0b621b630becaf36d: Status 404 returned error can't find the container with id 5ad48e272b7d83908d4736a02a47b959fa60e89a422117d0b621b630becaf36d
Sep 18 19:56:48.988096 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:48.988061    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8" event={"ID":"22f4f9d4-97d9-4aa9-83fa-3d4b801e1416","Type":"ContainerStarted","Data":"5ad48e272b7d83908d4736a02a47b959fa60e89a422117d0b621b630becaf36d"}
Sep 18 19:56:49.400313 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:49.400286    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:49.565258 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:49.565180    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:49.995806 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:49.995777    2583 generic.go:356] "Generic (PLEG): container finished" podID="22f4f9d4-97d9-4aa9-83fa-3d4b801e1416" containerID="887681f99ef5de821084ce37d747955889f7c7c8c27593f895fc40ac7cc7f253" exitCode=0
Sep 18 19:56:49.995984 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:49.995851    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8" event={"ID":"22f4f9d4-97d9-4aa9-83fa-3d4b801e1416","Type":"ContainerDied","Data":"887681f99ef5de821084ce37d747955889f7c7c8c27593f895fc40ac7cc7f253"}
Sep 18 19:56:50.303749 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:50.303667    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:50.985506 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:50.985479    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:51.154168 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:51.154143    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8"
Sep 18 19:56:51.344359 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:51.344327    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f4f9d4-97d9-4aa9-83fa-3d4b801e1416-maas-api-service-ca\") pod \"22f4f9d4-97d9-4aa9-83fa-3d4b801e1416\" (UID: \"22f4f9d4-97d9-4aa9-83fa-3d4b801e1416\") "
Sep 18 19:56:51.344700 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:51.344679    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22f4f9d4-97d9-4aa9-83fa-3d4b801e1416-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "22f4f9d4-97d9-4aa9-83fa-3d4b801e1416" (UID: "22f4f9d4-97d9-4aa9-83fa-3d4b801e1416"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:56:51.445108 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:51.445077    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/22f4f9d4-97d9-4aa9-83fa-3d4b801e1416-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:51.762955 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:51.762874    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:52.009480 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:52.009448    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8"
Sep 18 19:56:52.009835 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:52.009479    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8" event={"ID":"22f4f9d4-97d9-4aa9-83fa-3d4b801e1416","Type":"ContainerDied","Data":"5ad48e272b7d83908d4736a02a47b959fa60e89a422117d0b621b630becaf36d"}
Sep 18 19:56:52.009835 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:52.009528    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ad48e272b7d83908d4736a02a47b959fa60e89a422117d0b621b630becaf36d"
Sep 18 19:56:52.527331 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:52.527295    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:52.949744 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:52.949716    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"
Sep 18 19:56:52.949891 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:52.949792    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"
Sep 18 19:56:53.291662 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:53.291551    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:54.206320 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:54.206287    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:55.126722 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:55.126693    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:55.932317 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:55.932277    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:56.254307 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:56.254231    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw"]
Sep 18 19:56:56.254679 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:56.254644    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22f4f9d4-97d9-4aa9-83fa-3d4b801e1416" containerName="revoke-keys"
Sep 18 19:56:56.254679 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:56.254655    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="22f4f9d4-97d9-4aa9-83fa-3d4b801e1416" containerName="revoke-keys"
Sep 18 19:56:56.254758 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:56.254734    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="22f4f9d4-97d9-4aa9-83fa-3d4b801e1416" containerName="revoke-keys"
Sep 18 19:56:56.257877 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:56.257860    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw"
Sep 18 19:56:56.269744 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:56.269728    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 19:56:56.269833 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:56.269745    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 19:56:56.294578 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:56.294535    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8b4dcfc-9b2e-4220-a228-73019e72d9f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw\" (UID: \"b8b4dcfc-9b2e-4220-a228-73019e72d9f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw"
Sep 18 19:56:56.296737 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:56.296696    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw"]
Sep 18 19:56:56.395872 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:56.395835    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8b4dcfc-9b2e-4220-a228-73019e72d9f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw\" (UID: \"b8b4dcfc-9b2e-4220-a228-73019e72d9f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw"
Sep 18 19:56:56.396517 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:56.396497    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8b4dcfc-9b2e-4220-a228-73019e72d9f5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw\" (UID: \"b8b4dcfc-9b2e-4220-a228-73019e72d9f5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw"
Sep 18 19:56:56.568081 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:56.567970    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw"
Sep 18 19:56:56.839322 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:56.839297    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw"]
Sep 18 19:56:56.840667 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:56:56.840642    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b4dcfc_9b2e_4220_a228_73019e72d9f5.slice/crio-9b2ed30d50e1a9af69beae07084e9c91cf847624a55e1ea382f434db8f4e03d8 WatchSource:0}: Error finding container 9b2ed30d50e1a9af69beae07084e9c91cf847624a55e1ea382f434db8f4e03d8: Status 404 returned error can't find the container with id 9b2ed30d50e1a9af69beae07084e9c91cf847624a55e1ea382f434db8f4e03d8
Sep 18 19:56:57.042360 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:57.042330    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw" event={"ID":"b8b4dcfc-9b2e-4220-a228-73019e72d9f5","Type":"ContainerStarted","Data":"9b2ed30d50e1a9af69beae07084e9c91cf847624a55e1ea382f434db8f4e03d8"}
Sep 18 19:56:57.117212 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:57.117187    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:58.049660 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:58.049627    2583 generic.go:356] "Generic (PLEG): container finished" podID="b8b4dcfc-9b2e-4220-a228-73019e72d9f5" containerID="502bd14107620f0639fecb3de21673b2556ca787f2c0aefb8d11ff8a27500d9f" exitCode=0
Sep 18 19:56:58.050029 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:58.049711    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw" event={"ID":"b8b4dcfc-9b2e-4220-a228-73019e72d9f5","Type":"ContainerDied","Data":"502bd14107620f0639fecb3de21673b2556ca787f2c0aefb8d11ff8a27500d9f"}
Sep 18 19:56:58.187569 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:58.187539    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:58.921339 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:58.921309    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:56:59.200700 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:59.200672    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw"
Sep 18 19:56:59.218826 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:59.218802    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8b4dcfc-9b2e-4220-a228-73019e72d9f5-maas-api-service-ca\") pod \"b8b4dcfc-9b2e-4220-a228-73019e72d9f5\" (UID: \"b8b4dcfc-9b2e-4220-a228-73019e72d9f5\") "
Sep 18 19:56:59.219209 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:59.219171    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8b4dcfc-9b2e-4220-a228-73019e72d9f5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b8b4dcfc-9b2e-4220-a228-73019e72d9f5" (UID: "b8b4dcfc-9b2e-4220-a228-73019e72d9f5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:56:59.320093 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:59.320066    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8b4dcfc-9b2e-4220-a228-73019e72d9f5-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:56:59.937786 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:56:59.937755    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:00.063505 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:00.063476    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw" event={"ID":"b8b4dcfc-9b2e-4220-a228-73019e72d9f5","Type":"ContainerDied","Data":"9b2ed30d50e1a9af69beae07084e9c91cf847624a55e1ea382f434db8f4e03d8"}
Sep 18 19:57:00.063505 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:00.063503    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw"
Sep 18 19:57:00.063732 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:00.063520    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b2ed30d50e1a9af69beae07084e9c91cf847624a55e1ea382f434db8f4e03d8"
Sep 18 19:57:00.614359 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:00.614331    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:00.688480 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:00.688451    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:01.275265 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:01.275220    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:01.339660 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:01.339627    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:01.398503 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:01.398463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:01.498958 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:01.498869    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:01.551289 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:01.551204    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8"]
Sep 18 19:57:01.573062 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:01.558869    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-1d073e-5lkj8"]
Sep 18 19:57:01.599161 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:01.599131    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:01.798545 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:01.798507    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:01.811745 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:01.811681    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22f4f9d4-97d9-4aa9-83fa-3d4b801e1416" path="/var/lib/kubelet/pods/22f4f9d4-97d9-4aa9-83fa-3d4b801e1416/volumes"
Sep 18 19:57:01.921599 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:01.921574    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:02.760302 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:02.760267    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:03.492510 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:03.492479    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:04.278712 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:04.278680    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:05.011821 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:05.011770    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:05.791882 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:05.791836    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:06.608374 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:06.608346    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:06.999061 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:06.998959    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:07.235411 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.235386    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:07.266593 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.266519    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"]
Sep 18 19:57:07.266819 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.266793    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86" podUID="f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc" containerName="payload-processing" containerID="cri-o://0c9580954480b2dd4fe7fc23a9d7c1a11e35d8f7e365d07dbc9c305ca124f808" gracePeriod=30
Sep 18 19:57:07.276565 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.276541    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"]
Sep 18 19:57:07.276816 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.276789    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff" podUID="21a101f8-9986-4e5e-bde9-b178a461b36d" containerName="payload-pre-processing" containerID="cri-o://4bf328ecc17aa0c0b709b13ed9541180c1237218a528d3c3311c68f4bfa71cfa" gracePeriod=30
Sep 18 19:57:07.311385 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.311352    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:07.369460 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.369431    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:07.463737 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.463711    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw"]
Sep 18 19:57:07.466850 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.466827    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:07.468331 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.468313    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-2c301e6b-ppqdw"]
Sep 18 19:57:07.526012 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.525977    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:07.549513 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.549475    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"
Sep 18 19:57:07.589841 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.587405    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"
Sep 18 19:57:07.598976 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.598948    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc-plugins-config-volume\") pod \"f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc\" (UID: \"f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc\") "
Sep 18 19:57:07.599170 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.599013    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7mcw\" (UniqueName: \"kubernetes.io/projected/f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc-kube-api-access-v7mcw\") pod \"f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc\" (UID: \"f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc\") "
Sep 18 19:57:07.599465 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.599439    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc" (UID: "f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:57:07.602253 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.602222    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc-kube-api-access-v7mcw" (OuterVolumeSpecName: "kube-api-access-v7mcw") pod "f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc" (UID: "f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc"). InnerVolumeSpecName "kube-api-access-v7mcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:57:07.604147 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.604105    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:07.700077 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.700017    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21a101f8-9986-4e5e-bde9-b178a461b36d-plugins-config-volume\") pod \"21a101f8-9986-4e5e-bde9-b178a461b36d\" (UID: \"21a101f8-9986-4e5e-bde9-b178a461b36d\") "
Sep 18 19:57:07.700576 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.700129    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxbp4\" (UniqueName: \"kubernetes.io/projected/21a101f8-9986-4e5e-bde9-b178a461b36d-kube-api-access-qxbp4\") pod \"21a101f8-9986-4e5e-bde9-b178a461b36d\" (UID: \"21a101f8-9986-4e5e-bde9-b178a461b36d\") "
Sep 18 19:57:07.700576 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.700453    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7mcw\" (UniqueName: \"kubernetes.io/projected/f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc-kube-api-access-v7mcw\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:57:07.700576 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.700473    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:57:07.701296 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.701268    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21a101f8-9986-4e5e-bde9-b178a461b36d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "21a101f8-9986-4e5e-bde9-b178a461b36d" (UID: "21a101f8-9986-4e5e-bde9-b178a461b36d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:57:07.704168 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.703402    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21a101f8-9986-4e5e-bde9-b178a461b36d-kube-api-access-qxbp4" (OuterVolumeSpecName: "kube-api-access-qxbp4") pod "21a101f8-9986-4e5e-bde9-b178a461b36d" (UID: "21a101f8-9986-4e5e-bde9-b178a461b36d"). InnerVolumeSpecName "kube-api-access-qxbp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:57:07.801521 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.801440    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/21a101f8-9986-4e5e-bde9-b178a461b36d-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:57:07.801521 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.801469    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxbp4\" (UniqueName: \"kubernetes.io/projected/21a101f8-9986-4e5e-bde9-b178a461b36d-kube-api-access-qxbp4\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:57:07.812273 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:07.812242    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8b4dcfc-9b2e-4220-a228-73019e72d9f5" path="/var/lib/kubelet/pods/b8b4dcfc-9b2e-4220-a228-73019e72d9f5/volumes"
Sep 18 19:57:08.023314 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.023281    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:08.111151 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.111119    2583 generic.go:356] "Generic (PLEG): container finished" podID="21a101f8-9986-4e5e-bde9-b178a461b36d" containerID="4bf328ecc17aa0c0b709b13ed9541180c1237218a528d3c3311c68f4bfa71cfa" exitCode=0
Sep 18 19:57:08.111359 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.111168    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"
Sep 18 19:57:08.111359 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.111212    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff" event={"ID":"21a101f8-9986-4e5e-bde9-b178a461b36d","Type":"ContainerDied","Data":"4bf328ecc17aa0c0b709b13ed9541180c1237218a528d3c3311c68f4bfa71cfa"}
Sep 18 19:57:08.111359 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.111265    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff" event={"ID":"21a101f8-9986-4e5e-bde9-b178a461b36d","Type":"ContainerDied","Data":"fb3fb3570becb241691ee14ab86e13301520030488dd87f02de65abdbc7c7b06"}
Sep 18 19:57:08.111359 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.111301    2583 scope.go:117] "RemoveContainer" containerID="4bf328ecc17aa0c0b709b13ed9541180c1237218a528d3c3311c68f4bfa71cfa"
Sep 18 19:57:08.112704 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.112681    2583 generic.go:356] "Generic (PLEG): container finished" podID="f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc" containerID="0c9580954480b2dd4fe7fc23a9d7c1a11e35d8f7e365d07dbc9c305ca124f808" exitCode=0
Sep 18 19:57:08.112840 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.112724    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"
Sep 18 19:57:08.112840 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.112773    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86" event={"ID":"f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc","Type":"ContainerDied","Data":"0c9580954480b2dd4fe7fc23a9d7c1a11e35d8f7e365d07dbc9c305ca124f808"}
Sep 18 19:57:08.112840 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.112828    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86" event={"ID":"f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc","Type":"ContainerDied","Data":"54a3603bff71b95da413ec42819ef2c431b4013ec5ff8e5dd80234ed744d2da9"}
Sep 18 19:57:08.121227 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.121210    2583 scope.go:117] "RemoveContainer" containerID="4bf328ecc17aa0c0b709b13ed9541180c1237218a528d3c3311c68f4bfa71cfa"
Sep 18 19:57:08.121491 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:57:08.121474    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bf328ecc17aa0c0b709b13ed9541180c1237218a528d3c3311c68f4bfa71cfa\": container with ID starting with 4bf328ecc17aa0c0b709b13ed9541180c1237218a528d3c3311c68f4bfa71cfa not found: ID does not exist" containerID="4bf328ecc17aa0c0b709b13ed9541180c1237218a528d3c3311c68f4bfa71cfa"
Sep 18 19:57:08.121565 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.121504    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bf328ecc17aa0c0b709b13ed9541180c1237218a528d3c3311c68f4bfa71cfa"} err="failed to get container status \"4bf328ecc17aa0c0b709b13ed9541180c1237218a528d3c3311c68f4bfa71cfa\": rpc error: code = NotFound desc = could not find container \"4bf328ecc17aa0c0b709b13ed9541180c1237218a528d3c3311c68f4bfa71cfa\": container with ID starting with 4bf328ecc17aa0c0b709b13ed9541180c1237218a528d3c3311c68f4bfa71cfa not found: ID does not exist"
Sep 18 19:57:08.121565 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.121524    2583 scope.go:117] "RemoveContainer" containerID="0c9580954480b2dd4fe7fc23a9d7c1a11e35d8f7e365d07dbc9c305ca124f808"
Sep 18 19:57:08.130033 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.130018    2583 scope.go:117] "RemoveContainer" containerID="0c9580954480b2dd4fe7fc23a9d7c1a11e35d8f7e365d07dbc9c305ca124f808"
Sep 18 19:57:08.130400 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:57:08.130381    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c9580954480b2dd4fe7fc23a9d7c1a11e35d8f7e365d07dbc9c305ca124f808\": container with ID starting with 0c9580954480b2dd4fe7fc23a9d7c1a11e35d8f7e365d07dbc9c305ca124f808 not found: ID does not exist" containerID="0c9580954480b2dd4fe7fc23a9d7c1a11e35d8f7e365d07dbc9c305ca124f808"
Sep 18 19:57:08.130470 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.130411    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c9580954480b2dd4fe7fc23a9d7c1a11e35d8f7e365d07dbc9c305ca124f808"} err="failed to get container status \"0c9580954480b2dd4fe7fc23a9d7c1a11e35d8f7e365d07dbc9c305ca124f808\": rpc error: code = NotFound desc = could not find container \"0c9580954480b2dd4fe7fc23a9d7c1a11e35d8f7e365d07dbc9c305ca124f808\": container with ID starting with 0c9580954480b2dd4fe7fc23a9d7c1a11e35d8f7e365d07dbc9c305ca124f808 not found: ID does not exist"
Sep 18 19:57:08.132534 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.132516    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"]
Sep 18 19:57:08.137937 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.137919    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-2c301e6b-7bd6b689b5-fsc86"]
Sep 18 19:57:08.147880 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.147860    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"]
Sep 18 19:57:08.154176 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.154157    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2c301e6b-7b49fc646-8crff"]
Sep 18 19:57:08.297345 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.297311    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:08.384743 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.384667    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:08.485202 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.485172    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:08.973507 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:08.973473    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:09.811251 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:09.811220    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21a101f8-9986-4e5e-bde9-b178a461b36d" path="/var/lib/kubelet/pods/21a101f8-9986-4e5e-bde9-b178a461b36d/volumes"
Sep 18 19:57:09.811589 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:09.811577    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc" path="/var/lib/kubelet/pods/f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc/volumes"
Sep 18 19:57:09.875533 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:09.875505    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:10.020080 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:10.020052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:10.712463 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:10.712435    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:11.400006 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:11.399977    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:15.722157 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:15.722117    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:15.826441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:15.826413    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:15.902885 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:15.902856    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:15.966932 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:15.966900    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:16.466165 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:16.466134    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:26.604470 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:26.604432    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:42.452825 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:42.452795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:43.895313 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:43.895283    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:44.137616 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:44.137583    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"]
Sep 18 19:57:44.137822 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:44.137781    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6" podUID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerName="istio-proxy" containerID="cri-o://3de92b1538ef6d1431c9caa5941bb4e0bfdb4e15d74e27b2f0cbb3839b988ccf" gracePeriod=30
Sep 18 19:57:44.160469 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:44.160401    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:44.626421 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:44.626393    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:45.138143 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:45.138114    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:45.215638 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:45.215605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:46.175025 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:46.174984    2583 patch_prober.go:28] interesting pod/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 19:57:46.175415 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:46.175072    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6" podUID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 19:57:48.158304 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.158272    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"]
Sep 18 19:57:48.158704 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.158691    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc" containerName="payload-processing"
Sep 18 19:57:48.158750 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.158705    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc" containerName="payload-processing"
Sep 18 19:57:48.158750 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.158724    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21a101f8-9986-4e5e-bde9-b178a461b36d" containerName="payload-pre-processing"
Sep 18 19:57:48.158750 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.158730    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="21a101f8-9986-4e5e-bde9-b178a461b36d" containerName="payload-pre-processing"
Sep 18 19:57:48.158750 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.158740    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8b4dcfc-9b2e-4220-a228-73019e72d9f5" containerName="revoke-keys"
Sep 18 19:57:48.158750 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.158745    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8b4dcfc-9b2e-4220-a228-73019e72d9f5" containerName="revoke-keys"
Sep 18 19:57:48.158904 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.158811    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8b4dcfc-9b2e-4220-a228-73019e72d9f5" containerName="revoke-keys"
Sep 18 19:57:48.158904 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.158819    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3cab642-6d25-4c9b-8e04-afeaeb5ce7dc" containerName="payload-processing"
Sep 18 19:57:48.158904 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.158825    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="21a101f8-9986-4e5e-bde9-b178a461b36d" containerName="payload-pre-processing"
Sep 18 19:57:48.162035 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.162019    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.164589 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.164565    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-d94b9e\"/\"openshift-service-ca.crt\""
Sep 18 19:57:48.165611 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.165591    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-d94b9e\"/\"default-dockercfg-8wprj\""
Sep 18 19:57:48.165666 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.165598    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-d94b9e\"/\"kube-root-ca.crt\""
Sep 18 19:57:48.165666 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.165657    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-d94b9e\"/\"premium-w0-d94b9e-kserve-self-signed-certs\""
Sep 18 19:57:48.170309 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.170290    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"]
Sep 18 19:57:48.240592 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.240558    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:48.273603 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.273576    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-home\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.273745 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.273618    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-model-cache\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.273745 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.273736    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-tmp-dir\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.273825 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.273758    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq9cx\" (UniqueName: \"kubernetes.io/projected/f81bea2d-4d78-472f-bbdc-ba2b84f24009-kube-api-access-hq9cx\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.273825 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.273779    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-dshm\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.273825 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.273800    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f81bea2d-4d78-472f-bbdc-ba2b84f24009-tls-certs\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.342564 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.342398    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:48.374825 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.374797    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-model-cache\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.375021 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.374885    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-tmp-dir\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.375021 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.374909    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq9cx\" (UniqueName: \"kubernetes.io/projected/f81bea2d-4d78-472f-bbdc-ba2b84f24009-kube-api-access-hq9cx\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.375021 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.374930    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-dshm\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.375021 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.374944    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f81bea2d-4d78-472f-bbdc-ba2b84f24009-tls-certs\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.375021 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.374962    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-home\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.375331 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.375280    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-model-cache\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.375331 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.375302    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-tmp-dir\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.375408 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.375355    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-home\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.377266 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.377245    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-dshm\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.377520 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.377504    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f81bea2d-4d78-472f-bbdc-ba2b84f24009-tls-certs\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.383387 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.383364    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq9cx\" (UniqueName: \"kubernetes.io/projected/f81bea2d-4d78-472f-bbdc-ba2b84f24009-kube-api-access-hq9cx\") pod \"premium-w0-d94b9e-kserve-577797b64f-xpq8l\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") " pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.444577 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.444486    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:48.472007 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.471975    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:48.558221 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.558026    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:48.746537 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:48.746510    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"]
Sep 18 19:57:48.747508 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:57:48.747482    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf81bea2d_4d78_472f_bbdc_ba2b84f24009.slice/crio-39e0790b1841d5b85f14dc0dc81c006754aac99bbf1563a8c6ee74128b2fd2b4 WatchSource:0}: Error finding container 39e0790b1841d5b85f14dc0dc81c006754aac99bbf1563a8c6ee74128b2fd2b4: Status 404 returned error can't find the container with id 39e0790b1841d5b85f14dc0dc81c006754aac99bbf1563a8c6ee74128b2fd2b4
Sep 18 19:57:49.002549 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.002472    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:49.127872 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.127842    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:49.253317 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.253227    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:49.368885 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.368851    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:49.370764 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.370736    2583 generic.go:356] "Generic (PLEG): container finished" podID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerID="3de92b1538ef6d1431c9caa5941bb4e0bfdb4e15d74e27b2f0cbb3839b988ccf" exitCode=0
Sep 18 19:57:49.370901 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.370808    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6" event={"ID":"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5","Type":"ContainerDied","Data":"3de92b1538ef6d1431c9caa5941bb4e0bfdb4e15d74e27b2f0cbb3839b988ccf"}
Sep 18 19:57:49.370901 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.370878    2583 scope.go:117] "RemoveContainer" containerID="43eb11a82e953e7ce0ac8316f06393905b6c4144e2eb15b45092a64bbc8a6893"
Sep 18 19:57:49.373196 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.373172    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l" event={"ID":"f81bea2d-4d78-472f-bbdc-ba2b84f24009","Type":"ContainerStarted","Data":"b269dff0e17c5dc667991f90e95fecd56527e59b7ff28b0841b3fa555e227146"}
Sep 18 19:57:49.373325 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.373212    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l" event={"ID":"f81bea2d-4d78-472f-bbdc-ba2b84f24009","Type":"ContainerStarted","Data":"39e0790b1841d5b85f14dc0dc81c006754aac99bbf1563a8c6ee74128b2fd2b4"}
Sep 18 19:57:49.401304 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.401254    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l" podStartSLOduration=1.40123468 podStartE2EDuration="1.40123468s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:57:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:57:49.391556111 +0000 UTC m=+1111.718649876" watchObservedRunningTime="2026-09-18 19:57:49.40123468 +0000 UTC m=+1111.728328456"
Sep 18 19:57:49.417069 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.417033    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:57:49.489603 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.489571    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-workload-socket\") pod \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") "
Sep 18 19:57:49.489603 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.489610    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-podinfo\") pod \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") "
Sep 18 19:57:49.489861 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.489626    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istiod-ca-cert\") pod \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") "
Sep 18 19:57:49.489861 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.489678    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-workload-certs\") pod \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") "
Sep 18 19:57:49.489861 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.489715    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-credential-socket\") pod \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") "
Sep 18 19:57:49.489861 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.489843    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dhq5\" (UniqueName: \"kubernetes.io/projected/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-kube-api-access-6dhq5\") pod \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") "
Sep 18 19:57:49.490102 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.489888    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" (UID: "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:57:49.490102 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.489936    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-token\") pod \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") "
Sep 18 19:57:49.490102 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.489981    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-data\") pod \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") "
Sep 18 19:57:49.490102 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.490053    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-envoy\") pod \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\" (UID: \"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5\") "
Sep 18 19:57:49.490102 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.490096    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" (UID: "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:57:49.490369 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.490174    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" (UID: "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:57:49.490369 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.490318    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" (UID: "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:57:49.490523 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.490500    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" (UID: "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:57:49.490642 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.490625    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-workload-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:57:49.490782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.490745    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-credential-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:57:49.490782 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.490768    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-data\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:57:49.490898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.490783    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-workload-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:57:49.490898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.490795    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istiod-ca-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:57:49.492386 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.492358    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" (UID: "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 19:57:49.492502 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.492434    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-kube-api-access-6dhq5" (OuterVolumeSpecName: "kube-api-access-6dhq5") pod "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" (UID: "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5"). InnerVolumeSpecName "kube-api-access-6dhq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:57:49.492502 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.492484    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" (UID: "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:57:49.492882 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.492853    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" (UID: "2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:57:49.592431 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.592397    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-envoy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:57:49.592431 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.592431    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-podinfo\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:57:49.592618 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.592445    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dhq5\" (UniqueName: \"kubernetes.io/projected/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-kube-api-access-6dhq5\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:57:49.592618 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:49.592460    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:57:50.137778 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:50.137743    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:50.380385 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:50.380355    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"
Sep 18 19:57:50.380817 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:50.380403    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6" event={"ID":"2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5","Type":"ContainerDied","Data":"07ff2bb4a1104b40d49d3f03fc5a5cb6bba9d219f6bb7561382825753cab1c66"}
Sep 18 19:57:50.380817 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:50.380453    2583 scope.go:117] "RemoveContainer" containerID="3de92b1538ef6d1431c9caa5941bb4e0bfdb4e15d74e27b2f0cbb3839b988ccf"
Sep 18 19:57:50.399666 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:50.399644    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"]
Sep 18 19:57:50.403788 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:50.403770    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-1d073e-openshift-default-797fbf4d4b-htmb6"]
Sep 18 19:57:50.893526 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:50.893499    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:51.600776 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:51.600751    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:51.660393 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:51.660364    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:51.760621 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:51.760594    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:51.812225 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:51.812184    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" path="/var/lib/kubelet/pods/2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5/volumes"
Sep 18 19:57:52.070888 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.070816    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:52.169390 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.169362    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:57:52.213230 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.213204    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"]
Sep 18 19:57:52.213641 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.213629    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerName="istio-proxy"
Sep 18 19:57:52.213691 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.213643    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerName="istio-proxy"
Sep 18 19:57:52.213691 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.213652    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerName="istio-proxy"
Sep 18 19:57:52.213691 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.213657    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerName="istio-proxy"
Sep 18 19:57:52.213787 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.213727    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerName="istio-proxy"
Sep 18 19:57:52.217863 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.217845    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"
Sep 18 19:57:52.221130 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.221110    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-be2171-dockercfg-2hfnz\""
Sep 18 19:57:52.221251 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.221155    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-be2171\""
Sep 18 19:57:52.230657 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.230633    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"]
Sep 18 19:57:52.254525 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.254504    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"]
Sep 18 19:57:52.254956 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.254943    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d7e1bb1-dd14-47b0-829d-2a648ca9e8e5" containerName="istio-proxy"
Sep 18 19:57:52.257914 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.257899    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"
Sep 18 19:57:52.267473 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.267455    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"]
Sep 18 19:57:52.321690 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.321604    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b8b8817-7601-469f-98e1-cd49914da46e-plugins-config-volume\") pod \"payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm\" (UID: \"7b8b8817-7601-469f-98e1-cd49914da46e\") " pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"
Sep 18 19:57:52.322034 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.322010    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59c78fd9-c468-4b16-8f41-dd6dab3eaad0-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd\" (UID: \"59c78fd9-c468-4b16-8f41-dd6dab3eaad0\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"
Sep 18 19:57:52.322255 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.322238    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfxk8\" (UniqueName: \"kubernetes.io/projected/59c78fd9-c468-4b16-8f41-dd6dab3eaad0-kube-api-access-wfxk8\") pod \"payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd\" (UID: \"59c78fd9-c468-4b16-8f41-dd6dab3eaad0\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"
Sep 18 19:57:52.322442 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.322425    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6bsm\" (UniqueName: \"kubernetes.io/projected/7b8b8817-7601-469f-98e1-cd49914da46e-kube-api-access-l6bsm\") pod \"payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm\" (UID: \"7b8b8817-7601-469f-98e1-cd49914da46e\") " pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"
Sep 18 19:57:52.423500 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.423469    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b8b8817-7601-469f-98e1-cd49914da46e-plugins-config-volume\") pod \"payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm\" (UID: \"7b8b8817-7601-469f-98e1-cd49914da46e\") " pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"
Sep 18 19:57:52.423656 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.423524    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59c78fd9-c468-4b16-8f41-dd6dab3eaad0-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd\" (UID: \"59c78fd9-c468-4b16-8f41-dd6dab3eaad0\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"
Sep 18 19:57:52.423656 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.423554    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfxk8\" (UniqueName: \"kubernetes.io/projected/59c78fd9-c468-4b16-8f41-dd6dab3eaad0-kube-api-access-wfxk8\") pod \"payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd\" (UID: \"59c78fd9-c468-4b16-8f41-dd6dab3eaad0\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"
Sep 18 19:57:52.423656 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.423593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6bsm\" (UniqueName: \"kubernetes.io/projected/7b8b8817-7601-469f-98e1-cd49914da46e-kube-api-access-l6bsm\") pod \"payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm\" (UID: \"7b8b8817-7601-469f-98e1-cd49914da46e\") " pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"
Sep 18 19:57:52.424255 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.424234    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b8b8817-7601-469f-98e1-cd49914da46e-plugins-config-volume\") pod \"payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm\" (UID: \"7b8b8817-7601-469f-98e1-cd49914da46e\") " pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"
Sep 18 19:57:52.424333 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.424273    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59c78fd9-c468-4b16-8f41-dd6dab3eaad0-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd\" (UID: \"59c78fd9-c468-4b16-8f41-dd6dab3eaad0\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"
Sep 18 19:57:52.432687 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.432657    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6bsm\" (UniqueName: \"kubernetes.io/projected/7b8b8817-7601-469f-98e1-cd49914da46e-kube-api-access-l6bsm\") pod \"payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm\" (UID: \"7b8b8817-7601-469f-98e1-cd49914da46e\") " pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"
Sep 18 19:57:52.432687 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.432674    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfxk8\" (UniqueName: \"kubernetes.io/projected/59c78fd9-c468-4b16-8f41-dd6dab3eaad0-kube-api-access-wfxk8\") pod \"payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd\" (UID: \"59c78fd9-c468-4b16-8f41-dd6dab3eaad0\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"
Sep 18 19:57:52.529336 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.529311    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"
Sep 18 19:57:52.569451 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.569423    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"
Sep 18 19:57:52.806084 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.806028    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"]
Sep 18 19:57:52.810879 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:57:52.810858    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8b8817_7601_469f_98e1_cd49914da46e.slice/crio-0214fb9385540393f25db219e927b608c452f26ee0c1d45b1169e7016c67dc7e WatchSource:0}: Error finding container 0214fb9385540393f25db219e927b608c452f26ee0c1d45b1169e7016c67dc7e: Status 404 returned error can't find the container with id 0214fb9385540393f25db219e927b608c452f26ee0c1d45b1169e7016c67dc7e
Sep 18 19:57:52.854925 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:52.854900    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"]
Sep 18 19:57:52.856092 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:57:52.856066    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59c78fd9_c468_4b16_8f41_dd6dab3eaad0.slice/crio-1252f0cec0947c1e963c0afc239581338dbfbd1cbaab8c812fc9e935d211a667 WatchSource:0}: Error finding container 1252f0cec0947c1e963c0afc239581338dbfbd1cbaab8c812fc9e935d211a667: Status 404 returned error can't find the container with id 1252f0cec0947c1e963c0afc239581338dbfbd1cbaab8c812fc9e935d211a667
Sep 18 19:57:53.400144 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:53.400109    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm" event={"ID":"7b8b8817-7601-469f-98e1-cd49914da46e","Type":"ContainerStarted","Data":"69f594c8b7d4996f2520878e12126b2d7b3129609b5dee18b03499317b496133"}
Sep 18 19:57:53.400315 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:53.400171    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm" event={"ID":"7b8b8817-7601-469f-98e1-cd49914da46e","Type":"ContainerStarted","Data":"0214fb9385540393f25db219e927b608c452f26ee0c1d45b1169e7016c67dc7e"}
Sep 18 19:57:53.400394 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:53.400306    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"
Sep 18 19:57:53.401813 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:53.401789    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd" event={"ID":"59c78fd9-c468-4b16-8f41-dd6dab3eaad0","Type":"ContainerStarted","Data":"66402e67a3b57e709832e1154a92fbf48d384445dc48e2e9744f9458b2ed28cd"}
Sep 18 19:57:53.401918 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:53.401828    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd" event={"ID":"59c78fd9-c468-4b16-8f41-dd6dab3eaad0","Type":"ContainerStarted","Data":"1252f0cec0947c1e963c0afc239581338dbfbd1cbaab8c812fc9e935d211a667"}
Sep 18 19:57:53.401918 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:53.401868    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"
Sep 18 19:57:53.418443 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:53.418393    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm" podStartSLOduration=1.418379861 podStartE2EDuration="1.418379861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:57:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:57:53.415573088 +0000 UTC m=+1115.742666863" watchObservedRunningTime="2026-09-18 19:57:53.418379861 +0000 UTC m=+1115.745473619"
Sep 18 19:57:53.431131 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:53.431090    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd" podStartSLOduration=1.431076731 podStartE2EDuration="1.431076731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:57:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:57:53.429824265 +0000 UTC m=+1115.756918056" watchObservedRunningTime="2026-09-18 19:57:53.431076731 +0000 UTC m=+1115.758170517"
Sep 18 19:57:58.472959 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:58.472926    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:58.473358 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:58.472975    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:58.485516 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:58.485492    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:59.446901 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:59.446869    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 19:57:59.559572 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:57:59.559531    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:04.410573 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:04.410542    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"
Sep 18 19:58:04.410959 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:04.410633    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"
Sep 18 19:58:05.115204 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:05.115156    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:10.989625 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:10.989580    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:11.049055 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:11.049014    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:11.127203 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:11.127160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:11.230174 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:11.230144    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:13.465412 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:13.465380    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:13.729180 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:13.729099    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:14.804181 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:14.804144    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:15.495696 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:15.495664    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:16.195293 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:16.195258    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:17.130892 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:17.130856    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:18.135322 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:18.135294    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:21.732385 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:21.732352    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:22.530300 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:22.530271    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:28.523461 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:28.523424    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:28.632268 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:28.632239    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:28.724981 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:28.724952    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:28.828056 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:28.827956    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:29.463389 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:29.463360    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:29.563324 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:29.563297    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:29.664461 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:29.664436    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:31.152659 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:31.152624    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:37.092250 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:37.092220    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:37.192443 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:37.192412    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:37.772334 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:37.772306    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:43.428475 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:43.428441    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:43.529633 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:43.529601    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:43.650284 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:43.650257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:43.931896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:43.931856    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"]
Sep 18 19:58:43.935555 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:43.935535    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:43.938295 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:43.938277    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-870f71c0-openshift-default-dockercfg-5tqm7\""
Sep 18 19:58:43.954674 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:43.954652    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"]
Sep 18 19:58:43.963428 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:43.963407    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:44.040058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.038378    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-workload-certs\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.040058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.038430    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-istio-envoy\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.040058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.038467    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0121711b-41c2-45a7-872b-05af7c858e0f-istiod-ca-cert\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.040058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.038525    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-credential-socket\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.040058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.038559    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7s54\" (UniqueName: \"kubernetes.io/projected/0121711b-41c2-45a7-872b-05af7c858e0f-kube-api-access-h7s54\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.040058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.038607    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-workload-socket\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.040058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.038641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0121711b-41c2-45a7-872b-05af7c858e0f-istio-token\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.040058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.038686    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0121711b-41c2-45a7-872b-05af7c858e0f-istio-podinfo\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.040058 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.038806    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-istio-data\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.076172 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.076134    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:44.141441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.139811    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-workload-certs\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.141441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.139865    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-istio-envoy\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.141441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.139890    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0121711b-41c2-45a7-872b-05af7c858e0f-istiod-ca-cert\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.141441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.139921    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-credential-socket\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.141441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.139946    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7s54\" (UniqueName: \"kubernetes.io/projected/0121711b-41c2-45a7-872b-05af7c858e0f-kube-api-access-h7s54\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.141441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.139979    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-workload-socket\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.141441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.140007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0121711b-41c2-45a7-872b-05af7c858e0f-istio-token\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.141441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.140057    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0121711b-41c2-45a7-872b-05af7c858e0f-istio-podinfo\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.141441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.140148    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-istio-data\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.141441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.140566    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-istio-data\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.141441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.140804    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-credential-socket\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.141441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.140831    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0121711b-41c2-45a7-872b-05af7c858e0f-istiod-ca-cert\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.141441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.141098    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-workload-certs\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.141441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.141374    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-workload-socket\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.143691 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.143668    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-istio-envoy\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.143819 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.143754    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0121711b-41c2-45a7-872b-05af7c858e0f-istio-podinfo\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.149066 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.149015    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0121711b-41c2-45a7-872b-05af7c858e0f-istio-token\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.149341 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.149323    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7s54\" (UniqueName: \"kubernetes.io/projected/0121711b-41c2-45a7-872b-05af7c858e0f-kube-api-access-h7s54\") pod \"e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") " pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.246296 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.246218    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:44.570682 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:58:44.570648    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0121711b_41c2_45a7_872b_05af7c858e0f.slice/crio-3888a249059c103851ccddca528168054c34fa6f53de2a9e39692ada6f59d4dd WatchSource:0}: Error finding container 3888a249059c103851ccddca528168054c34fa6f53de2a9e39692ada6f59d4dd: Status 404 returned error can't find the container with id 3888a249059c103851ccddca528168054c34fa6f53de2a9e39692ada6f59d4dd
Sep 18 19:58:44.570998 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.570762    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"]
Sep 18 19:58:44.572921 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.572887    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:58:44.573009 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.572950    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:58:44.573009 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.572978    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:58:44.713791 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.713757    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr" event={"ID":"0121711b-41c2-45a7-872b-05af7c858e0f","Type":"ContainerStarted","Data":"01371bf4934a1082d14bb623869df707ad08be7f90361b3f40a24ca2374d4984"}
Sep 18 19:58:44.713997 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.713805    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr" event={"ID":"0121711b-41c2-45a7-872b-05af7c858e0f","Type":"ContainerStarted","Data":"3888a249059c103851ccddca528168054c34fa6f53de2a9e39692ada6f59d4dd"}
Sep 18 19:58:44.733372 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:44.733304    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr" podStartSLOduration=1.733282683 podStartE2EDuration="1.733282683s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:58:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:58:44.732713439 +0000 UTC m=+1167.059807214" watchObservedRunningTime="2026-09-18 19:58:44.733282683 +0000 UTC m=+1167.060376449"
Sep 18 19:58:45.246812 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:45.246781    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:45.251922 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:45.251897    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:45.720218 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:45.720189    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:45.721196 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:45.721178    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:58:49.376513 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:49.376486    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:50.098673 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:50.098640    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:50.194657 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:50.194628    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:50.395941 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:50.395863    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:51.135625 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:51.135584    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:51.998409 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:51.998376    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:52.713611 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:52.713585    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:53.544052 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:53.544000    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:54.466276 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:54.466241    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:54.569222 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:54.569192    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:54.986503 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:54.986478    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:55.087455 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.087426    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:55.112188 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.112164    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"]
Sep 18 19:58:55.115949 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.115928    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"
Sep 18 19:58:55.119377 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.119354    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-870f71c0\""
Sep 18 19:58:55.119487 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.119390    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-870f71c0-dockercfg-8jtww\""
Sep 18 19:58:55.126163 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.126143    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"]
Sep 18 19:58:55.146357 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.146327    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec262acc-fc30-46af-a6cf-82d943ea78ae-plugins-config-volume\") pod \"payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t\" (UID: \"ec262acc-fc30-46af-a6cf-82d943ea78ae\") " pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"
Sep 18 19:58:55.146465 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.146433    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbtvt\" (UniqueName: \"kubernetes.io/projected/ec262acc-fc30-46af-a6cf-82d943ea78ae-kube-api-access-dbtvt\") pod \"payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t\" (UID: \"ec262acc-fc30-46af-a6cf-82d943ea78ae\") " pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"
Sep 18 19:58:55.247704 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.247611    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec262acc-fc30-46af-a6cf-82d943ea78ae-plugins-config-volume\") pod \"payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t\" (UID: \"ec262acc-fc30-46af-a6cf-82d943ea78ae\") " pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"
Sep 18 19:58:55.247874 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.247708    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbtvt\" (UniqueName: \"kubernetes.io/projected/ec262acc-fc30-46af-a6cf-82d943ea78ae-kube-api-access-dbtvt\") pod \"payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t\" (UID: \"ec262acc-fc30-46af-a6cf-82d943ea78ae\") " pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"
Sep 18 19:58:55.249141 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.249110    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec262acc-fc30-46af-a6cf-82d943ea78ae-plugins-config-volume\") pod \"payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t\" (UID: \"ec262acc-fc30-46af-a6cf-82d943ea78ae\") " pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"
Sep 18 19:58:55.258600 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.258568    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbtvt\" (UniqueName: \"kubernetes.io/projected/ec262acc-fc30-46af-a6cf-82d943ea78ae-kube-api-access-dbtvt\") pod \"payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t\" (UID: \"ec262acc-fc30-46af-a6cf-82d943ea78ae\") " pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"
Sep 18 19:58:55.430121 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.430093    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"
Sep 18 19:58:55.708171 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.708143    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"]
Sep 18 19:58:55.709183 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:58:55.709150    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec262acc_fc30_46af_a6cf_82d943ea78ae.slice/crio-9303b012b02320c18a56ba73b9de1e16c9a512c617651df43f3f651cb92c2481 WatchSource:0}: Error finding container 9303b012b02320c18a56ba73b9de1e16c9a512c617651df43f3f651cb92c2481: Status 404 returned error can't find the container with id 9303b012b02320c18a56ba73b9de1e16c9a512c617651df43f3f651cb92c2481
Sep 18 19:58:55.782072 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.782029    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t" event={"ID":"ec262acc-fc30-46af-a6cf-82d943ea78ae","Type":"ContainerStarted","Data":"79564f210478d418594919ec9cfd90a374b66650315f88ae278cc0a734665df5"}
Sep 18 19:58:55.782194 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.782097    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t" event={"ID":"ec262acc-fc30-46af-a6cf-82d943ea78ae","Type":"ContainerStarted","Data":"9303b012b02320c18a56ba73b9de1e16c9a512c617651df43f3f651cb92c2481"}
Sep 18 19:58:55.782194 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.782150    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"
Sep 18 19:58:55.799868 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:55.799815    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t" podStartSLOduration=0.799798054 podStartE2EDuration="799.798054ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:58:55.798412797 +0000 UTC m=+1178.125506562" watchObservedRunningTime="2026-09-18 19:58:55.799798054 +0000 UTC m=+1178.126891818"
Sep 18 19:58:58.653315 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:58.653272    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:58:58.753756 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:58:58.753732    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:06.791428 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:06.791397    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"
Sep 18 19:59:09.575613 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:09.575582    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:16.043275 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:16.042311    2583 patch_prober.go:28] interesting pod/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": read tcp 10.132.0.2:36134->10.132.0.65:15021: read: connection reset by peer" start-of-body=
Sep 18 19:59:16.043275 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:16.042436    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr" podUID="0121711b-41c2-45a7-872b-05af7c858e0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": read tcp 10.132.0.2:36134->10.132.0.65:15021: read: connection reset by peer"
Sep 18 19:59:16.695415 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:16.695381    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:16.919492 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:16.919459    2583 generic.go:356] "Generic (PLEG): container finished" podID="0121711b-41c2-45a7-872b-05af7c858e0f" containerID="01371bf4934a1082d14bb623869df707ad08be7f90361b3f40a24ca2374d4984" exitCode=0
Sep 18 19:59:16.919660 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:16.919531    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr" event={"ID":"0121711b-41c2-45a7-872b-05af7c858e0f","Type":"ContainerDied","Data":"01371bf4934a1082d14bb623869df707ad08be7f90361b3f40a24ca2374d4984"}
Sep 18 19:59:16.919898 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:16.919884    2583 scope.go:117] "RemoveContainer" containerID="01371bf4934a1082d14bb623869df707ad08be7f90361b3f40a24ca2374d4984"
Sep 18 19:59:16.921092 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:16.921067    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:59:16.921149 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:16.921131    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:59:16.921184 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:16.921162    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:59:17.289871 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:17.289802    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:17.429195 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:17.429166    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:17.932992 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:17.932953    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr" event={"ID":"0121711b-41c2-45a7-872b-05af7c858e0f","Type":"ContainerStarted","Data":"e30c01e04715e0a7a7691368dc85101cb90ca21c3202f4b4c5e6f34f811c2ac1"}
Sep 18 19:59:18.114074 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:18.114018    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:18.246881 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:18.246787    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:59:18.247171 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:18.247147    2583 patch_prober.go:28] interesting pod/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 18 19:59:18.247268 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:18.247203    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr" podUID="0121711b-41c2-45a7-872b-05af7c858e0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 18 19:59:18.815256 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:18.815225    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:19.246755 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:19.246724    2583 patch_prober.go:28] interesting pod/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 18 19:59:19.246927 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:19.246777    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr" podUID="0121711b-41c2-45a7-872b-05af7c858e0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 18 19:59:19.479579 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:19.479548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:19.792347 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:19.792321    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 19:59:19.795178 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:19.795149    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 19:59:20.020809 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:20.020777    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:20.246696 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:20.246662    2583 patch_prober.go:28] interesting pod/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 18 19:59:20.246882 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:20.246723    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr" podUID="0121711b-41c2-45a7-872b-05af7c858e0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 18 19:59:20.323538 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:20.323505    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:20.644281 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:20.644248    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:20.742312 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:20.742285    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:20.991079 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:20.990994    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:21.141265 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.141236    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q"]
Sep 18 19:59:21.141660 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.141594    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:21.143882 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.143865    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q"
Sep 18 19:59:21.147069 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.147032    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 19:59:21.147503 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.147484    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 19:59:21.175377 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.175353    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q"]
Sep 18 19:59:21.246801 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.246720    2583 patch_prober.go:28] interesting pod/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 18 19:59:21.246801 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.246782    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr" podUID="0121711b-41c2-45a7-872b-05af7c858e0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 18 19:59:21.270977 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.270952    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:21.313030 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.313002    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31a1eee7-d420-449e-898a-46a50d3b966e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-be2171-g9x7q\" (UID: \"31a1eee7-d420-449e-898a-46a50d3b966e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q"
Sep 18 19:59:21.414417 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.414381    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31a1eee7-d420-449e-898a-46a50d3b966e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-be2171-g9x7q\" (UID: \"31a1eee7-d420-449e-898a-46a50d3b966e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q"
Sep 18 19:59:21.415409 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.415385    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31a1eee7-d420-449e-898a-46a50d3b966e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-be2171-g9x7q\" (UID: \"31a1eee7-d420-449e-898a-46a50d3b966e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q"
Sep 18 19:59:21.453982 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.453955    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q"
Sep 18 19:59:21.734231 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.734199    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q"]
Sep 18 19:59:21.739226 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:59:21.739195    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a1eee7_d420_449e_898a_46a50d3b966e.slice/crio-a8acd5e15cb74f9406e6f932fffb38f2b0af0a9768c7d62ef9ba210c52b36e2e WatchSource:0}: Error finding container a8acd5e15cb74f9406e6f932fffb38f2b0af0a9768c7d62ef9ba210c52b36e2e: Status 404 returned error can't find the container with id a8acd5e15cb74f9406e6f932fffb38f2b0af0a9768c7d62ef9ba210c52b36e2e
Sep 18 19:59:21.962908 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:21.962873    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q" event={"ID":"31a1eee7-d420-449e-898a-46a50d3b966e","Type":"ContainerStarted","Data":"a8acd5e15cb74f9406e6f932fffb38f2b0af0a9768c7d62ef9ba210c52b36e2e"}
Sep 18 19:59:22.247390 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:22.247362    2583 patch_prober.go:28] interesting pod/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 18 19:59:22.247761 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:22.247413    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr" podUID="0121711b-41c2-45a7-872b-05af7c858e0f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 18 19:59:22.308606 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:22.308580    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:22.972713 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:22.972625    2583 generic.go:356] "Generic (PLEG): container finished" podID="31a1eee7-d420-449e-898a-46a50d3b966e" containerID="155d8086977ae8cbabf28fe7f76dc78751bab7c3f8048c81c99df5701bc899fe" exitCode=0
Sep 18 19:59:22.972877 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:22.972720    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q" event={"ID":"31a1eee7-d420-449e-898a-46a50d3b966e","Type":"ContainerDied","Data":"155d8086977ae8cbabf28fe7f76dc78751bab7c3f8048c81c99df5701bc899fe"}
Sep 18 19:59:23.035561 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:23.035523    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:23.299394 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:23.299297    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:59:23.299791 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:23.299691    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:59:23.301570 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:23.301549    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:59:23.942108 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:23.942063    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:24.125710 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:24.125690    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q"
Sep 18 19:59:24.248657 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:24.248574    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31a1eee7-d420-449e-898a-46a50d3b966e-maas-api-service-ca\") pod \"31a1eee7-d420-449e-898a-46a50d3b966e\" (UID: \"31a1eee7-d420-449e-898a-46a50d3b966e\") "
Sep 18 19:59:24.248921 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:24.248898    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31a1eee7-d420-449e-898a-46a50d3b966e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "31a1eee7-d420-449e-898a-46a50d3b966e" (UID: "31a1eee7-d420-449e-898a-46a50d3b966e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:59:24.349993 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:24.349962    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/31a1eee7-d420-449e-898a-46a50d3b966e-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:24.786763 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:24.786717    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:24.986050 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:24.986010    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q"
Sep 18 19:59:24.986214 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:24.986060    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q" event={"ID":"31a1eee7-d420-449e-898a-46a50d3b966e","Type":"ContainerDied","Data":"a8acd5e15cb74f9406e6f932fffb38f2b0af0a9768c7d62ef9ba210c52b36e2e"}
Sep 18 19:59:24.986214 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:24.986104    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a8acd5e15cb74f9406e6f932fffb38f2b0af0a9768c7d62ef9ba210c52b36e2e"
Sep 18 19:59:25.504835 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:25.504792    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:26.316000 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:26.315972    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:27.092571 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:27.092540    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:27.759981 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:27.759944    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:27.859988 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:27.859960    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:28.170403 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:28.170369    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd"]
Sep 18 19:59:28.170995 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:28.170975    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31a1eee7-d420-449e-898a-46a50d3b966e" containerName="revoke-keys"
Sep 18 19:59:28.171109 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:28.170997    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="31a1eee7-d420-449e-898a-46a50d3b966e" containerName="revoke-keys"
Sep 18 19:59:28.171169 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:28.171149    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="31a1eee7-d420-449e-898a-46a50d3b966e" containerName="revoke-keys"
Sep 18 19:59:28.173231 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:28.173212    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd"
Sep 18 19:59:28.177150 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:28.177129    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 19:59:28.177249 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:28.177131    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 19:59:28.192468 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:28.192442    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd"]
Sep 18 19:59:28.287377 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:28.287341    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5569d48-aa97-47ff-b8aa-ecf09ac4d93d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd\" (UID: \"f5569d48-aa97-47ff-b8aa-ecf09ac4d93d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd"
Sep 18 19:59:28.388826 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:28.388793    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5569d48-aa97-47ff-b8aa-ecf09ac4d93d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd\" (UID: \"f5569d48-aa97-47ff-b8aa-ecf09ac4d93d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd"
Sep 18 19:59:28.389599 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:28.389576    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5569d48-aa97-47ff-b8aa-ecf09ac4d93d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd\" (UID: \"f5569d48-aa97-47ff-b8aa-ecf09ac4d93d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd"
Sep 18 19:59:28.483829 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:28.483771    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd"
Sep 18 19:59:28.755216 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:28.755191    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd"]
Sep 18 19:59:28.755743 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:59:28.755716    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5569d48_aa97_47ff_b8aa_ecf09ac4d93d.slice/crio-ca4e2a909a46f1c80f96553311dba0d49e975bb16c108de42c87b9734cc28e07 WatchSource:0}: Error finding container ca4e2a909a46f1c80f96553311dba0d49e975bb16c108de42c87b9734cc28e07: Status 404 returned error can't find the container with id ca4e2a909a46f1c80f96553311dba0d49e975bb16c108de42c87b9734cc28e07
Sep 18 19:59:28.915212 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:28.915174    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:29.013061 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:29.012956    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd" event={"ID":"f5569d48-aa97-47ff-b8aa-ecf09ac4d93d","Type":"ContainerStarted","Data":"ca4e2a909a46f1c80f96553311dba0d49e975bb16c108de42c87b9734cc28e07"}
Sep 18 19:59:29.910589 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:29.910557    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:30.021001 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:30.020963    2583 generic.go:356] "Generic (PLEG): container finished" podID="f5569d48-aa97-47ff-b8aa-ecf09ac4d93d" containerID="bf556e433addb3e5d70df3bb5c1bcaba28a26f438cbc2b63e4708eee2cb46afe" exitCode=0
Sep 18 19:59:30.021169 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:30.021059    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd" event={"ID":"f5569d48-aa97-47ff-b8aa-ecf09ac4d93d","Type":"ContainerDied","Data":"bf556e433addb3e5d70df3bb5c1bcaba28a26f438cbc2b63e4708eee2cb46afe"}
Sep 18 19:59:30.603346 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:30.603318    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:31.170659 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:31.170636    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd"
Sep 18 19:59:31.320645 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:31.320569    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5569d48-aa97-47ff-b8aa-ecf09ac4d93d-maas-api-service-ca\") pod \"f5569d48-aa97-47ff-b8aa-ecf09ac4d93d\" (UID: \"f5569d48-aa97-47ff-b8aa-ecf09ac4d93d\") "
Sep 18 19:59:31.320911 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:31.320889    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5569d48-aa97-47ff-b8aa-ecf09ac4d93d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f5569d48-aa97-47ff-b8aa-ecf09ac4d93d" (UID: "f5569d48-aa97-47ff-b8aa-ecf09ac4d93d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:59:31.422297 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:31.422270    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5569d48-aa97-47ff-b8aa-ecf09ac4d93d-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:31.431852 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:31.431828    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:31.511888 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:31.511858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:32.037751 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:32.037726    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd"
Sep 18 19:59:32.037994 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:32.037775    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd" event={"ID":"f5569d48-aa97-47ff-b8aa-ecf09ac4d93d","Type":"ContainerDied","Data":"ca4e2a909a46f1c80f96553311dba0d49e975bb16c108de42c87b9734cc28e07"}
Sep 18 19:59:32.037994 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:32.037831    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca4e2a909a46f1c80f96553311dba0d49e975bb16c108de42c87b9734cc28e07"
Sep 18 19:59:32.203911 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:32.203871    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:33.002908 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:33.002870    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:34.243918 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.243890    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:34.439290 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.439253    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:34.478465 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.478434    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"]
Sep 18 19:59:34.478755 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.478722    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm" podUID="7b8b8817-7601-469f-98e1-cd49914da46e" containerName="payload-processing" containerID="cri-o://69f594c8b7d4996f2520878e12126b2d7b3129609b5dee18b03499317b496133" gracePeriod=30
Sep 18 19:59:34.486699 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.485810    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"]
Sep 18 19:59:34.487341 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.487295    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd" podUID="59c78fd9-c468-4b16-8f41-dd6dab3eaad0" containerName="payload-pre-processing" containerID="cri-o://66402e67a3b57e709832e1154a92fbf48d384445dc48e2e9744f9458b2ed28cd" gracePeriod=30
Sep 18 19:59:34.526017 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.525994    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:34.589806 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.589777    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:34.646464 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.646433    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:34.646632 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.646480    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q"]
Sep 18 19:59:34.649845 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.649810    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-be2171-g9x7q"]
Sep 18 19:59:34.716789 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.716763    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:34.754487 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.754438    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"
Sep 18 19:59:34.777749 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.777731    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"
Sep 18 19:59:34.852153 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.852120    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b8b8817-7601-469f-98e1-cd49914da46e-plugins-config-volume\") pod \"7b8b8817-7601-469f-98e1-cd49914da46e\" (UID: \"7b8b8817-7601-469f-98e1-cd49914da46e\") "
Sep 18 19:59:34.852346 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.852182    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59c78fd9-c468-4b16-8f41-dd6dab3eaad0-plugins-config-volume\") pod \"59c78fd9-c468-4b16-8f41-dd6dab3eaad0\" (UID: \"59c78fd9-c468-4b16-8f41-dd6dab3eaad0\") "
Sep 18 19:59:34.852346 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.852233    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6bsm\" (UniqueName: \"kubernetes.io/projected/7b8b8817-7601-469f-98e1-cd49914da46e-kube-api-access-l6bsm\") pod \"7b8b8817-7601-469f-98e1-cd49914da46e\" (UID: \"7b8b8817-7601-469f-98e1-cd49914da46e\") "
Sep 18 19:59:34.852472 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.852379    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfxk8\" (UniqueName: \"kubernetes.io/projected/59c78fd9-c468-4b16-8f41-dd6dab3eaad0-kube-api-access-wfxk8\") pod \"59c78fd9-c468-4b16-8f41-dd6dab3eaad0\" (UID: \"59c78fd9-c468-4b16-8f41-dd6dab3eaad0\") "
Sep 18 19:59:34.852472 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.852438    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b8b8817-7601-469f-98e1-cd49914da46e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b8b8817-7601-469f-98e1-cd49914da46e" (UID: "7b8b8817-7601-469f-98e1-cd49914da46e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:59:34.852579 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.852508    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59c78fd9-c468-4b16-8f41-dd6dab3eaad0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "59c78fd9-c468-4b16-8f41-dd6dab3eaad0" (UID: "59c78fd9-c468-4b16-8f41-dd6dab3eaad0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:59:34.852738 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.852721    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59c78fd9-c468-4b16-8f41-dd6dab3eaad0-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:34.852806 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.852745    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b8b8817-7601-469f-98e1-cd49914da46e-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:34.854480 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.854458    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b8b8817-7601-469f-98e1-cd49914da46e-kube-api-access-l6bsm" (OuterVolumeSpecName: "kube-api-access-l6bsm") pod "7b8b8817-7601-469f-98e1-cd49914da46e" (UID: "7b8b8817-7601-469f-98e1-cd49914da46e"). InnerVolumeSpecName "kube-api-access-l6bsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:59:34.854588 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.854566    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59c78fd9-c468-4b16-8f41-dd6dab3eaad0-kube-api-access-wfxk8" (OuterVolumeSpecName: "kube-api-access-wfxk8") pod "59c78fd9-c468-4b16-8f41-dd6dab3eaad0" (UID: "59c78fd9-c468-4b16-8f41-dd6dab3eaad0"). InnerVolumeSpecName "kube-api-access-wfxk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:59:34.954015 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.953984    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfxk8\" (UniqueName: \"kubernetes.io/projected/59c78fd9-c468-4b16-8f41-dd6dab3eaad0-kube-api-access-wfxk8\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:34.954015 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:34.954011    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6bsm\" (UniqueName: \"kubernetes.io/projected/7b8b8817-7601-469f-98e1-cd49914da46e-kube-api-access-l6bsm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:35.003160 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.003133    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:35.058137 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.058069    2583 generic.go:356] "Generic (PLEG): container finished" podID="7b8b8817-7601-469f-98e1-cd49914da46e" containerID="69f594c8b7d4996f2520878e12126b2d7b3129609b5dee18b03499317b496133" exitCode=0
Sep 18 19:59:35.058137 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.058119    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"
Sep 18 19:59:35.058286 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.058151    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm" event={"ID":"7b8b8817-7601-469f-98e1-cd49914da46e","Type":"ContainerDied","Data":"69f594c8b7d4996f2520878e12126b2d7b3129609b5dee18b03499317b496133"}
Sep 18 19:59:35.058286 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.058199    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm" event={"ID":"7b8b8817-7601-469f-98e1-cd49914da46e","Type":"ContainerDied","Data":"0214fb9385540393f25db219e927b608c452f26ee0c1d45b1169e7016c67dc7e"}
Sep 18 19:59:35.058286 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.058226    2583 scope.go:117] "RemoveContainer" containerID="69f594c8b7d4996f2520878e12126b2d7b3129609b5dee18b03499317b496133"
Sep 18 19:59:35.059620 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.059597    2583 generic.go:356] "Generic (PLEG): container finished" podID="59c78fd9-c468-4b16-8f41-dd6dab3eaad0" containerID="66402e67a3b57e709832e1154a92fbf48d384445dc48e2e9744f9458b2ed28cd" exitCode=0
Sep 18 19:59:35.059740 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.059638    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"
Sep 18 19:59:35.059740 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.059650    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd" event={"ID":"59c78fd9-c468-4b16-8f41-dd6dab3eaad0","Type":"ContainerDied","Data":"66402e67a3b57e709832e1154a92fbf48d384445dc48e2e9744f9458b2ed28cd"}
Sep 18 19:59:35.059740 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.059710    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd" event={"ID":"59c78fd9-c468-4b16-8f41-dd6dab3eaad0","Type":"ContainerDied","Data":"1252f0cec0947c1e963c0afc239581338dbfbd1cbaab8c812fc9e935d211a667"}
Sep 18 19:59:35.068829 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.068810    2583 scope.go:117] "RemoveContainer" containerID="69f594c8b7d4996f2520878e12126b2d7b3129609b5dee18b03499317b496133"
Sep 18 19:59:35.069145 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:59:35.069124    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69f594c8b7d4996f2520878e12126b2d7b3129609b5dee18b03499317b496133\": container with ID starting with 69f594c8b7d4996f2520878e12126b2d7b3129609b5dee18b03499317b496133 not found: ID does not exist" containerID="69f594c8b7d4996f2520878e12126b2d7b3129609b5dee18b03499317b496133"
Sep 18 19:59:35.069313 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.069156    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69f594c8b7d4996f2520878e12126b2d7b3129609b5dee18b03499317b496133"} err="failed to get container status \"69f594c8b7d4996f2520878e12126b2d7b3129609b5dee18b03499317b496133\": rpc error: code = NotFound desc = could not find container \"69f594c8b7d4996f2520878e12126b2d7b3129609b5dee18b03499317b496133\": container with ID starting with 69f594c8b7d4996f2520878e12126b2d7b3129609b5dee18b03499317b496133 not found: ID does not exist"
Sep 18 19:59:35.069313 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.069179    2583 scope.go:117] "RemoveContainer" containerID="66402e67a3b57e709832e1154a92fbf48d384445dc48e2e9744f9458b2ed28cd"
Sep 18 19:59:35.078148 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.078133    2583 scope.go:117] "RemoveContainer" containerID="66402e67a3b57e709832e1154a92fbf48d384445dc48e2e9744f9458b2ed28cd"
Sep 18 19:59:35.078426 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:59:35.078401    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66402e67a3b57e709832e1154a92fbf48d384445dc48e2e9744f9458b2ed28cd\": container with ID starting with 66402e67a3b57e709832e1154a92fbf48d384445dc48e2e9744f9458b2ed28cd not found: ID does not exist" containerID="66402e67a3b57e709832e1154a92fbf48d384445dc48e2e9744f9458b2ed28cd"
Sep 18 19:59:35.078490 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.078435    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66402e67a3b57e709832e1154a92fbf48d384445dc48e2e9744f9458b2ed28cd"} err="failed to get container status \"66402e67a3b57e709832e1154a92fbf48d384445dc48e2e9744f9458b2ed28cd\": rpc error: code = NotFound desc = could not find container \"66402e67a3b57e709832e1154a92fbf48d384445dc48e2e9744f9458b2ed28cd\": container with ID starting with 66402e67a3b57e709832e1154a92fbf48d384445dc48e2e9744f9458b2ed28cd not found: ID does not exist"
Sep 18 19:59:35.088836 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.088767    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"]
Sep 18 19:59:35.092093 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.092075    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-be2171-5c4c89446f-wlmcm"]
Sep 18 19:59:35.104195 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.104176    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"]
Sep 18 19:59:35.106953 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.106934    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-be2171-7b549c4958-646dd"]
Sep 18 19:59:35.145250 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.145232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:35.811866 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.811789    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31a1eee7-d420-449e-898a-46a50d3b966e" path="/var/lib/kubelet/pods/31a1eee7-d420-449e-898a-46a50d3b966e/volumes"
Sep 18 19:59:35.812230 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.812180    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59c78fd9-c468-4b16-8f41-dd6dab3eaad0" path="/var/lib/kubelet/pods/59c78fd9-c468-4b16-8f41-dd6dab3eaad0/volumes"
Sep 18 19:59:35.812503 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.812490    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b8b8817-7601-469f-98e1-cd49914da46e" path="/var/lib/kubelet/pods/7b8b8817-7601-469f-98e1-cd49914da46e/volumes"
Sep 18 19:59:35.866076 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:35.866018    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:36.771667 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:36.771610    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:37.421871 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:37.421840    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:37.521774 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:37.521744    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:38.084246 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:38.084218    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:38.809689 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:38.809635    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:39.400459 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.400427    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:39.424953 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.424919    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"]
Sep 18 19:59:39.425235 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.425190    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t" podUID="ec262acc-fc30-46af-a6cf-82d943ea78ae" containerName="payload-processing" containerID="cri-o://79564f210478d418594919ec9cfd90a374b66650315f88ae278cc0a734665df5" gracePeriod=30
Sep 18 19:59:39.498381 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.498344    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:39.589563 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.589533    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd"]
Sep 18 19:59:39.590241 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.590148    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:39.593385 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.593360    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-870f71c0-lvcpd"]
Sep 18 19:59:39.658769 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.658680    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:39.690404 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.690384    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"
Sep 18 19:59:39.797836 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.797808    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec262acc-fc30-46af-a6cf-82d943ea78ae-plugins-config-volume\") pod \"ec262acc-fc30-46af-a6cf-82d943ea78ae\" (UID: \"ec262acc-fc30-46af-a6cf-82d943ea78ae\") "
Sep 18 19:59:39.797836 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.797846    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbtvt\" (UniqueName: \"kubernetes.io/projected/ec262acc-fc30-46af-a6cf-82d943ea78ae-kube-api-access-dbtvt\") pod \"ec262acc-fc30-46af-a6cf-82d943ea78ae\" (UID: \"ec262acc-fc30-46af-a6cf-82d943ea78ae\") "
Sep 18 19:59:39.798561 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.798533    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec262acc-fc30-46af-a6cf-82d943ea78ae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ec262acc-fc30-46af-a6cf-82d943ea78ae" (UID: "ec262acc-fc30-46af-a6cf-82d943ea78ae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:59:39.800830 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.800808    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec262acc-fc30-46af-a6cf-82d943ea78ae-kube-api-access-dbtvt" (OuterVolumeSpecName: "kube-api-access-dbtvt") pod "ec262acc-fc30-46af-a6cf-82d943ea78ae" (UID: "ec262acc-fc30-46af-a6cf-82d943ea78ae"). InnerVolumeSpecName "kube-api-access-dbtvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:59:39.811724 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.811702    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5569d48-aa97-47ff-b8aa-ecf09ac4d93d" path="/var/lib/kubelet/pods/f5569d48-aa97-47ff-b8aa-ecf09ac4d93d/volumes"
Sep 18 19:59:39.898954 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.898906    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec262acc-fc30-46af-a6cf-82d943ea78ae-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:39.898954 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.898934    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbtvt\" (UniqueName: \"kubernetes.io/projected/ec262acc-fc30-46af-a6cf-82d943ea78ae-kube-api-access-dbtvt\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:39.945726 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:39.945614    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:40.054515 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:40.054481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:40.099441 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:40.099404    2583 generic.go:356] "Generic (PLEG): container finished" podID="ec262acc-fc30-46af-a6cf-82d943ea78ae" containerID="79564f210478d418594919ec9cfd90a374b66650315f88ae278cc0a734665df5" exitCode=0
Sep 18 19:59:40.099631 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:40.099484    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"
Sep 18 19:59:40.099631 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:40.099504    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t" event={"ID":"ec262acc-fc30-46af-a6cf-82d943ea78ae","Type":"ContainerDied","Data":"79564f210478d418594919ec9cfd90a374b66650315f88ae278cc0a734665df5"}
Sep 18 19:59:40.099631 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:40.099562    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t" event={"ID":"ec262acc-fc30-46af-a6cf-82d943ea78ae","Type":"ContainerDied","Data":"9303b012b02320c18a56ba73b9de1e16c9a512c617651df43f3f651cb92c2481"}
Sep 18 19:59:40.099631 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:40.099600    2583 scope.go:117] "RemoveContainer" containerID="79564f210478d418594919ec9cfd90a374b66650315f88ae278cc0a734665df5"
Sep 18 19:59:40.109638 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:40.109621    2583 scope.go:117] "RemoveContainer" containerID="79564f210478d418594919ec9cfd90a374b66650315f88ae278cc0a734665df5"
Sep 18 19:59:40.109927 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:59:40.109892    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79564f210478d418594919ec9cfd90a374b66650315f88ae278cc0a734665df5\": container with ID starting with 79564f210478d418594919ec9cfd90a374b66650315f88ae278cc0a734665df5 not found: ID does not exist" containerID="79564f210478d418594919ec9cfd90a374b66650315f88ae278cc0a734665df5"
Sep 18 19:59:40.109995 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:40.109941    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79564f210478d418594919ec9cfd90a374b66650315f88ae278cc0a734665df5"} err="failed to get container status \"79564f210478d418594919ec9cfd90a374b66650315f88ae278cc0a734665df5\": rpc error: code = NotFound desc = could not find container \"79564f210478d418594919ec9cfd90a374b66650315f88ae278cc0a734665df5\": container with ID starting with 79564f210478d418594919ec9cfd90a374b66650315f88ae278cc0a734665df5 not found: ID does not exist"
Sep 18 19:59:40.119313 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:40.119291    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"]
Sep 18 19:59:40.127403 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:40.127383    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-870f71c0-598f6c4457-kq78t"]
Sep 18 19:59:40.821399 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:40.821362    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:41.805953 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:41.805920    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:41.811539 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:41.811513    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec262acc-fc30-46af-a6cf-82d943ea78ae" path="/var/lib/kubelet/pods/ec262acc-fc30-46af-a6cf-82d943ea78ae/volumes"
Sep 18 19:59:41.907135 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:41.907103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:42.084809 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.084785    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:42.521904 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.521820    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:42.625927 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.625869    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:42.795863 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.795778    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"]
Sep 18 19:59:42.796261 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.796246    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b8b8817-7601-469f-98e1-cd49914da46e" containerName="payload-processing"
Sep 18 19:59:42.796316 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.796263    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b8b8817-7601-469f-98e1-cd49914da46e" containerName="payload-processing"
Sep 18 19:59:42.796316 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.796278    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59c78fd9-c468-4b16-8f41-dd6dab3eaad0" containerName="payload-pre-processing"
Sep 18 19:59:42.796316 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.796284    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="59c78fd9-c468-4b16-8f41-dd6dab3eaad0" containerName="payload-pre-processing"
Sep 18 19:59:42.796316 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.796295    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec262acc-fc30-46af-a6cf-82d943ea78ae" containerName="payload-processing"
Sep 18 19:59:42.796316 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.796304    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec262acc-fc30-46af-a6cf-82d943ea78ae" containerName="payload-processing"
Sep 18 19:59:42.796544 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.796318    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5569d48-aa97-47ff-b8aa-ecf09ac4d93d" containerName="revoke-keys"
Sep 18 19:59:42.796544 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.796325    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5569d48-aa97-47ff-b8aa-ecf09ac4d93d" containerName="revoke-keys"
Sep 18 19:59:42.796544 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.796413    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec262acc-fc30-46af-a6cf-82d943ea78ae" containerName="payload-processing"
Sep 18 19:59:42.796544 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.796422    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b8b8817-7601-469f-98e1-cd49914da46e" containerName="payload-processing"
Sep 18 19:59:42.796544 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.796427    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="59c78fd9-c468-4b16-8f41-dd6dab3eaad0" containerName="payload-pre-processing"
Sep 18 19:59:42.796544 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.796435    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5569d48-aa97-47ff-b8aa-ecf09ac4d93d" containerName="revoke-keys"
Sep 18 19:59:42.799648 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.799627    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.802642 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.802621    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-03d45c-openshift-default-dockercfg-sc95q\""
Sep 18 19:59:42.814779 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.814759    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"]
Sep 18 19:59:42.827621 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.827591    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-data\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.827734 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.827648    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-podinfo\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.827810 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.827791    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-envoy\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.827886 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.827848    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istiod-ca-cert\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.827963 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.827899    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-token\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.827963 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.827928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-workload-certs\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.828110 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.828011    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-workload-socket\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.828110 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.828079    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6gnf\" (UniqueName: \"kubernetes.io/projected/2c731c6a-610a-47c8-a1ee-3bdc62495f93-kube-api-access-m6gnf\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.828231 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.828129    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-credential-socket\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.838340 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.838321    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:42.929629 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.929593    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-workload-socket\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.930298 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.930245    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6gnf\" (UniqueName: \"kubernetes.io/projected/2c731c6a-610a-47c8-a1ee-3bdc62495f93-kube-api-access-m6gnf\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.930424 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.930366    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-credential-socket\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.930497 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.930416    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-data\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.930497 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.930469    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-podinfo\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.930497 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.930485    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-workload-socket\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.930739 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.930714    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-data\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.930896 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.930869    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-credential-socket\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.931028 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.931007    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-envoy\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.931529 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.931102    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istiod-ca-cert\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.931812 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.931792    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-token\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.931970 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.931953    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-workload-certs\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.932177 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.931801    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istiod-ca-cert\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.932318 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.932294    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-workload-certs\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.934679 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.934658    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-podinfo\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.935613 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.935586    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-envoy\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.944300 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.944279    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6gnf\" (UniqueName: \"kubernetes.io/projected/2c731c6a-610a-47c8-a1ee-3bdc62495f93-kube-api-access-m6gnf\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:42.950086 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:42.950065    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-token\") pod \"e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") " pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:43.056240 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:43.056160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:43.111349 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:43.111313    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:43.402388 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:43.402358    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"]
Sep 18 19:59:43.403486 ip-10-0-135-240 kubenswrapper[2583]: W0918 19:59:43.403463    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c731c6a_610a_47c8_a1ee_3bdc62495f93.slice/crio-6b9b48746f96622d1bb2c67e483529a866da5f3cc4ee2bba745fc4b2195658a6 WatchSource:0}: Error finding container 6b9b48746f96622d1bb2c67e483529a866da5f3cc4ee2bba745fc4b2195658a6: Status 404 returned error can't find the container with id 6b9b48746f96622d1bb2c67e483529a866da5f3cc4ee2bba745fc4b2195658a6
Sep 18 19:59:43.405787 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:43.405757    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:59:43.405866 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:43.405825    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:59:43.405866 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:43.405853    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 19:59:43.631737 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:43.631701    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:44.127744 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:44.127711    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z" event={"ID":"2c731c6a-610a-47c8-a1ee-3bdc62495f93","Type":"ContainerStarted","Data":"e0bd5b47e5df08e04b10f782810e47c0907c7d139ba6c1750f4b81f150510513"}
Sep 18 19:59:44.128136 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:44.127760    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z" event={"ID":"2c731c6a-610a-47c8-a1ee-3bdc62495f93","Type":"ContainerStarted","Data":"6b9b48746f96622d1bb2c67e483529a866da5f3cc4ee2bba745fc4b2195658a6"}
Sep 18 19:59:44.153841 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:44.153796    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z" podStartSLOduration=2.153782298 podStartE2EDuration="2.153782298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 19:59:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 19:59:44.150512318 +0000 UTC m=+1226.477606107" watchObservedRunningTime="2026-09-18 19:59:44.153782298 +0000 UTC m=+1226.480876063"
Sep 18 19:59:44.561705 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:44.561607    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:44.657570 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:44.657536    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:44.757728 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:44.757687    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:45.111956 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:45.111924    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:45.117219 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:45.117197    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:45.134998 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:45.134973    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:45.135711 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:45.135693    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 19:59:46.318999 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:46.318970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:46.418063 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:46.418021    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:46.570497 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:46.570418    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"]
Sep 18 19:59:46.570717 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:46.570691    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr" podUID="0121711b-41c2-45a7-872b-05af7c858e0f" containerName="istio-proxy" containerID="cri-o://e30c01e04715e0a7a7691368dc85101cb90ca21c3202f4b4c5e6f34f811c2ac1" gracePeriod=30
Sep 18 19:59:46.585820 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:46.585796    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:46.932681 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:46.932623    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:47.021835 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:47.021807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:47.172439 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:47.172408    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:48.504176 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:48.504148    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:49.495636 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:49.495603    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:51.821337 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.821309    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:59:51.921080 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.921000    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7s54\" (UniqueName: \"kubernetes.io/projected/0121711b-41c2-45a7-872b-05af7c858e0f-kube-api-access-h7s54\") pod \"0121711b-41c2-45a7-872b-05af7c858e0f\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") "
Sep 18 19:59:51.921080 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.921034    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-credential-socket\") pod \"0121711b-41c2-45a7-872b-05af7c858e0f\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") "
Sep 18 19:59:51.921257 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.921087    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0121711b-41c2-45a7-872b-05af7c858e0f-istio-podinfo\") pod \"0121711b-41c2-45a7-872b-05af7c858e0f\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") "
Sep 18 19:59:51.921257 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.921194    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-workload-certs\") pod \"0121711b-41c2-45a7-872b-05af7c858e0f\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") "
Sep 18 19:59:51.921382 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.921273    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0121711b-41c2-45a7-872b-05af7c858e0f-istiod-ca-cert\") pod \"0121711b-41c2-45a7-872b-05af7c858e0f\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") "
Sep 18 19:59:51.921382 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.921311    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-istio-data\") pod \"0121711b-41c2-45a7-872b-05af7c858e0f\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") "
Sep 18 19:59:51.921382 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.921340    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-workload-socket\") pod \"0121711b-41c2-45a7-872b-05af7c858e0f\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") "
Sep 18 19:59:51.921382 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.921375    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-istio-envoy\") pod \"0121711b-41c2-45a7-872b-05af7c858e0f\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") "
Sep 18 19:59:51.921593 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.921380    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0121711b-41c2-45a7-872b-05af7c858e0f" (UID: "0121711b-41c2-45a7-872b-05af7c858e0f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:59:51.921593 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.921450    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0121711b-41c2-45a7-872b-05af7c858e0f-istio-token\") pod \"0121711b-41c2-45a7-872b-05af7c858e0f\" (UID: \"0121711b-41c2-45a7-872b-05af7c858e0f\") "
Sep 18 19:59:51.921593 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.921473    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0121711b-41c2-45a7-872b-05af7c858e0f" (UID: "0121711b-41c2-45a7-872b-05af7c858e0f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:59:51.921593 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.921550    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0121711b-41c2-45a7-872b-05af7c858e0f" (UID: "0121711b-41c2-45a7-872b-05af7c858e0f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:59:51.921830 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.921614    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0121711b-41c2-45a7-872b-05af7c858e0f" (UID: "0121711b-41c2-45a7-872b-05af7c858e0f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:59:51.921830 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.921644    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0121711b-41c2-45a7-872b-05af7c858e0f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0121711b-41c2-45a7-872b-05af7c858e0f" (UID: "0121711b-41c2-45a7-872b-05af7c858e0f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 19:59:51.922028 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.922006    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-credential-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:51.922114 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.922034    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-workload-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:51.922114 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.922066    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0121711b-41c2-45a7-872b-05af7c858e0f-istiod-ca-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:51.922114 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.922078    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-istio-data\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:51.922114 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.922092    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-workload-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:51.923522 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.923471    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0121711b-41c2-45a7-872b-05af7c858e0f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0121711b-41c2-45a7-872b-05af7c858e0f" (UID: "0121711b-41c2-45a7-872b-05af7c858e0f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 19:59:51.923522 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.923497    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0121711b-41c2-45a7-872b-05af7c858e0f-kube-api-access-h7s54" (OuterVolumeSpecName: "kube-api-access-h7s54") pod "0121711b-41c2-45a7-872b-05af7c858e0f" (UID: "0121711b-41c2-45a7-872b-05af7c858e0f"). InnerVolumeSpecName "kube-api-access-h7s54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:59:51.923677 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.923540    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0121711b-41c2-45a7-872b-05af7c858e0f" (UID: "0121711b-41c2-45a7-872b-05af7c858e0f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 19:59:51.923778 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:51.923759    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0121711b-41c2-45a7-872b-05af7c858e0f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0121711b-41c2-45a7-872b-05af7c858e0f" (UID: "0121711b-41c2-45a7-872b-05af7c858e0f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 19:59:52.023240 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.023208    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0121711b-41c2-45a7-872b-05af7c858e0f-istio-podinfo\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:52.023240 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.023235    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0121711b-41c2-45a7-872b-05af7c858e0f-istio-envoy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:52.023240 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.023244    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0121711b-41c2-45a7-872b-05af7c858e0f-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:52.023465 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.023252    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7s54\" (UniqueName: \"kubernetes.io/projected/0121711b-41c2-45a7-872b-05af7c858e0f-kube-api-access-h7s54\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 19:59:52.181246 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.181165    2583 generic.go:356] "Generic (PLEG): container finished" podID="0121711b-41c2-45a7-872b-05af7c858e0f" containerID="e30c01e04715e0a7a7691368dc85101cb90ca21c3202f4b4c5e6f34f811c2ac1" exitCode=0
Sep 18 19:59:52.181246 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.181211    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"
Sep 18 19:59:52.181445 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.181247    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr" event={"ID":"0121711b-41c2-45a7-872b-05af7c858e0f","Type":"ContainerDied","Data":"e30c01e04715e0a7a7691368dc85101cb90ca21c3202f4b4c5e6f34f811c2ac1"}
Sep 18 19:59:52.181445 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.181304    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr" event={"ID":"0121711b-41c2-45a7-872b-05af7c858e0f","Type":"ContainerDied","Data":"3888a249059c103851ccddca528168054c34fa6f53de2a9e39692ada6f59d4dd"}
Sep 18 19:59:52.181445 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.181334    2583 scope.go:117] "RemoveContainer" containerID="e30c01e04715e0a7a7691368dc85101cb90ca21c3202f4b4c5e6f34f811c2ac1"
Sep 18 19:59:52.191753 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.191733    2583 scope.go:117] "RemoveContainer" containerID="01371bf4934a1082d14bb623869df707ad08be7f90361b3f40a24ca2374d4984"
Sep 18 19:59:52.202948 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.202928    2583 scope.go:117] "RemoveContainer" containerID="e30c01e04715e0a7a7691368dc85101cb90ca21c3202f4b4c5e6f34f811c2ac1"
Sep 18 19:59:52.203254 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:59:52.203233    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e30c01e04715e0a7a7691368dc85101cb90ca21c3202f4b4c5e6f34f811c2ac1\": container with ID starting with e30c01e04715e0a7a7691368dc85101cb90ca21c3202f4b4c5e6f34f811c2ac1 not found: ID does not exist" containerID="e30c01e04715e0a7a7691368dc85101cb90ca21c3202f4b4c5e6f34f811c2ac1"
Sep 18 19:59:52.203349 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.203260    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30c01e04715e0a7a7691368dc85101cb90ca21c3202f4b4c5e6f34f811c2ac1"} err="failed to get container status \"e30c01e04715e0a7a7691368dc85101cb90ca21c3202f4b4c5e6f34f811c2ac1\": rpc error: code = NotFound desc = could not find container \"e30c01e04715e0a7a7691368dc85101cb90ca21c3202f4b4c5e6f34f811c2ac1\": container with ID starting with e30c01e04715e0a7a7691368dc85101cb90ca21c3202f4b4c5e6f34f811c2ac1 not found: ID does not exist"
Sep 18 19:59:52.203349 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.203276    2583 scope.go:117] "RemoveContainer" containerID="01371bf4934a1082d14bb623869df707ad08be7f90361b3f40a24ca2374d4984"
Sep 18 19:59:52.203509 ip-10-0-135-240 kubenswrapper[2583]: E0918 19:59:52.203488    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01371bf4934a1082d14bb623869df707ad08be7f90361b3f40a24ca2374d4984\": container with ID starting with 01371bf4934a1082d14bb623869df707ad08be7f90361b3f40a24ca2374d4984 not found: ID does not exist" containerID="01371bf4934a1082d14bb623869df707ad08be7f90361b3f40a24ca2374d4984"
Sep 18 19:59:52.203555 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.203515    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01371bf4934a1082d14bb623869df707ad08be7f90361b3f40a24ca2374d4984"} err="failed to get container status \"01371bf4934a1082d14bb623869df707ad08be7f90361b3f40a24ca2374d4984\": rpc error: code = NotFound desc = could not find container \"01371bf4934a1082d14bb623869df707ad08be7f90361b3f40a24ca2374d4984\": container with ID starting with 01371bf4934a1082d14bb623869df707ad08be7f90361b3f40a24ca2374d4984 not found: ID does not exist"
Sep 18 19:59:52.208912 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.208890    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"]
Sep 18 19:59:52.211416 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.211398    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-870f71c0-openshift-default-7dd6c5cb8d-h6fpr"]
Sep 18 19:59:52.872806 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:52.872772    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:53.434656 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:53.434606    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:53.574731 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:53.574706    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:53.666388 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:53.666358    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:53.778580 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:53.778508    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:53.811731 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:53.811706    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0121711b-41c2-45a7-872b-05af7c858e0f" path="/var/lib/kubelet/pods/0121711b-41c2-45a7-872b-05af7c858e0f/volumes"
Sep 18 19:59:59.439172 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:59.439141    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 19:59:59.507579 ip-10-0-135-240 kubenswrapper[2583]: I0918 19:59:59.507554    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:00.147261 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.147231    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d6291d-29829360-xxfqc"]
Sep 18 20:00:00.147695 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.147682    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0121711b-41c2-45a7-872b-05af7c858e0f" containerName="istio-proxy"
Sep 18 20:00:00.147749 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.147697    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0121711b-41c2-45a7-872b-05af7c858e0f" containerName="istio-proxy"
Sep 18 20:00:00.147749 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.147705    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0121711b-41c2-45a7-872b-05af7c858e0f" containerName="istio-proxy"
Sep 18 20:00:00.147749 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.147711    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0121711b-41c2-45a7-872b-05af7c858e0f" containerName="istio-proxy"
Sep 18 20:00:00.147843 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.147789    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0121711b-41c2-45a7-872b-05af7c858e0f" containerName="istio-proxy"
Sep 18 20:00:00.147843 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.147796    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0121711b-41c2-45a7-872b-05af7c858e0f" containerName="istio-proxy"
Sep 18 20:00:00.152505 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.152482    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d6291d-29829360-xxfqc"
Sep 18 20:00:00.154297 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.154279    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-674263-29829360-49cg2"]
Sep 18 20:00:00.155313 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.155293    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 20:00:00.157636 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.157621    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-674263-29829360-49cg2"
Sep 18 20:00:00.158009 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.157986    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829360-sf4z7"]
Sep 18 20:00:00.162126 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.162107    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829360-sf4z7"
Sep 18 20:00:00.162703 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.162686    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d6291d-29829360-xxfqc"]
Sep 18 20:00:00.166665 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.166648    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-674263-29829360-49cg2"]
Sep 18 20:00:00.170278 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.170260    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d6291d-29829360-xxfqc"
Sep 18 20:00:00.170724 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.170704    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829360-sf4z7"]
Sep 18 20:00:00.182482 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.182459    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-674263-29829360-49cg2"
Sep 18 20:00:00.220256 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.220228    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829360-sf4z7"
Sep 18 20:00:00.326300 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.326276    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:00.455386 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.455363    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d6291d-29829360-xxfqc"]
Sep 18 20:00:00.456950 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:00:00.456925    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3785357c_8a86_4ed9_94e1_e7d340cd5ec6.slice/crio-ef52f841583f17f64ddc3b52ea3815b5bc33663f0b7ceec7d1771508c9ded9cb WatchSource:0}: Error finding container ef52f841583f17f64ddc3b52ea3815b5bc33663f0b7ceec7d1771508c9ded9cb: Status 404 returned error can't find the container with id ef52f841583f17f64ddc3b52ea3815b5bc33663f0b7ceec7d1771508c9ded9cb
Sep 18 20:00:00.471579 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.471558    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-674263-29829360-49cg2"]
Sep 18 20:00:00.473714 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:00:00.473688    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6136b913_ec7e_4387_818e_b4242ea66554.slice/crio-1f75303deafab1c8618336888a5a3e90c9ac1197fa247a94fe8ef0e9aff23aab WatchSource:0}: Error finding container 1f75303deafab1c8618336888a5a3e90c9ac1197fa247a94fe8ef0e9aff23aab: Status 404 returned error can't find the container with id 1f75303deafab1c8618336888a5a3e90c9ac1197fa247a94fe8ef0e9aff23aab
Sep 18 20:00:00.542167 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.542141    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829360-sf4z7"]
Sep 18 20:00:00.543195 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:00:00.543170    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dee1a0b_209a_4ff8_ba90_2af8055910ed.slice/crio-b417316aaf520060aa2f0c7d49abde43f8906d2d94f957e49a76d7189c8fd683 WatchSource:0}: Error finding container b417316aaf520060aa2f0c7d49abde43f8906d2d94f957e49a76d7189c8fd683: Status 404 returned error can't find the container with id b417316aaf520060aa2f0c7d49abde43f8906d2d94f957e49a76d7189c8fd683
Sep 18 20:00:00.641440 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:00.641410    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:01.099958 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:01.099917    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:01.244963 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:01.244925    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829360-sf4z7" event={"ID":"8dee1a0b-209a-4ff8-ba90-2af8055910ed","Type":"ContainerStarted","Data":"3332832e06b2d3cca88f8105a1054cd1d2b41dea93175ab86a3461e6f5c761cd"}
Sep 18 20:00:01.245138 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:01.245019    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829360-sf4z7" event={"ID":"8dee1a0b-209a-4ff8-ba90-2af8055910ed","Type":"ContainerStarted","Data":"b417316aaf520060aa2f0c7d49abde43f8906d2d94f957e49a76d7189c8fd683"}
Sep 18 20:00:01.246567 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:01.246539    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-674263-29829360-49cg2" event={"ID":"6136b913-ec7e-4387-818e-b4242ea66554","Type":"ContainerStarted","Data":"63736577d7d5f5d69bd10647dc3759856e99b6b7e6a585121da1e1cb65d4bbb8"}
Sep 18 20:00:01.246698 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:01.246584    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-674263-29829360-49cg2" event={"ID":"6136b913-ec7e-4387-818e-b4242ea66554","Type":"ContainerStarted","Data":"1f75303deafab1c8618336888a5a3e90c9ac1197fa247a94fe8ef0e9aff23aab"}
Sep 18 20:00:01.247892 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:01.247871    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d6291d-29829360-xxfqc" event={"ID":"3785357c-8a86-4ed9-94e1-e7d340cd5ec6","Type":"ContainerStarted","Data":"52837ffa00dcecff09ccb82ce8043cc9d3b28b9f6e13c20c36e4ac1495254f77"}
Sep 18 20:00:01.248001 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:01.247906    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d6291d-29829360-xxfqc" event={"ID":"3785357c-8a86-4ed9-94e1-e7d340cd5ec6","Type":"ContainerStarted","Data":"ef52f841583f17f64ddc3b52ea3815b5bc33663f0b7ceec7d1771508c9ded9cb"}
Sep 18 20:00:01.260594 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:01.260553    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829360-sf4z7" podStartSLOduration=1.2605399259999999 podStartE2EDuration="1.260539926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:00:01.259265992 +0000 UTC m=+1243.586359757" watchObservedRunningTime="2026-09-18 20:00:01.260539926 +0000 UTC m=+1243.587633689"
Sep 18 20:00:01.277985 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:01.277939    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-674263-29829360-49cg2" podStartSLOduration=1.277923256 podStartE2EDuration="1.277923256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:00:01.275404629 +0000 UTC m=+1243.602498395" watchObservedRunningTime="2026-09-18 20:00:01.277923256 +0000 UTC m=+1243.605017017"
Sep 18 20:00:01.297196 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:01.297149    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d6291d-29829360-xxfqc" podStartSLOduration=1.29713396 podStartE2EDuration="1.29713396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:00:01.294204684 +0000 UTC m=+1243.621298449" watchObservedRunningTime="2026-09-18 20:00:01.29713396 +0000 UTC m=+1243.624227723"
Sep 18 20:00:02.256845 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:02.256809    2583 generic.go:356] "Generic (PLEG): container finished" podID="6136b913-ec7e-4387-818e-b4242ea66554" containerID="63736577d7d5f5d69bd10647dc3759856e99b6b7e6a585121da1e1cb65d4bbb8" exitCode=0
Sep 18 20:00:02.257258 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:02.256893    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-674263-29829360-49cg2" event={"ID":"6136b913-ec7e-4387-818e-b4242ea66554","Type":"ContainerDied","Data":"63736577d7d5f5d69bd10647dc3759856e99b6b7e6a585121da1e1cb65d4bbb8"}
Sep 18 20:00:02.258603 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:02.258580    2583 generic.go:356] "Generic (PLEG): container finished" podID="3785357c-8a86-4ed9-94e1-e7d340cd5ec6" containerID="52837ffa00dcecff09ccb82ce8043cc9d3b28b9f6e13c20c36e4ac1495254f77" exitCode=0
Sep 18 20:00:02.258722 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:02.258653    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d6291d-29829360-xxfqc" event={"ID":"3785357c-8a86-4ed9-94e1-e7d340cd5ec6","Type":"ContainerDied","Data":"52837ffa00dcecff09ccb82ce8043cc9d3b28b9f6e13c20c36e4ac1495254f77"}
Sep 18 20:00:02.260209 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:02.260186    2583 generic.go:356] "Generic (PLEG): container finished" podID="8dee1a0b-209a-4ff8-ba90-2af8055910ed" containerID="3332832e06b2d3cca88f8105a1054cd1d2b41dea93175ab86a3461e6f5c761cd" exitCode=0
Sep 18 20:00:02.260330 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:02.260227    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829360-sf4z7" event={"ID":"8dee1a0b-209a-4ff8-ba90-2af8055910ed","Type":"ContainerDied","Data":"3332832e06b2d3cca88f8105a1054cd1d2b41dea93175ab86a3461e6f5c761cd"}
Sep 18 20:00:03.270557 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:03.270523    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:03.391902 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:03.391867    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:03.440434 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:03.440408    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d6291d-29829360-xxfqc"
Sep 18 20:00:03.483020 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:03.482993    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-674263-29829360-49cg2"
Sep 18 20:00:03.487086 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:03.487061    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829360-sf4z7"
Sep 18 20:00:03.548823 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:03.548752    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:04.274112 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:04.274082    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-674263-29829360-49cg2"
Sep 18 20:00:04.274112 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:04.274090    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-674263-29829360-49cg2" event={"ID":"6136b913-ec7e-4387-818e-b4242ea66554","Type":"ContainerDied","Data":"1f75303deafab1c8618336888a5a3e90c9ac1197fa247a94fe8ef0e9aff23aab"}
Sep 18 20:00:04.274585 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:04.274169    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f75303deafab1c8618336888a5a3e90c9ac1197fa247a94fe8ef0e9aff23aab"
Sep 18 20:00:04.275559 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:04.275536    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d6291d-29829360-xxfqc"
Sep 18 20:00:04.275675 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:04.275567    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d6291d-29829360-xxfqc" event={"ID":"3785357c-8a86-4ed9-94e1-e7d340cd5ec6","Type":"ContainerDied","Data":"ef52f841583f17f64ddc3b52ea3815b5bc33663f0b7ceec7d1771508c9ded9cb"}
Sep 18 20:00:04.275675 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:04.275609    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef52f841583f17f64ddc3b52ea3815b5bc33663f0b7ceec7d1771508c9ded9cb"
Sep 18 20:00:04.276920 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:04.276900    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829360-sf4z7" event={"ID":"8dee1a0b-209a-4ff8-ba90-2af8055910ed","Type":"ContainerDied","Data":"b417316aaf520060aa2f0c7d49abde43f8906d2d94f957e49a76d7189c8fd683"}
Sep 18 20:00:04.277027 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:04.276931    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b417316aaf520060aa2f0c7d49abde43f8906d2d94f957e49a76d7189c8fd683"
Sep 18 20:00:04.277027 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:04.276904    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829360-sf4z7"
Sep 18 20:00:04.461783 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:04.461752    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:05.211322 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:05.211295    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:05.896974 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:05.896942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:06.758207 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:06.758181    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:06.848307 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:06.848278    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:07.268278 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.268245    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:07.366950 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.366918    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:07.373976 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.373950    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"]
Sep 18 20:00:07.374421 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.374408    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dee1a0b-209a-4ff8-ba90-2af8055910ed" containerName="cleanup"
Sep 18 20:00:07.374474 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.374423    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dee1a0b-209a-4ff8-ba90-2af8055910ed" containerName="cleanup"
Sep 18 20:00:07.374474 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.374439    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6136b913-ec7e-4387-818e-b4242ea66554" containerName="cleanup"
Sep 18 20:00:07.374474 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.374448    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6136b913-ec7e-4387-818e-b4242ea66554" containerName="cleanup"
Sep 18 20:00:07.374474 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.374462    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3785357c-8a86-4ed9-94e1-e7d340cd5ec6" containerName="cleanup"
Sep 18 20:00:07.374474 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.374467    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="3785357c-8a86-4ed9-94e1-e7d340cd5ec6" containerName="cleanup"
Sep 18 20:00:07.374631 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.374545    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dee1a0b-209a-4ff8-ba90-2af8055910ed" containerName="cleanup"
Sep 18 20:00:07.374631 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.374555    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="3785357c-8a86-4ed9-94e1-e7d340cd5ec6" containerName="cleanup"
Sep 18 20:00:07.374631 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.374562    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6136b913-ec7e-4387-818e-b4242ea66554" containerName="cleanup"
Sep 18 20:00:07.377739 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.377725    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"
Sep 18 20:00:07.380376 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.380360    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-047bea\""
Sep 18 20:00:07.390507 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.390478    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"]
Sep 18 20:00:07.403690 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.403666    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"]
Sep 18 20:00:07.407329 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.407309    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"
Sep 18 20:00:07.410132 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.410112    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-047bea-dockercfg-2gnw9\""
Sep 18 20:00:07.417863 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.417843    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"]
Sep 18 20:00:07.478704 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.478644    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/283bb088-5ae9-45d2-8950-ed8ee537bc23-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8\" (UID: \"283bb088-5ae9-45d2-8950-ed8ee537bc23\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"
Sep 18 20:00:07.478865 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.478732    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwmpk\" (UniqueName: \"kubernetes.io/projected/283bb088-5ae9-45d2-8950-ed8ee537bc23-kube-api-access-xwmpk\") pod \"payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8\" (UID: \"283bb088-5ae9-45d2-8950-ed8ee537bc23\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"
Sep 18 20:00:07.579589 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.579497    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a688ef1-04dc-4339-9b8a-35580391fd63-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f\" (UID: \"4a688ef1-04dc-4339-9b8a-35580391fd63\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"
Sep 18 20:00:07.579589 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.579562    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcwjn\" (UniqueName: \"kubernetes.io/projected/4a688ef1-04dc-4339-9b8a-35580391fd63-kube-api-access-zcwjn\") pod \"payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f\" (UID: \"4a688ef1-04dc-4339-9b8a-35580391fd63\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"
Sep 18 20:00:07.579776 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.579643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/283bb088-5ae9-45d2-8950-ed8ee537bc23-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8\" (UID: \"283bb088-5ae9-45d2-8950-ed8ee537bc23\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"
Sep 18 20:00:07.579776 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.579702    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwmpk\" (UniqueName: \"kubernetes.io/projected/283bb088-5ae9-45d2-8950-ed8ee537bc23-kube-api-access-xwmpk\") pod \"payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8\" (UID: \"283bb088-5ae9-45d2-8950-ed8ee537bc23\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"
Sep 18 20:00:07.580357 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.580340    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/283bb088-5ae9-45d2-8950-ed8ee537bc23-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8\" (UID: \"283bb088-5ae9-45d2-8950-ed8ee537bc23\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"
Sep 18 20:00:07.589193 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.589169    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwmpk\" (UniqueName: \"kubernetes.io/projected/283bb088-5ae9-45d2-8950-ed8ee537bc23-kube-api-access-xwmpk\") pod \"payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8\" (UID: \"283bb088-5ae9-45d2-8950-ed8ee537bc23\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"
Sep 18 20:00:07.680649 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.680615    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a688ef1-04dc-4339-9b8a-35580391fd63-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f\" (UID: \"4a688ef1-04dc-4339-9b8a-35580391fd63\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"
Sep 18 20:00:07.680790 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.680665    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcwjn\" (UniqueName: \"kubernetes.io/projected/4a688ef1-04dc-4339-9b8a-35580391fd63-kube-api-access-zcwjn\") pod \"payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f\" (UID: \"4a688ef1-04dc-4339-9b8a-35580391fd63\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"
Sep 18 20:00:07.681411 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.681387    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a688ef1-04dc-4339-9b8a-35580391fd63-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f\" (UID: \"4a688ef1-04dc-4339-9b8a-35580391fd63\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"
Sep 18 20:00:07.689521 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.689501    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"
Sep 18 20:00:07.696444 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.696418    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcwjn\" (UniqueName: \"kubernetes.io/projected/4a688ef1-04dc-4339-9b8a-35580391fd63-kube-api-access-zcwjn\") pod \"payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f\" (UID: \"4a688ef1-04dc-4339-9b8a-35580391fd63\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"
Sep 18 20:00:07.719336 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.719309    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"
Sep 18 20:00:07.800294 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.800269    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:07.972586 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:07.972547    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"]
Sep 18 20:00:07.973769 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:00:07.973743    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod283bb088_5ae9_45d2_8950_ed8ee537bc23.slice/crio-d57f6cf762da62db8db2b2832b7ae6d9263ec748d03041c5395f26314ee7df49 WatchSource:0}: Error finding container d57f6cf762da62db8db2b2832b7ae6d9263ec748d03041c5395f26314ee7df49: Status 404 returned error can't find the container with id d57f6cf762da62db8db2b2832b7ae6d9263ec748d03041c5395f26314ee7df49
Sep 18 20:00:08.005306 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:08.005284    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"]
Sep 18 20:00:08.018137 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:00:08.018107    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a688ef1_04dc_4339_9b8a_35580391fd63.slice/crio-b1fd67787f73e2be9752c34c10b25cf8af6095c29c30dd7c3c6736bfa53886a3 WatchSource:0}: Error finding container b1fd67787f73e2be9752c34c10b25cf8af6095c29c30dd7c3c6736bfa53886a3: Status 404 returned error can't find the container with id b1fd67787f73e2be9752c34c10b25cf8af6095c29c30dd7c3c6736bfa53886a3
Sep 18 20:00:08.312128 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:08.312019    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8" event={"ID":"283bb088-5ae9-45d2-8950-ed8ee537bc23","Type":"ContainerStarted","Data":"4a4144ddb68d502ac364d918fbb6d59b347b174bf4fe87d95364f3ca807382c7"}
Sep 18 20:00:08.312128 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:08.312094    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8" event={"ID":"283bb088-5ae9-45d2-8950-ed8ee537bc23","Type":"ContainerStarted","Data":"d57f6cf762da62db8db2b2832b7ae6d9263ec748d03041c5395f26314ee7df49"}
Sep 18 20:00:08.312648 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:08.312178    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"
Sep 18 20:00:08.314349 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:08.314323    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f" event={"ID":"4a688ef1-04dc-4339-9b8a-35580391fd63","Type":"ContainerStarted","Data":"d3d2ab79c4e44b6d13b4bcba6028820d67ba857270c1b21641e2a20b7881aca6"}
Sep 18 20:00:08.314484 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:08.314363    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f" event={"ID":"4a688ef1-04dc-4339-9b8a-35580391fd63","Type":"ContainerStarted","Data":"b1fd67787f73e2be9752c34c10b25cf8af6095c29c30dd7c3c6736bfa53886a3"}
Sep 18 20:00:08.314484 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:08.314459    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"
Sep 18 20:00:08.338989 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:08.338943    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8" podStartSLOduration=1.3389287730000001 podStartE2EDuration="1.338928773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:00:08.336657197 +0000 UTC m=+1250.663750989" watchObservedRunningTime="2026-09-18 20:00:08.338928773 +0000 UTC m=+1250.666022540"
Sep 18 20:00:08.359662 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:08.359619    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f" podStartSLOduration=1.359606856 podStartE2EDuration="1.359606856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:00:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:00:08.358643477 +0000 UTC m=+1250.685737242" watchObservedRunningTime="2026-09-18 20:00:08.359606856 +0000 UTC m=+1250.686700621"
Sep 18 20:00:08.654229 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:08.654198    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:19.322928 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:19.322895    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"
Sep 18 20:00:19.323462 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:19.323090    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"
Sep 18 20:00:20.094826 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:20.094797    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:29.103591 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:29.103559    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:29.989064 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:29.989018    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:30.731358 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:30.731322    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:31.536639 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:31.536604    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:32.380472 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:32.380439    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:33.109851 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:33.109826    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:33.339171 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:33.339139    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:33.642917 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:33.642884    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:33.943143 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:33.943067    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"]
Sep 18 20:00:33.948592 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:33.948556    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:33.951779 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:33.951758    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-9838c2-openshift-default-dockercfg-bccnq\""
Sep 18 20:00:33.970899 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:33.970864    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"]
Sep 18 20:00:33.979988 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:33.979969    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:34.042303 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.042269    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-envoy\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.042471 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.042314    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drpd7\" (UniqueName: \"kubernetes.io/projected/06c38514-0a40-4293-b06d-3ccdf0a46688-kube-api-access-drpd7\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.042471 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.042432    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-credential-socket\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.042591 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.042483    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-workload-certs\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.042591 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.042530    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06c38514-0a40-4293-b06d-3ccdf0a46688-istiod-ca-cert\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.042668 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.042595    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-data\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.042668 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.042644    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-podinfo\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.042668 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.042660    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-token\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.042786 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.042681    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-workload-socket\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.143793 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.143649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drpd7\" (UniqueName: \"kubernetes.io/projected/06c38514-0a40-4293-b06d-3ccdf0a46688-kube-api-access-drpd7\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.144640 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.144616    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-credential-socket\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.145174 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.145002    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-workload-certs\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.145700 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.145646    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-workload-certs\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.146083 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.146065    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06c38514-0a40-4293-b06d-3ccdf0a46688-istiod-ca-cert\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.146580 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.146550    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-data\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.146744 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.146728    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-data\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.147014 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.146996    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-podinfo\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.147630 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.147612    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-token\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.147866 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.146723    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06c38514-0a40-4293-b06d-3ccdf0a46688-istiod-ca-cert\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.147866 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.146900    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-credential-socket\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.148062 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.148028    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-workload-socket\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.148234 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.148217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-envoy\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.148350 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.148327    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-workload-socket\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.151319 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.151293    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-envoy\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.151739 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.151719    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-podinfo\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.155304 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.155277    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drpd7\" (UniqueName: \"kubernetes.io/projected/06c38514-0a40-4293-b06d-3ccdf0a46688-kube-api-access-drpd7\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.156139 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.156112    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-token\") pod \"e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") " pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.258989 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.258918    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:34.343942 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.343893    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:34.537195 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.537170    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"]
Sep 18 20:00:34.538254 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:00:34.538229    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06c38514_0a40_4293_b06d_3ccdf0a46688.slice/crio-6bdae1df9e986e76c92a3981bdaefc34c45c159d82cebcbd6e08bf257358535b WatchSource:0}: Error finding container 6bdae1df9e986e76c92a3981bdaefc34c45c159d82cebcbd6e08bf257358535b: Status 404 returned error can't find the container with id 6bdae1df9e986e76c92a3981bdaefc34c45c159d82cebcbd6e08bf257358535b
Sep 18 20:00:34.540533 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.540502    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:00:34.540602 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.540562    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:00:34.540602 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:34.540591    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:00:35.492647 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:35.492613    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m" event={"ID":"06c38514-0a40-4293-b06d-3ccdf0a46688","Type":"ContainerStarted","Data":"557de4117508b507db440e942eaffa600366f06b988af8b4a619baf69d9278f2"}
Sep 18 20:00:35.493021 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:35.492672    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m" event={"ID":"06c38514-0a40-4293-b06d-3ccdf0a46688","Type":"ContainerStarted","Data":"6bdae1df9e986e76c92a3981bdaefc34c45c159d82cebcbd6e08bf257358535b"}
Sep 18 20:00:35.514183 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:35.514136    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m" podStartSLOduration=2.514122918 podStartE2EDuration="2.514122918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:00:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:00:35.512901568 +0000 UTC m=+1277.839995323" watchObservedRunningTime="2026-09-18 20:00:35.514122918 +0000 UTC m=+1277.841216682"
Sep 18 20:00:36.259127 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:36.259085    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:36.264226 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:36.264202    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:36.500208 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:36.500175    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:36.501371 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:36.501348    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:00:36.775529 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:36.775497    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:37.446506 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:37.446466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:37.548249 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:37.548219    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:37.646511 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:37.646471    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:38.434670 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:38.434635    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:39.183978 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:39.183948    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:40.014849 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:40.014812    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:40.638156 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:40.638129    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:40.745103 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:40.745072    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:40.841529 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:40.841501    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:41.444485 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:41.444459    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:41.529739 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:41.529704    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:41.703350 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:41.703271    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:41.917525 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:41.917492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:42.014476 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:42.014403    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:42.040741 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:42.040712    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"]
Sep 18 20:00:42.044444 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:42.044428    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"
Sep 18 20:00:42.047298 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:42.047279    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-9838c2\""
Sep 18 20:00:42.047402 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:42.047382    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-9838c2-dockercfg-mv885\""
Sep 18 20:00:42.055814 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:42.055786    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"]
Sep 18 20:00:42.235138 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:42.235101    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bvbp\" (UniqueName: \"kubernetes.io/projected/733f96f7-c46f-476e-93ca-b97347780652-kube-api-access-7bvbp\") pod \"payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8\" (UID: \"733f96f7-c46f-476e-93ca-b97347780652\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"
Sep 18 20:00:42.235311 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:42.235189    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/733f96f7-c46f-476e-93ca-b97347780652-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8\" (UID: \"733f96f7-c46f-476e-93ca-b97347780652\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"
Sep 18 20:00:42.336479 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:42.336453    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/733f96f7-c46f-476e-93ca-b97347780652-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8\" (UID: \"733f96f7-c46f-476e-93ca-b97347780652\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"
Sep 18 20:00:42.336619 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:42.336534    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bvbp\" (UniqueName: \"kubernetes.io/projected/733f96f7-c46f-476e-93ca-b97347780652-kube-api-access-7bvbp\") pod \"payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8\" (UID: \"733f96f7-c46f-476e-93ca-b97347780652\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"
Sep 18 20:00:42.337197 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:42.337180    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/733f96f7-c46f-476e-93ca-b97347780652-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8\" (UID: \"733f96f7-c46f-476e-93ca-b97347780652\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"
Sep 18 20:00:42.344862 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:42.344832    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bvbp\" (UniqueName: \"kubernetes.io/projected/733f96f7-c46f-476e-93ca-b97347780652-kube-api-access-7bvbp\") pod \"payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8\" (UID: \"733f96f7-c46f-476e-93ca-b97347780652\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"
Sep 18 20:00:42.357670 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:42.357644    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"
Sep 18 20:00:42.631527 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:42.631501    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"]
Sep 18 20:00:42.632776 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:00:42.632746    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733f96f7_c46f_476e_93ca_b97347780652.slice/crio-f746930722f624f4019dc8ba7cb1d07bdebcf171db3212651cb27cb62745ad89 WatchSource:0}: Error finding container f746930722f624f4019dc8ba7cb1d07bdebcf171db3212651cb27cb62745ad89: Status 404 returned error can't find the container with id f746930722f624f4019dc8ba7cb1d07bdebcf171db3212651cb27cb62745ad89
Sep 18 20:00:43.550782 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:43.550741    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8" event={"ID":"733f96f7-c46f-476e-93ca-b97347780652","Type":"ContainerStarted","Data":"52d643c19b174762ac2054a941fb7cd4ff33527dd12302469a0e022c1f1ca77f"}
Sep 18 20:00:43.551211 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:43.550841    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8" event={"ID":"733f96f7-c46f-476e-93ca-b97347780652","Type":"ContainerStarted","Data":"f746930722f624f4019dc8ba7cb1d07bdebcf171db3212651cb27cb62745ad89"}
Sep 18 20:00:43.551211 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:43.550870    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"
Sep 18 20:00:43.584853 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:43.584807    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8" podStartSLOduration=1.584793018 podStartE2EDuration="1.584793018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:00:43.583150016 +0000 UTC m=+1285.910243780" watchObservedRunningTime="2026-09-18 20:00:43.584793018 +0000 UTC m=+1285.911886781"
Sep 18 20:00:49.137191 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:49.137159    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t"]
Sep 18 20:00:49.140979 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:49.140963    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t"
Sep 18 20:00:49.143959 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:49.143931    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 20:00:49.144082 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:49.143961    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 20:00:49.150949 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:49.150911    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t"]
Sep 18 20:00:49.203524 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:49.203496    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t\" (UID: \"92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t"
Sep 18 20:00:49.304318 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:49.304279    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t\" (UID: \"92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t"
Sep 18 20:00:49.304914 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:49.304896    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t\" (UID: \"92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t"
Sep 18 20:00:49.452748 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:49.452681    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t"
Sep 18 20:00:49.475683 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:49.475659    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:49.729648 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:49.729623    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t"]
Sep 18 20:00:49.731312 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:00:49.731289    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f9fbb9_e697_4d1d_a1f0_9cfeae9a865d.slice/crio-e2c96a3727a084df029c2c7d91b6f7cb306f0de9f8325596b929ed919b9fd68d WatchSource:0}: Error finding container e2c96a3727a084df029c2c7d91b6f7cb306f0de9f8325596b929ed919b9fd68d: Status 404 returned error can't find the container with id e2c96a3727a084df029c2c7d91b6f7cb306f0de9f8325596b929ed919b9fd68d
Sep 18 20:00:50.329265 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:50.329190    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:50.595662 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:50.595626    2583 generic.go:356] "Generic (PLEG): container finished" podID="92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d" containerID="04be7f221234eb90ee3217be070ac6fe83aa1222006ed68186e6a928b9f71f57" exitCode=0
Sep 18 20:00:50.595857 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:50.595713    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t" event={"ID":"92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d","Type":"ContainerDied","Data":"04be7f221234eb90ee3217be070ac6fe83aa1222006ed68186e6a928b9f71f57"}
Sep 18 20:00:50.595857 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:50.595759    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t" event={"ID":"92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d","Type":"ContainerStarted","Data":"e2c96a3727a084df029c2c7d91b6f7cb306f0de9f8325596b929ed919b9fd68d"}
Sep 18 20:00:51.380905 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:51.380877    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:51.789111 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:51.789087    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t"
Sep 18 20:00:51.848095 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:51.848056    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d-maas-api-service-ca\") pod \"92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d\" (UID: \"92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d\") "
Sep 18 20:00:51.848566 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:51.848544    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d" (UID: "92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:00:51.949632 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:51.949541    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:00:52.274269 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:52.274183    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:52.609582 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:52.609552    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t"
Sep 18 20:00:52.609974 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:52.609600    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t" event={"ID":"92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d","Type":"ContainerDied","Data":"e2c96a3727a084df029c2c7d91b6f7cb306f0de9f8325596b929ed919b9fd68d"}
Sep 18 20:00:52.609974 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:52.609652    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2c96a3727a084df029c2c7d91b6f7cb306f0de9f8325596b929ed919b9fd68d"
Sep 18 20:00:53.045942 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:53.045858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:53.922911 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:53.922840    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:54.560096 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:54.560066    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"
Sep 18 20:00:54.899493 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:54.899456    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:55.609711 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:55.609667    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:56.505756 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:56.505723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:57.306470 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:57.306434    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:57.404080 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:57.404031    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:58.011020 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:58.010991    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:58.272234 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:58.272137    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:58.924000 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:58.923964    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:59.570717 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.570688    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:59.580852 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.580828    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d6291d-29829360-xxfqc"]
Sep 18 20:00:59.583583 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.583564    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-d6291d-29829360-xxfqc"]
Sep 18 20:00:59.615503 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.615439    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"]
Sep 18 20:00:59.615698 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.615673    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z" podUID="58a5cba7-e1e6-4101-bc8b-0a974ef75041" containerName="payload-pre-processing" containerID="cri-o://a7e82e4f3905efb693214af97b453cc31b2903b7b850040a26d45b34c6e7c055" gracePeriod=30
Sep 18 20:00:59.669107 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.669082    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:59.683107 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.683079    2583 generic.go:356] "Generic (PLEG): container finished" podID="06c38514-0a40-4293-b06d-3ccdf0a46688" containerID="557de4117508b507db440e942eaffa600366f06b988af8b4a619baf69d9278f2" exitCode=0
Sep 18 20:00:59.683222 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.683153    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m" event={"ID":"06c38514-0a40-4293-b06d-3ccdf0a46688","Type":"ContainerDied","Data":"557de4117508b507db440e942eaffa600366f06b988af8b4a619baf69d9278f2"}
Sep 18 20:00:59.683587 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.683573    2583 scope.go:117] "RemoveContainer" containerID="557de4117508b507db440e942eaffa600366f06b988af8b4a619baf69d9278f2"
Sep 18 20:00:59.684781 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.684721    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:00:59.684903 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.684783    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:00:59.684903 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.684811    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:00:59.771977 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.771948    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:59.817198 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.816952    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3785357c-8a86-4ed9-94e1-e7d340cd5ec6" path="/var/lib/kubelet/pods/3785357c-8a86-4ed9-94e1-e7d340cd5ec6/volumes"
Sep 18 20:00:59.836646 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.836617    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t"]
Sep 18 20:00:59.843167 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.843084    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-d6291d-n4f4t"]
Sep 18 20:00:59.843947 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.843897    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:00:59.906253 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:00:59.906225    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"
Sep 18 20:01:00.035786 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.035699    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58a5cba7-e1e6-4101-bc8b-0a974ef75041-plugins-config-volume\") pod \"58a5cba7-e1e6-4101-bc8b-0a974ef75041\" (UID: \"58a5cba7-e1e6-4101-bc8b-0a974ef75041\") "
Sep 18 20:01:00.036237 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.035808    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5rzq\" (UniqueName: \"kubernetes.io/projected/58a5cba7-e1e6-4101-bc8b-0a974ef75041-kube-api-access-s5rzq\") pod \"58a5cba7-e1e6-4101-bc8b-0a974ef75041\" (UID: \"58a5cba7-e1e6-4101-bc8b-0a974ef75041\") "
Sep 18 20:01:00.036237 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.036073    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58a5cba7-e1e6-4101-bc8b-0a974ef75041-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "58a5cba7-e1e6-4101-bc8b-0a974ef75041" (UID: "58a5cba7-e1e6-4101-bc8b-0a974ef75041"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:01:00.036237 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.036233    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58a5cba7-e1e6-4101-bc8b-0a974ef75041-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:01:00.038290 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.038266    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58a5cba7-e1e6-4101-bc8b-0a974ef75041-kube-api-access-s5rzq" (OuterVolumeSpecName: "kube-api-access-s5rzq") pod "58a5cba7-e1e6-4101-bc8b-0a974ef75041" (UID: "58a5cba7-e1e6-4101-bc8b-0a974ef75041"). InnerVolumeSpecName "kube-api-access-s5rzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:01:00.137488 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.137451    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5rzq\" (UniqueName: \"kubernetes.io/projected/58a5cba7-e1e6-4101-bc8b-0a974ef75041-kube-api-access-s5rzq\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:01:00.181101 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.181071    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:00.337249 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.337216    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:00.690970 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.690876    2583 generic.go:356] "Generic (PLEG): container finished" podID="58a5cba7-e1e6-4101-bc8b-0a974ef75041" containerID="a7e82e4f3905efb693214af97b453cc31b2903b7b850040a26d45b34c6e7c055" exitCode=0
Sep 18 20:01:00.690970 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.690921    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"
Sep 18 20:01:00.691256 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.690965    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z" event={"ID":"58a5cba7-e1e6-4101-bc8b-0a974ef75041","Type":"ContainerDied","Data":"a7e82e4f3905efb693214af97b453cc31b2903b7b850040a26d45b34c6e7c055"}
Sep 18 20:01:00.691256 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.691018    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z" event={"ID":"58a5cba7-e1e6-4101-bc8b-0a974ef75041","Type":"ContainerDied","Data":"389cc7c442530b6e864dff0c14b38e8bc2e27ac201e5d7dd71c56e1f8dcb6868"}
Sep 18 20:01:00.691256 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.691062    2583 scope.go:117] "RemoveContainer" containerID="a7e82e4f3905efb693214af97b453cc31b2903b7b850040a26d45b34c6e7c055"
Sep 18 20:01:00.693473 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.693450    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m" event={"ID":"06c38514-0a40-4293-b06d-3ccdf0a46688","Type":"ContainerStarted","Data":"d6a3ba33be03b7aa5e9913219f9cb4dc3e6c25245620b51e0fc60c817227d1ad"}
Sep 18 20:01:00.701665 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.701647    2583 scope.go:117] "RemoveContainer" containerID="a7e82e4f3905efb693214af97b453cc31b2903b7b850040a26d45b34c6e7c055"
Sep 18 20:01:00.701942 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:01:00.701924    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7e82e4f3905efb693214af97b453cc31b2903b7b850040a26d45b34c6e7c055\": container with ID starting with a7e82e4f3905efb693214af97b453cc31b2903b7b850040a26d45b34c6e7c055 not found: ID does not exist" containerID="a7e82e4f3905efb693214af97b453cc31b2903b7b850040a26d45b34c6e7c055"
Sep 18 20:01:00.701990 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.701949    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7e82e4f3905efb693214af97b453cc31b2903b7b850040a26d45b34c6e7c055"} err="failed to get container status \"a7e82e4f3905efb693214af97b453cc31b2903b7b850040a26d45b34c6e7c055\": rpc error: code = NotFound desc = could not find container \"a7e82e4f3905efb693214af97b453cc31b2903b7b850040a26d45b34c6e7c055\": container with ID starting with a7e82e4f3905efb693214af97b453cc31b2903b7b850040a26d45b34c6e7c055 not found: ID does not exist"
Sep 18 20:01:00.743463 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.743428    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"]
Sep 18 20:01:00.757407 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:00.757379    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-d6291d-7df7d6c8c8-n6v7z"]
Sep 18 20:01:01.251740 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:01.251707    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:01.261024 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:01.260998    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:01:01.261316 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:01.261075    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 18 20:01:01.261464 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:01.261440    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m" podUID="06c38514-0a40-4293-b06d-3ccdf0a46688" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 18 20:01:01.813368 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:01.813325    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58a5cba7-e1e6-4101-bc8b-0a974ef75041" path="/var/lib/kubelet/pods/58a5cba7-e1e6-4101-bc8b-0a974ef75041/volumes"
Sep 18 20:01:01.813926 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:01.813899    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d" path="/var/lib/kubelet/pods/92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d/volumes"
Sep 18 20:01:01.996327 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:01.996295    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:02.259923 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:02.259882    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 18 20:01:02.260347 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:02.259951    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m" podUID="06c38514-0a40-4293-b06d-3ccdf0a46688" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 18 20:01:02.797355 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:02.797327    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:03.260347 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:03.260313    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 18 20:01:03.260722 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:03.260365    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m" podUID="06c38514-0a40-4293-b06d-3ccdf0a46688" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 18 20:01:03.525642 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:03.525548    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:04.260332 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:04.260300    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 18 20:01:04.260508 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:04.260351    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m" podUID="06c38514-0a40-4293-b06d-3ccdf0a46688" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 18 20:01:04.315062 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:04.315009    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:05.097486 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:05.097448    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:05.259681 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:05.259648    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Sep 18 20:01:05.259858 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:05.259702    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m" podUID="06c38514-0a40-4293-b06d-3ccdf0a46688" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Sep 18 20:01:05.299585 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:05.299542    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:06.264330 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:06.264301    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:01:06.264664 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:06.264642    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:01:06.265279 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:06.265261    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:01:06.950677 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:06.950647    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:07.258413 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:07.258338    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:07.356299 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:07.356270    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:09.883948 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:09.883919    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:10.734931 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:10.734903    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:10.832347 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:10.832312    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:11.512858 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:11.512821    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:12.422720 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:12.422692    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:13.398690 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:13.398654    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:14.213846 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:14.213804    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:14.912349 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:14.912317    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:15.012551 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.012509    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:15.163361 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.163285    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:15.386368 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.386338    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:15.488440 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.488361    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:15.495173 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.495148    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"]
Sep 18 20:01:15.495580 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.495567    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58a5cba7-e1e6-4101-bc8b-0a974ef75041" containerName="payload-pre-processing"
Sep 18 20:01:15.495625 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.495581    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="58a5cba7-e1e6-4101-bc8b-0a974ef75041" containerName="payload-pre-processing"
Sep 18 20:01:15.495625 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.495607    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d" containerName="revoke-keys"
Sep 18 20:01:15.495625 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.495613    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d" containerName="revoke-keys"
Sep 18 20:01:15.495724 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.495676    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="58a5cba7-e1e6-4101-bc8b-0a974ef75041" containerName="payload-pre-processing"
Sep 18 20:01:15.495724 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.495687    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="92f9fbb9-e697-4d1d-a1f0-9cfeae9a865d" containerName="revoke-keys"
Sep 18 20:01:15.499075 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.499061    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"
Sep 18 20:01:15.501830 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.501812    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-166dc9bb-dockercfg-hhm9j\""
Sep 18 20:01:15.501942 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.501864    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-166dc9bb\""
Sep 18 20:01:15.510489 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.510460    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"]
Sep 18 20:01:15.530327 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.530299    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"]
Sep 18 20:01:15.534154 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.534132    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"
Sep 18 20:01:15.544605 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.544580    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"]
Sep 18 20:01:15.709801 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.709768    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22292678-1ea6-4840-930d-1f3f65606bbe-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6\" (UID: \"22292678-1ea6-4840-930d-1f3f65606bbe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"
Sep 18 20:01:15.709801 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.709807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwwsx\" (UniqueName: \"kubernetes.io/projected/22292678-1ea6-4840-930d-1f3f65606bbe-kube-api-access-vwwsx\") pod \"payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6\" (UID: \"22292678-1ea6-4840-930d-1f3f65606bbe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"
Sep 18 20:01:15.710132 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.709933    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0c5b6af-4214-4955-b57e-1cff0a548399-plugins-config-volume\") pod \"payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv\" (UID: \"d0c5b6af-4214-4955-b57e-1cff0a548399\") " pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"
Sep 18 20:01:15.710132 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.709986    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9l8l\" (UniqueName: \"kubernetes.io/projected/d0c5b6af-4214-4955-b57e-1cff0a548399-kube-api-access-n9l8l\") pod \"payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv\" (UID: \"d0c5b6af-4214-4955-b57e-1cff0a548399\") " pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"
Sep 18 20:01:15.810919 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.810842    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22292678-1ea6-4840-930d-1f3f65606bbe-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6\" (UID: \"22292678-1ea6-4840-930d-1f3f65606bbe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"
Sep 18 20:01:15.810919 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.810875    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwwsx\" (UniqueName: \"kubernetes.io/projected/22292678-1ea6-4840-930d-1f3f65606bbe-kube-api-access-vwwsx\") pod \"payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6\" (UID: \"22292678-1ea6-4840-930d-1f3f65606bbe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"
Sep 18 20:01:15.811164 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.810927    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0c5b6af-4214-4955-b57e-1cff0a548399-plugins-config-volume\") pod \"payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv\" (UID: \"d0c5b6af-4214-4955-b57e-1cff0a548399\") " pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"
Sep 18 20:01:15.811164 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.810954    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9l8l\" (UniqueName: \"kubernetes.io/projected/d0c5b6af-4214-4955-b57e-1cff0a548399-kube-api-access-n9l8l\") pod \"payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv\" (UID: \"d0c5b6af-4214-4955-b57e-1cff0a548399\") " pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"
Sep 18 20:01:15.811624 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.811602    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22292678-1ea6-4840-930d-1f3f65606bbe-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6\" (UID: \"22292678-1ea6-4840-930d-1f3f65606bbe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"
Sep 18 20:01:15.811701 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.811683    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0c5b6af-4214-4955-b57e-1cff0a548399-plugins-config-volume\") pod \"payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv\" (UID: \"d0c5b6af-4214-4955-b57e-1cff0a548399\") " pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"
Sep 18 20:01:15.819755 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.819720    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9l8l\" (UniqueName: \"kubernetes.io/projected/d0c5b6af-4214-4955-b57e-1cff0a548399-kube-api-access-n9l8l\") pod \"payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv\" (UID: \"d0c5b6af-4214-4955-b57e-1cff0a548399\") " pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"
Sep 18 20:01:15.819889 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.819826    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwwsx\" (UniqueName: \"kubernetes.io/projected/22292678-1ea6-4840-930d-1f3f65606bbe-kube-api-access-vwwsx\") pod \"payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6\" (UID: \"22292678-1ea6-4840-930d-1f3f65606bbe\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"
Sep 18 20:01:15.846796 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:15.846758    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"
Sep 18 20:01:16.112148 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:16.112114    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"
Sep 18 20:01:16.127141 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:16.127112    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"]
Sep 18 20:01:16.129139 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:01:16.129109    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0c5b6af_4214_4955_b57e_1cff0a548399.slice/crio-867e61dd4657c6e2aba02d0c6697513cec16cdd03a4bee9a6b93a0e9f0937aad WatchSource:0}: Error finding container 867e61dd4657c6e2aba02d0c6697513cec16cdd03a4bee9a6b93a0e9f0937aad: Status 404 returned error can't find the container with id 867e61dd4657c6e2aba02d0c6697513cec16cdd03a4bee9a6b93a0e9f0937aad
Sep 18 20:01:16.398959 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:16.398928    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"]
Sep 18 20:01:16.400868 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:01:16.400845    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22292678_1ea6_4840_930d_1f3f65606bbe.slice/crio-c76b3c0970dd69dc3b58171ce35cfb3475a8bbd04868638d779d61943ca0a2c8 WatchSource:0}: Error finding container c76b3c0970dd69dc3b58171ce35cfb3475a8bbd04868638d779d61943ca0a2c8: Status 404 returned error can't find the container with id c76b3c0970dd69dc3b58171ce35cfb3475a8bbd04868638d779d61943ca0a2c8
Sep 18 20:01:16.805375 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:16.805286    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6" event={"ID":"22292678-1ea6-4840-930d-1f3f65606bbe","Type":"ContainerStarted","Data":"fcc8a3d0092c4f136fa2f749da2a1bcd55e791a5f6db9b09e012106c028029a7"}
Sep 18 20:01:16.805375 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:16.805337    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6" event={"ID":"22292678-1ea6-4840-930d-1f3f65606bbe","Type":"ContainerStarted","Data":"c76b3c0970dd69dc3b58171ce35cfb3475a8bbd04868638d779d61943ca0a2c8"}
Sep 18 20:01:16.805589 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:16.805388    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"
Sep 18 20:01:16.806993 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:16.806967    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv" event={"ID":"d0c5b6af-4214-4955-b57e-1cff0a548399","Type":"ContainerStarted","Data":"53bfae4cbeb7067117924720be6e99e868da4dcd6f6a7d920e79a9b32f2376dd"}
Sep 18 20:01:16.807119 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:16.807012    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv" event={"ID":"d0c5b6af-4214-4955-b57e-1cff0a548399","Type":"ContainerStarted","Data":"867e61dd4657c6e2aba02d0c6697513cec16cdd03a4bee9a6b93a0e9f0937aad"}
Sep 18 20:01:16.807119 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:16.807051    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"
Sep 18 20:01:16.826519 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:16.826462    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6" podStartSLOduration=1.826441819 podStartE2EDuration="1.826441819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:01:16.823946819 +0000 UTC m=+1319.151040586" watchObservedRunningTime="2026-09-18 20:01:16.826441819 +0000 UTC m=+1319.153535585"
Sep 18 20:01:16.842929 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:16.842883    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv" podStartSLOduration=1.8428699769999999 podStartE2EDuration="1.842869977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:01:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:01:16.84239029 +0000 UTC m=+1319.169484057" watchObservedRunningTime="2026-09-18 20:01:16.842869977 +0000 UTC m=+1319.169963741"
Sep 18 20:01:18.965455 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:18.965424    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:19.066340 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:19.066311    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:27.815497 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:27.815463    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"
Sep 18 20:01:27.815968 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:27.815837    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"
Sep 18 20:01:36.636195 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:36.636078    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:37.616217 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:37.616184    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:39.002453 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:39.002418    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:39.174285 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:39.174256    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:39.703460 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:39.703425    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:40.402412 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:40.402375    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:40.711271 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:40.711174    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:41.079542 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:41.079466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:42.040229 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:42.040174    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:42.187513 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:42.187487    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:42.807552 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:42.807515    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:42.917099 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:42.917065    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:43.734282 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:43.734239    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:48.440181 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:48.440150    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:48.540722 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:48.540692    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:48.671449 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:48.671419    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"]
Sep 18 20:01:48.671655 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:48.671630    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy" containerID="cri-o://068492a50b32e249aec3afeb8abd962c08d95537151b76ae2f607659137763ca" gracePeriod=30
Sep 18 20:01:48.694236 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:48.694152    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:49.307602 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:49.307568    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:50.381987 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:50.381958    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:51.268433 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:51.268399    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:51.683455 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:51.683421    2583 patch_prober.go:28] interesting pod/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 20:01:51.683863 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:51.683489    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:01:52.011483 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:52.011394    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:52.829185 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:52.829152    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:53.538486 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.538452    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:53.930805 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.930784    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 20:01:53.993419 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.993392    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-workload-socket\") pod \"346b626a-3590-441b-bdfd-77ce92b3de45\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") "
Sep 18 20:01:53.993563 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.993435    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-istio-data\") pod \"346b626a-3590-441b-bdfd-77ce92b3de45\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") "
Sep 18 20:01:53.993563 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.993465    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m9bl\" (UniqueName: \"kubernetes.io/projected/346b626a-3590-441b-bdfd-77ce92b3de45-kube-api-access-5m9bl\") pod \"346b626a-3590-441b-bdfd-77ce92b3de45\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") "
Sep 18 20:01:53.993563 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.993490    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/346b626a-3590-441b-bdfd-77ce92b3de45-istio-podinfo\") pod \"346b626a-3590-441b-bdfd-77ce92b3de45\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") "
Sep 18 20:01:53.993563 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.993536    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-workload-certs\") pod \"346b626a-3590-441b-bdfd-77ce92b3de45\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") "
Sep 18 20:01:53.993770 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.993574    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/346b626a-3590-441b-bdfd-77ce92b3de45-istio-token\") pod \"346b626a-3590-441b-bdfd-77ce92b3de45\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") "
Sep 18 20:01:53.993770 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.993602    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-credential-socket\") pod \"346b626a-3590-441b-bdfd-77ce92b3de45\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") "
Sep 18 20:01:53.993770 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.993653    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-istio-envoy\") pod \"346b626a-3590-441b-bdfd-77ce92b3de45\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") "
Sep 18 20:01:53.993770 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.993687    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/346b626a-3590-441b-bdfd-77ce92b3de45-istiod-ca-cert\") pod \"346b626a-3590-441b-bdfd-77ce92b3de45\" (UID: \"346b626a-3590-441b-bdfd-77ce92b3de45\") "
Sep 18 20:01:53.993770 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.993715    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "346b626a-3590-441b-bdfd-77ce92b3de45" (UID: "346b626a-3590-441b-bdfd-77ce92b3de45"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:01:53.994053 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.993801    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-istio-data" (OuterVolumeSpecName: "istio-data") pod "346b626a-3590-441b-bdfd-77ce92b3de45" (UID: "346b626a-3590-441b-bdfd-77ce92b3de45"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:01:53.994149 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.994127    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/346b626a-3590-441b-bdfd-77ce92b3de45-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "346b626a-3590-441b-bdfd-77ce92b3de45" (UID: "346b626a-3590-441b-bdfd-77ce92b3de45"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:01:53.994464 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.994220    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "346b626a-3590-441b-bdfd-77ce92b3de45" (UID: "346b626a-3590-441b-bdfd-77ce92b3de45"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:01:53.994464 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.994233    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "346b626a-3590-441b-bdfd-77ce92b3de45" (UID: "346b626a-3590-441b-bdfd-77ce92b3de45"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:01:53.994464 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.994386    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-workload-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:01:53.994464 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.994404    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-credential-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:01:53.994464 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.994417    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/346b626a-3590-441b-bdfd-77ce92b3de45-istiod-ca-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:01:53.994464 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.994430    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-workload-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:01:53.994464 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.994443    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-istio-data\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:01:53.996121 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.996092    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/346b626a-3590-441b-bdfd-77ce92b3de45-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "346b626a-3590-441b-bdfd-77ce92b3de45" (UID: "346b626a-3590-441b-bdfd-77ce92b3de45"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:01:53.996374 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.996347    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/346b626a-3590-441b-bdfd-77ce92b3de45-istio-token" (OuterVolumeSpecName: "istio-token") pod "346b626a-3590-441b-bdfd-77ce92b3de45" (UID: "346b626a-3590-441b-bdfd-77ce92b3de45"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:01:53.996494 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.996419    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/346b626a-3590-441b-bdfd-77ce92b3de45-kube-api-access-5m9bl" (OuterVolumeSpecName: "kube-api-access-5m9bl") pod "346b626a-3590-441b-bdfd-77ce92b3de45" (UID: "346b626a-3590-441b-bdfd-77ce92b3de45"). InnerVolumeSpecName "kube-api-access-5m9bl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:01:53.996545 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:53.996484    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "346b626a-3590-441b-bdfd-77ce92b3de45" (UID: "346b626a-3590-441b-bdfd-77ce92b3de45"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:01:54.058117 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.058024    2583 generic.go:356] "Generic (PLEG): container finished" podID="346b626a-3590-441b-bdfd-77ce92b3de45" containerID="068492a50b32e249aec3afeb8abd962c08d95537151b76ae2f607659137763ca" exitCode=0
Sep 18 20:01:54.058117 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.058088    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"
Sep 18 20:01:54.058280 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.058085    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" event={"ID":"346b626a-3590-441b-bdfd-77ce92b3de45","Type":"ContainerDied","Data":"068492a50b32e249aec3afeb8abd962c08d95537151b76ae2f607659137763ca"}
Sep 18 20:01:54.058280 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.058218    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck" event={"ID":"346b626a-3590-441b-bdfd-77ce92b3de45","Type":"ContainerDied","Data":"622ce673c453ef7e93e1c58f4ee03add3ba7ecacf6311695741ad4d87832b5ad"}
Sep 18 20:01:54.058280 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.058251    2583 scope.go:117] "RemoveContainer" containerID="068492a50b32e249aec3afeb8abd962c08d95537151b76ae2f607659137763ca"
Sep 18 20:01:54.068514 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.068498    2583 scope.go:117] "RemoveContainer" containerID="b6a3fdb547289613856cd06e76334f2c517e0edc95d8797d8190a947673b919e"
Sep 18 20:01:54.077500 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.077383    2583 scope.go:117] "RemoveContainer" containerID="068492a50b32e249aec3afeb8abd962c08d95537151b76ae2f607659137763ca"
Sep 18 20:01:54.078127 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:01:54.077777    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"068492a50b32e249aec3afeb8abd962c08d95537151b76ae2f607659137763ca\": container with ID starting with 068492a50b32e249aec3afeb8abd962c08d95537151b76ae2f607659137763ca not found: ID does not exist" containerID="068492a50b32e249aec3afeb8abd962c08d95537151b76ae2f607659137763ca"
Sep 18 20:01:54.078127 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.077821    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068492a50b32e249aec3afeb8abd962c08d95537151b76ae2f607659137763ca"} err="failed to get container status \"068492a50b32e249aec3afeb8abd962c08d95537151b76ae2f607659137763ca\": rpc error: code = NotFound desc = could not find container \"068492a50b32e249aec3afeb8abd962c08d95537151b76ae2f607659137763ca\": container with ID starting with 068492a50b32e249aec3afeb8abd962c08d95537151b76ae2f607659137763ca not found: ID does not exist"
Sep 18 20:01:54.078127 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.077852    2583 scope.go:117] "RemoveContainer" containerID="b6a3fdb547289613856cd06e76334f2c517e0edc95d8797d8190a947673b919e"
Sep 18 20:01:54.078375 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:01:54.078249    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6a3fdb547289613856cd06e76334f2c517e0edc95d8797d8190a947673b919e\": container with ID starting with b6a3fdb547289613856cd06e76334f2c517e0edc95d8797d8190a947673b919e not found: ID does not exist" containerID="b6a3fdb547289613856cd06e76334f2c517e0edc95d8797d8190a947673b919e"
Sep 18 20:01:54.078375 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.078280    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6a3fdb547289613856cd06e76334f2c517e0edc95d8797d8190a947673b919e"} err="failed to get container status \"b6a3fdb547289613856cd06e76334f2c517e0edc95d8797d8190a947673b919e\": rpc error: code = NotFound desc = could not find container \"b6a3fdb547289613856cd06e76334f2c517e0edc95d8797d8190a947673b919e\": container with ID starting with b6a3fdb547289613856cd06e76334f2c517e0edc95d8797d8190a947673b919e not found: ID does not exist"
Sep 18 20:01:54.081028 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.081010    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"]
Sep 18 20:01:54.085061 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.085028    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d6291d-openshift-default-7486cb767d-6bxck"]
Sep 18 20:01:54.095665 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.095649    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/346b626a-3590-441b-bdfd-77ce92b3de45-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:01:54.095665 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.095666    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/346b626a-3590-441b-bdfd-77ce92b3de45-istio-envoy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:01:54.095818 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.095676    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m9bl\" (UniqueName: \"kubernetes.io/projected/346b626a-3590-441b-bdfd-77ce92b3de45-kube-api-access-5m9bl\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:01:54.095818 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.095684    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/346b626a-3590-441b-bdfd-77ce92b3de45-istio-podinfo\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:01:54.242326 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:54.242296    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:55.018498 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:55.018461    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:55.811669 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:55.811625    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" path="/var/lib/kubelet/pods/346b626a-3590-441b-bdfd-77ce92b3de45/volumes"
Sep 18 20:01:59.502419 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:59.502388    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:59.532773 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:59.532746    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"]
Sep 18 20:01:59.533014 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:59.532993    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s" podUID="67bccc9d-681e-4966-ae5a-429c4c323b11" containerName="payload-processing" containerID="cri-o://b48627c88676e2c058c1ee7691e5e2789841175f331ccf60c33e1684390ca430" gracePeriod=30
Sep 18 20:01:59.589312 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:59.589279    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:59.691450 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:59.691421    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:59.764109 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:59.763979    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:01:59.789843 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:59.789817    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"
Sep 18 20:01:59.854768 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:59.854744    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67bccc9d-681e-4966-ae5a-429c4c323b11-plugins-config-volume\") pod \"67bccc9d-681e-4966-ae5a-429c4c323b11\" (UID: \"67bccc9d-681e-4966-ae5a-429c4c323b11\") "
Sep 18 20:01:59.854930 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:59.854799    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwgvb\" (UniqueName: \"kubernetes.io/projected/67bccc9d-681e-4966-ae5a-429c4c323b11-kube-api-access-xwgvb\") pod \"67bccc9d-681e-4966-ae5a-429c4c323b11\" (UID: \"67bccc9d-681e-4966-ae5a-429c4c323b11\") "
Sep 18 20:01:59.855201 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:59.855175    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67bccc9d-681e-4966-ae5a-429c4c323b11-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "67bccc9d-681e-4966-ae5a-429c4c323b11" (UID: "67bccc9d-681e-4966-ae5a-429c4c323b11"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:01:59.856838 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:59.856815    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67bccc9d-681e-4966-ae5a-429c4c323b11-kube-api-access-xwgvb" (OuterVolumeSpecName: "kube-api-access-xwgvb") pod "67bccc9d-681e-4966-ae5a-429c4c323b11" (UID: "67bccc9d-681e-4966-ae5a-429c4c323b11"). InnerVolumeSpecName "kube-api-access-xwgvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:01:59.959073 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:59.958994    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwgvb\" (UniqueName: \"kubernetes.io/projected/67bccc9d-681e-4966-ae5a-429c4c323b11-kube-api-access-xwgvb\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:01:59.959073 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:01:59.959028    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67bccc9d-681e-4966-ae5a-429c4c323b11-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:00.091967 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.091929    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:00.098018 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.097977    2583 generic.go:356] "Generic (PLEG): container finished" podID="67bccc9d-681e-4966-ae5a-429c4c323b11" containerID="b48627c88676e2c058c1ee7691e5e2789841175f331ccf60c33e1684390ca430" exitCode=0
Sep 18 20:02:00.098018 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.098017    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"
Sep 18 20:02:00.098259 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.098069    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s" event={"ID":"67bccc9d-681e-4966-ae5a-429c4c323b11","Type":"ContainerDied","Data":"b48627c88676e2c058c1ee7691e5e2789841175f331ccf60c33e1684390ca430"}
Sep 18 20:02:00.098259 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.098133    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s" event={"ID":"67bccc9d-681e-4966-ae5a-429c4c323b11","Type":"ContainerDied","Data":"9c720055f41359db7320bb83eca89075eb70fb9d132de23860e4b7a57b9491f7"}
Sep 18 20:02:00.098259 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.098159    2583 scope.go:117] "RemoveContainer" containerID="b48627c88676e2c058c1ee7691e5e2789841175f331ccf60c33e1684390ca430"
Sep 18 20:02:00.109188 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.109151    2583 scope.go:117] "RemoveContainer" containerID="b48627c88676e2c058c1ee7691e5e2789841175f331ccf60c33e1684390ca430"
Sep 18 20:02:00.109422 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:02:00.109398    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b48627c88676e2c058c1ee7691e5e2789841175f331ccf60c33e1684390ca430\": container with ID starting with b48627c88676e2c058c1ee7691e5e2789841175f331ccf60c33e1684390ca430 not found: ID does not exist" containerID="b48627c88676e2c058c1ee7691e5e2789841175f331ccf60c33e1684390ca430"
Sep 18 20:02:00.109484 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.109430    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b48627c88676e2c058c1ee7691e5e2789841175f331ccf60c33e1684390ca430"} err="failed to get container status \"b48627c88676e2c058c1ee7691e5e2789841175f331ccf60c33e1684390ca430\": rpc error: code = NotFound desc = could not find container \"b48627c88676e2c058c1ee7691e5e2789841175f331ccf60c33e1684390ca430\": container with ID starting with b48627c88676e2c058c1ee7691e5e2789841175f331ccf60c33e1684390ca430 not found: ID does not exist"
Sep 18 20:02:00.123394 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.123374    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"]
Sep 18 20:02:00.128899 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.128878    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d5f7da-5667fcc597-xxt4s"]
Sep 18 20:02:00.157301 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.157278    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"]
Sep 18 20:02:00.157827 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.157807    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67bccc9d-681e-4966-ae5a-429c4c323b11" containerName="payload-processing"
Sep 18 20:02:00.157827 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.157827    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="67bccc9d-681e-4966-ae5a-429c4c323b11" containerName="payload-processing"
Sep 18 20:02:00.157958 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.157853    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy"
Sep 18 20:02:00.157958 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.157859    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy"
Sep 18 20:02:00.157958 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.157951    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy"
Sep 18 20:02:00.158072 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.157966    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy"
Sep 18 20:02:00.158072 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.157977    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="67bccc9d-681e-4966-ae5a-429c4c323b11" containerName="payload-processing"
Sep 18 20:02:00.162586 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.162568    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.165065 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.165026    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-d94b9e\"/\"distinct-2-w0-d94b9e-kserve-self-signed-certs\""
Sep 18 20:02:00.173392 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.173372    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"]
Sep 18 20:02:00.261769 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.261738    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-tmp-dir\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.261936 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.261826    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-model-cache\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.261936 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.261865    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-dshm\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.261936 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.261900    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-home\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.261936 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.261925    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dec88288-e2a0-416d-b2c9-9dcde525e7a5-tls-certs\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.262128 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.261960    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcqkr\" (UniqueName: \"kubernetes.io/projected/dec88288-e2a0-416d-b2c9-9dcde525e7a5-kube-api-access-mcqkr\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.299492 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.299468    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:00.363648 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.363568    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-model-cache\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.363884 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.363864    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-dshm\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.364031 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.364014    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-home\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.364176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.364159    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dec88288-e2a0-416d-b2c9-9dcde525e7a5-tls-certs\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.364301 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.364287    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcqkr\" (UniqueName: \"kubernetes.io/projected/dec88288-e2a0-416d-b2c9-9dcde525e7a5-kube-api-access-mcqkr\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.364470 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.364453    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-tmp-dir\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.365002 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.364981    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-tmp-dir\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.365449 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.365423    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-model-cache\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.366004 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.365977    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-home\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.368882 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.368824    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dec88288-e2a0-416d-b2c9-9dcde525e7a5-tls-certs\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.369215 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.369197    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-dshm\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.375763 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.375740    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcqkr\" (UniqueName: \"kubernetes.io/projected/dec88288-e2a0-416d-b2c9-9dcde525e7a5-kube-api-access-mcqkr\") pod \"distinct-2-w0-d94b9e-kserve-959b4487-9p4db\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") " pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.472768 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.472741    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:00.569817 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.569776    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:00.754668 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:00.754640    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"]
Sep 18 20:02:00.755954 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:02:00.755927    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddec88288_e2a0_416d_b2c9_9dcde525e7a5.slice/crio-5b769b08ef2b927bcb865d2a6b37b95683ebd00cfa3d95efe739447bf980ac16 WatchSource:0}: Error finding container 5b769b08ef2b927bcb865d2a6b37b95683ebd00cfa3d95efe739447bf980ac16: Status 404 returned error can't find the container with id 5b769b08ef2b927bcb865d2a6b37b95683ebd00cfa3d95efe739447bf980ac16
Sep 18 20:02:01.005343 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:01.005260    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:01.107187 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:01.107151    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db" event={"ID":"dec88288-e2a0-416d-b2c9-9dcde525e7a5","Type":"ContainerStarted","Data":"6a4337fc7fa42588f89b574d1e105c4b8c0d5f217adaef92a5c3dd891f0ca3d7"}
Sep 18 20:02:01.107187 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:01.107195    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db" event={"ID":"dec88288-e2a0-416d-b2c9-9dcde525e7a5","Type":"ContainerStarted","Data":"5b769b08ef2b927bcb865d2a6b37b95683ebd00cfa3d95efe739447bf980ac16"}
Sep 18 20:02:01.128168 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:01.128121    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db" podStartSLOduration=1.128106715 podStartE2EDuration="1.128106715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:02:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:02:01.12608256 +0000 UTC m=+1363.453176327" watchObservedRunningTime="2026-09-18 20:02:01.128106715 +0000 UTC m=+1363.455200478"
Sep 18 20:02:01.805118 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:01.805033    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:01.811705 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:01.811679    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67bccc9d-681e-4966-ae5a-429c4c323b11" path="/var/lib/kubelet/pods/67bccc9d-681e-4966-ae5a-429c4c323b11/volumes"
Sep 18 20:02:02.134661 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:02.134629    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:02.494939 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:02.494846    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:03.141199 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:03.141171    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:03.906096 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:03.906066    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:04.671165 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:04.671136    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:05.168360 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:05.168329    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:10.472993 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:10.472954    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:10.473476 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:10.473007    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:10.485915 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:10.485891    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:11.182611 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:11.182579    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:02:13.670906 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:13.670874    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:13.758890 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:13.758860    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"]
Sep 18 20:02:13.759175 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:13.759152    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z" podUID="2c731c6a-610a-47c8-a1ee-3bdc62495f93" containerName="istio-proxy" containerID="cri-o://e0bd5b47e5df08e04b10f782810e47c0907c7d139ba6c1750f4b81f150510513" gracePeriod=30
Sep 18 20:02:13.782008 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:13.781964    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:14.010052 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:14.009942    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:14.131819 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:14.131790    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:15.142347 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:15.142302    2583 patch_prober.go:28] interesting pod/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 20:02:15.142835 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:15.142389    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z" podUID="2c731c6a-610a-47c8-a1ee-3bdc62495f93" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:02:19.013840 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.013806    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 20:02:19.159261 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.159225    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-podinfo\") pod \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") "
Sep 18 20:02:19.159446 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.159322    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istiod-ca-cert\") pod \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") "
Sep 18 20:02:19.159446 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.159350    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-workload-socket\") pod \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") "
Sep 18 20:02:19.159446 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.159394    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-token\") pod \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") "
Sep 18 20:02:19.159623 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.159442    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6gnf\" (UniqueName: \"kubernetes.io/projected/2c731c6a-610a-47c8-a1ee-3bdc62495f93-kube-api-access-m6gnf\") pod \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") "
Sep 18 20:02:19.159623 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.159498    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-data\") pod \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") "
Sep 18 20:02:19.159623 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.159533    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-workload-certs\") pod \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") "
Sep 18 20:02:19.159623 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.159567    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-credential-socket\") pod \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") "
Sep 18 20:02:19.159623 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.159602    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-envoy\") pod \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\" (UID: \"2c731c6a-610a-47c8-a1ee-3bdc62495f93\") "
Sep 18 20:02:19.159902 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.159626    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c731c6a-610a-47c8-a1ee-3bdc62495f93" (UID: "2c731c6a-610a-47c8-a1ee-3bdc62495f93"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:02:19.159902 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.159798    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c731c6a-610a-47c8-a1ee-3bdc62495f93" (UID: "2c731c6a-610a-47c8-a1ee-3bdc62495f93"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:02:19.159902 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.159848    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c731c6a-610a-47c8-a1ee-3bdc62495f93" (UID: "2c731c6a-610a-47c8-a1ee-3bdc62495f93"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:02:19.160076 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.159918    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c731c6a-610a-47c8-a1ee-3bdc62495f93" (UID: "2c731c6a-610a-47c8-a1ee-3bdc62495f93"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:02:19.160076 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.160026    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-workload-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:19.160076 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.160073    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-credential-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:19.160217 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.160088    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istiod-ca-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:19.160217 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.160101    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-workload-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:19.160217 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.160113    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c731c6a-610a-47c8-a1ee-3bdc62495f93" (UID: "2c731c6a-610a-47c8-a1ee-3bdc62495f93"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:02:19.161558 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.161527    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c731c6a-610a-47c8-a1ee-3bdc62495f93" (UID: "2c731c6a-610a-47c8-a1ee-3bdc62495f93"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:02:19.161772 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.161750    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c731c6a-610a-47c8-a1ee-3bdc62495f93" (UID: "2c731c6a-610a-47c8-a1ee-3bdc62495f93"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:02:19.162088 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.162055    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c731c6a-610a-47c8-a1ee-3bdc62495f93-kube-api-access-m6gnf" (OuterVolumeSpecName: "kube-api-access-m6gnf") pod "2c731c6a-610a-47c8-a1ee-3bdc62495f93" (UID: "2c731c6a-610a-47c8-a1ee-3bdc62495f93"). InnerVolumeSpecName "kube-api-access-m6gnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:02:19.162212 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.162092    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c731c6a-610a-47c8-a1ee-3bdc62495f93" (UID: "2c731c6a-610a-47c8-a1ee-3bdc62495f93"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:02:19.162461 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.162444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:19.223371 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.223339    2583 generic.go:356] "Generic (PLEG): container finished" podID="2c731c6a-610a-47c8-a1ee-3bdc62495f93" containerID="e0bd5b47e5df08e04b10f782810e47c0907c7d139ba6c1750f4b81f150510513" exitCode=0
Sep 18 20:02:19.223496 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.223380    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"
Sep 18 20:02:19.223496 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.223423    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z" event={"ID":"2c731c6a-610a-47c8-a1ee-3bdc62495f93","Type":"ContainerDied","Data":"e0bd5b47e5df08e04b10f782810e47c0907c7d139ba6c1750f4b81f150510513"}
Sep 18 20:02:19.223496 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.223478    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z" event={"ID":"2c731c6a-610a-47c8-a1ee-3bdc62495f93","Type":"ContainerDied","Data":"6b9b48746f96622d1bb2c67e483529a866da5f3cc4ee2bba745fc4b2195658a6"}
Sep 18 20:02:19.223620 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.223505    2583 scope.go:117] "RemoveContainer" containerID="e0bd5b47e5df08e04b10f782810e47c0907c7d139ba6c1750f4b81f150510513"
Sep 18 20:02:19.233434 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.233417    2583 scope.go:117] "RemoveContainer" containerID="e0bd5b47e5df08e04b10f782810e47c0907c7d139ba6c1750f4b81f150510513"
Sep 18 20:02:19.233703 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:02:19.233681    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0bd5b47e5df08e04b10f782810e47c0907c7d139ba6c1750f4b81f150510513\": container with ID starting with e0bd5b47e5df08e04b10f782810e47c0907c7d139ba6c1750f4b81f150510513 not found: ID does not exist" containerID="e0bd5b47e5df08e04b10f782810e47c0907c7d139ba6c1750f4b81f150510513"
Sep 18 20:02:19.233776 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.233714    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0bd5b47e5df08e04b10f782810e47c0907c7d139ba6c1750f4b81f150510513"} err="failed to get container status \"e0bd5b47e5df08e04b10f782810e47c0907c7d139ba6c1750f4b81f150510513\": rpc error: code = NotFound desc = could not find container \"e0bd5b47e5df08e04b10f782810e47c0907c7d139ba6c1750f4b81f150510513\": container with ID starting with e0bd5b47e5df08e04b10f782810e47c0907c7d139ba6c1750f4b81f150510513 not found: ID does not exist"
Sep 18 20:02:19.246085 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.246061    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"]
Sep 18 20:02:19.250095 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.250072    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-03d45c-openshift-default-cc8f54458-g8r5z"]
Sep 18 20:02:19.260673 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.260656    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-envoy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:19.260673 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.260674    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-podinfo\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:19.260784 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.260682    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:19.260784 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.260691    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6gnf\" (UniqueName: \"kubernetes.io/projected/2c731c6a-610a-47c8-a1ee-3bdc62495f93-kube-api-access-m6gnf\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:19.260784 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.260701    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c731c6a-610a-47c8-a1ee-3bdc62495f93-istio-data\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:19.812564 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:19.812532    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c731c6a-610a-47c8-a1ee-3bdc62495f93" path="/var/lib/kubelet/pods/2c731c6a-610a-47c8-a1ee-3bdc62495f93/volumes"
Sep 18 20:02:20.600896 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:20.600865    2583 scope.go:117] "RemoveContainer" containerID="cf15b27e99f964e0336e4b8bb6b8543ec3ffecf056909b3d3ae2ed49c380c056"
Sep 18 20:02:26.345007 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:26.344934    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:36.099422 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:36.099392    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:42.529998 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:42.529966    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:42.764869 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:42.764839    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"]
Sep 18 20:02:42.765095 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:42.765069    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v" podUID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" containerName="istio-proxy" containerID="cri-o://de7c364fa335be3e4ef44226333e214d75dcdca6522f898ea552e40b27c71212" gracePeriod=30
Sep 18 20:02:42.790190 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:42.790117    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:43.396442 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:43.396399    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:43.709192 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:43.709113    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:43.993512 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:43.993419    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:46.596920 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:46.596891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:47.264102 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:47.264068    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:47.372131 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:47.372107    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:47.546340 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:47.546246    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:48.014107 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.014082    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 20:02:48.131334 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.131293    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-envoy\") pod \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") "
Sep 18 20:02:48.131334 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.131339    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-workload-socket\") pod \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") "
Sep 18 20:02:48.131574 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.131372    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-workload-certs\") pod \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") "
Sep 18 20:02:48.131574 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.131399    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-podinfo\") pod \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") "
Sep 18 20:02:48.131574 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.131420    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-credential-socket\") pod \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") "
Sep 18 20:02:48.131574 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.131450    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwvnh\" (UniqueName: \"kubernetes.io/projected/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-kube-api-access-mwvnh\") pod \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") "
Sep 18 20:02:48.131574 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.131472    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-token\") pod \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") "
Sep 18 20:02:48.131574 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.131502    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-data\") pod \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") "
Sep 18 20:02:48.131574 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.131554    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istiod-ca-cert\") pod \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\" (UID: \"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5\") "
Sep 18 20:02:48.131948 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.131723    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" (UID: "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:02:48.131948 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.131741    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" (UID: "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:02:48.132112 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.131949    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-workload-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:48.132112 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.131956    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" (UID: "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:02:48.132112 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.131969    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-credential-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:48.132112 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.132008    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" (UID: "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:02:48.132112 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.132060    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" (UID: "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:02:48.133863 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.133791    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" (UID: "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:02:48.133863 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.133806    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-kube-api-access-mwvnh" (OuterVolumeSpecName: "kube-api-access-mwvnh") pod "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" (UID: "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5"). InnerVolumeSpecName "kube-api-access-mwvnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:02:48.134001 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.133972    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" (UID: "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:02:48.134001 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.133975    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" (UID: "6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:02:48.232531 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.232500    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-podinfo\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:48.232531 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.232531    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwvnh\" (UniqueName: \"kubernetes.io/projected/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-kube-api-access-mwvnh\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:48.232531 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.232541    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:48.232723 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.232551    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-data\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:48.232723 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.232558    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istiod-ca-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:48.232723 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.232565    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-istio-envoy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:48.232723 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.232573    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5-workload-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:02:48.325019 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.324990    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:48.412343 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.412256    2583 generic.go:356] "Generic (PLEG): container finished" podID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" containerID="de7c364fa335be3e4ef44226333e214d75dcdca6522f898ea552e40b27c71212" exitCode=0
Sep 18 20:02:48.412343 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.412301    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"
Sep 18 20:02:48.412630 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.412338    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v" event={"ID":"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5","Type":"ContainerDied","Data":"de7c364fa335be3e4ef44226333e214d75dcdca6522f898ea552e40b27c71212"}
Sep 18 20:02:48.412630 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.412393    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v" event={"ID":"6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5","Type":"ContainerDied","Data":"28e4a4639670da4552c85cec39f7ef173a6703744fbcb81b146867ceb5866473"}
Sep 18 20:02:48.412630 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.412423    2583 scope.go:117] "RemoveContainer" containerID="de7c364fa335be3e4ef44226333e214d75dcdca6522f898ea552e40b27c71212"
Sep 18 20:02:48.423214 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.423192    2583 scope.go:117] "RemoveContainer" containerID="1215094e59078896ef7e9435e9d4c45f9220b0cddd45553b6df0481666b9adbb"
Sep 18 20:02:48.434920 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.434894    2583 scope.go:117] "RemoveContainer" containerID="de7c364fa335be3e4ef44226333e214d75dcdca6522f898ea552e40b27c71212"
Sep 18 20:02:48.435926 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:02:48.435853    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de7c364fa335be3e4ef44226333e214d75dcdca6522f898ea552e40b27c71212\": container with ID starting with de7c364fa335be3e4ef44226333e214d75dcdca6522f898ea552e40b27c71212 not found: ID does not exist" containerID="de7c364fa335be3e4ef44226333e214d75dcdca6522f898ea552e40b27c71212"
Sep 18 20:02:48.435926 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.435891    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de7c364fa335be3e4ef44226333e214d75dcdca6522f898ea552e40b27c71212"} err="failed to get container status \"de7c364fa335be3e4ef44226333e214d75dcdca6522f898ea552e40b27c71212\": rpc error: code = NotFound desc = could not find container \"de7c364fa335be3e4ef44226333e214d75dcdca6522f898ea552e40b27c71212\": container with ID starting with de7c364fa335be3e4ef44226333e214d75dcdca6522f898ea552e40b27c71212 not found: ID does not exist"
Sep 18 20:02:48.435926 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.435915    2583 scope.go:117] "RemoveContainer" containerID="1215094e59078896ef7e9435e9d4c45f9220b0cddd45553b6df0481666b9adbb"
Sep 18 20:02:48.436236 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:02:48.436216    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1215094e59078896ef7e9435e9d4c45f9220b0cddd45553b6df0481666b9adbb\": container with ID starting with 1215094e59078896ef7e9435e9d4c45f9220b0cddd45553b6df0481666b9adbb not found: ID does not exist" containerID="1215094e59078896ef7e9435e9d4c45f9220b0cddd45553b6df0481666b9adbb"
Sep 18 20:02:48.436301 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.436242    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1215094e59078896ef7e9435e9d4c45f9220b0cddd45553b6df0481666b9adbb"} err="failed to get container status \"1215094e59078896ef7e9435e9d4c45f9220b0cddd45553b6df0481666b9adbb\": rpc error: code = NotFound desc = could not find container \"1215094e59078896ef7e9435e9d4c45f9220b0cddd45553b6df0481666b9adbb\": container with ID starting with 1215094e59078896ef7e9435e9d4c45f9220b0cddd45553b6df0481666b9adbb not found: ID does not exist"
Sep 18 20:02:48.440022 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.440000    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"]
Sep 18 20:02:48.442750 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.442733    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-d5f7da-openshift-default-585dfd4b46-dsm2v"]
Sep 18 20:02:48.730292 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:48.730211    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:49.207928 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:49.207902    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:49.813560 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:49.813523    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" path="/var/lib/kubelet/pods/6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5/volumes"
Sep 18 20:02:49.984607 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:49.984579    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:50.879182 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:50.879149    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:51.733501 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:51.733473    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:51.799130 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:51.799079    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:52.034263 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.034167    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:52.229373 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.229339    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:52.313365 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.313286    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:52.317466 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.317442    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"]
Sep 18 20:02:52.317863 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.317849    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" containerName="istio-proxy"
Sep 18 20:02:52.317907 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.317864    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" containerName="istio-proxy"
Sep 18 20:02:52.317907 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.317884    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy"
Sep 18 20:02:52.317907 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.317890    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="346b626a-3590-441b-bdfd-77ce92b3de45" containerName="istio-proxy"
Sep 18 20:02:52.317907 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.317896    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c731c6a-610a-47c8-a1ee-3bdc62495f93" containerName="istio-proxy"
Sep 18 20:02:52.317907 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.317901    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c731c6a-610a-47c8-a1ee-3bdc62495f93" containerName="istio-proxy"
Sep 18 20:02:52.318079 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.317909    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" containerName="istio-proxy"
Sep 18 20:02:52.318079 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.317915    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" containerName="istio-proxy"
Sep 18 20:02:52.318079 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.317980    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" containerName="istio-proxy"
Sep 18 20:02:52.318079 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.317987    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c731c6a-610a-47c8-a1ee-3bdc62495f93" containerName="istio-proxy"
Sep 18 20:02:52.318079 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.317998    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fc34eb7-5aff-4cac-9d32-2e4a3aa608f5" containerName="istio-proxy"
Sep 18 20:02:52.322450 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.322434    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"
Sep 18 20:02:52.325154 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.325129    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-57b6ce\""
Sep 18 20:02:52.332530 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.332510    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"]
Sep 18 20:02:52.471710 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.471676    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df1c163-0eb1-4a05-95cd-c479b61a7ab9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm\" (UID: \"6df1c163-0eb1-4a05-95cd-c479b61a7ab9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"
Sep 18 20:02:52.471874 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.471743    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgnhj\" (UniqueName: \"kubernetes.io/projected/6df1c163-0eb1-4a05-95cd-c479b61a7ab9-kube-api-access-cgnhj\") pod \"payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm\" (UID: \"6df1c163-0eb1-4a05-95cd-c479b61a7ab9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"
Sep 18 20:02:52.573158 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.573077    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df1c163-0eb1-4a05-95cd-c479b61a7ab9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm\" (UID: \"6df1c163-0eb1-4a05-95cd-c479b61a7ab9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"
Sep 18 20:02:52.573158 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.573137    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgnhj\" (UniqueName: \"kubernetes.io/projected/6df1c163-0eb1-4a05-95cd-c479b61a7ab9-kube-api-access-cgnhj\") pod \"payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm\" (UID: \"6df1c163-0eb1-4a05-95cd-c479b61a7ab9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"
Sep 18 20:02:52.573776 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.573756    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df1c163-0eb1-4a05-95cd-c479b61a7ab9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm\" (UID: \"6df1c163-0eb1-4a05-95cd-c479b61a7ab9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"
Sep 18 20:02:52.581855 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.581836    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgnhj\" (UniqueName: \"kubernetes.io/projected/6df1c163-0eb1-4a05-95cd-c479b61a7ab9-kube-api-access-cgnhj\") pod \"payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm\" (UID: \"6df1c163-0eb1-4a05-95cd-c479b61a7ab9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"
Sep 18 20:02:52.634160 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.634128    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"
Sep 18 20:02:52.909007 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:52.908980    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"]
Sep 18 20:02:52.910147 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:02:52.910119    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df1c163_0eb1_4a05_95cd_c479b61a7ab9.slice/crio-03241b5768e92b373289a4233703cfca41b73e6ae84f768725e279165253403b WatchSource:0}: Error finding container 03241b5768e92b373289a4233703cfca41b73e6ae84f768725e279165253403b: Status 404 returned error can't find the container with id 03241b5768e92b373289a4233703cfca41b73e6ae84f768725e279165253403b
Sep 18 20:02:53.452491 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:53.452452    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm" event={"ID":"6df1c163-0eb1-4a05-95cd-c479b61a7ab9","Type":"ContainerStarted","Data":"56ee27a33915676aaeb32d50e231a95109eb07c410d783ed989ba9487e32c612"}
Sep 18 20:02:53.452849 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:53.452518    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm" event={"ID":"6df1c163-0eb1-4a05-95cd-c479b61a7ab9","Type":"ContainerStarted","Data":"03241b5768e92b373289a4233703cfca41b73e6ae84f768725e279165253403b"}
Sep 18 20:02:53.452849 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:53.452547    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"
Sep 18 20:02:53.489260 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:53.489214    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm" podStartSLOduration=1.489199421 podStartE2EDuration="1.489199421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:02:53.485614704 +0000 UTC m=+1415.812708467" watchObservedRunningTime="2026-09-18 20:02:53.489199421 +0000 UTC m=+1415.816293186"
Sep 18 20:02:53.905340 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:53.905310    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:02:56.304712 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:02:56.304676    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:04.460996 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:04.460921    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"
Sep 18 20:03:14.126206 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:14.126169    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:15.052780 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:15.052747    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:16.135177 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:16.135147    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:16.897722 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:16.897695    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:17.360998 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.360967    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:17.402350 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.402317    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg"]
Sep 18 20:03:17.406108 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.406088    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg"
Sep 18 20:03:17.408876 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.408855    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 20:03:17.409069 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.409051    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 20:03:17.416480 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.416456    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg"]
Sep 18 20:03:17.513795 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.513762    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c62f8b76-27f4-4b07-8d5e-5ab8f1d53764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg\" (UID: \"c62f8b76-27f4-4b07-8d5e-5ab8f1d53764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg"
Sep 18 20:03:17.615083 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.614984    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c62f8b76-27f4-4b07-8d5e-5ab8f1d53764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg\" (UID: \"c62f8b76-27f4-4b07-8d5e-5ab8f1d53764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg"
Sep 18 20:03:17.615600 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.615580    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c62f8b76-27f4-4b07-8d5e-5ab8f1d53764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg\" (UID: \"c62f8b76-27f4-4b07-8d5e-5ab8f1d53764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg"
Sep 18 20:03:17.674491 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.674463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:17.718618 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.718593    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg"
Sep 18 20:03:17.920062 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.919955    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:17.968401 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.968370    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"]
Sep 18 20:03:17.972400 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.972354    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:17.975433 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.975411    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-5547b6-openshift-default-dockercfg-dd684\""
Sep 18 20:03:17.984794 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:17.984772    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"]
Sep 18 20:03:18.001380 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:03:18.001343    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62f8b76_27f4_4b07_8d5e_5ab8f1d53764.slice/crio-3877e3b8057fb2ea18f170668cd111be9bc516b1af2740e11a53e6b0353630e6 WatchSource:0}: Error finding container 3877e3b8057fb2ea18f170668cd111be9bc516b1af2740e11a53e6b0353630e6: Status 404 returned error can't find the container with id 3877e3b8057fb2ea18f170668cd111be9bc516b1af2740e11a53e6b0353630e6
Sep 18 20:03:18.001571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.001556    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg"]
Sep 18 20:03:18.007208 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.007188    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:18.018857 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.018837    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-istio-data\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.018943 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.018878    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-credential-socket\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.018943 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.018912    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-workload-certs\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.019075 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.018955    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-workload-socket\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.019075 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.018993    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxrcc\" (UniqueName: \"kubernetes.io/projected/0015137d-3932-4690-80cc-f4517c7b4686-kube-api-access-xxrcc\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.019075 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.019064    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0015137d-3932-4690-80cc-f4517c7b4686-istio-podinfo\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.019218 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.019093    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-istio-envoy\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.019218 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.019133    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0015137d-3932-4690-80cc-f4517c7b4686-istiod-ca-cert\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.019291 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.019225    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0015137d-3932-4690-80cc-f4517c7b4686-istio-token\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.120102 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.120034    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0015137d-3932-4690-80cc-f4517c7b4686-istio-podinfo\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.120267 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.120111    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-istio-envoy\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.120267 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.120143    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0015137d-3932-4690-80cc-f4517c7b4686-istiod-ca-cert\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.120349 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.120286    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0015137d-3932-4690-80cc-f4517c7b4686-istio-token\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.120416 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.120401    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-istio-data\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.120463 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.120444    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-credential-socket\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.120517 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.120476    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-workload-certs\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.120517 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.120509    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-workload-socket\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.120644 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.120539    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxrcc\" (UniqueName: \"kubernetes.io/projected/0015137d-3932-4690-80cc-f4517c7b4686-kube-api-access-xxrcc\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.120739 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.120708    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-istio-data\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.120888 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.120863    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-credential-socket\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.120984 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.120910    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0015137d-3932-4690-80cc-f4517c7b4686-istiod-ca-cert\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.120984 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.120916    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-workload-certs\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.121085 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.120981    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-workload-socket\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.122419 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.122398    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-istio-envoy\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.122640 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.122621    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0015137d-3932-4690-80cc-f4517c7b4686-istio-podinfo\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.128179 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.128156    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0015137d-3932-4690-80cc-f4517c7b4686-istio-token\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.128700 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.128684    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxrcc\" (UniqueName: \"kubernetes.io/projected/0015137d-3932-4690-80cc-f4517c7b4686-kube-api-access-xxrcc\") pod \"e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") " pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.285417 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.285381    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:18.321793 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.321761    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:18.566535 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.566511    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"]
Sep 18 20:03:18.567017 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:03:18.566990    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0015137d_3932_4690_80cc_f4517c7b4686.slice/crio-a78506357196a93797767b88e756bddec1f71a7045b55d442c64278b55085e80 WatchSource:0}: Error finding container a78506357196a93797767b88e756bddec1f71a7045b55d442c64278b55085e80: Status 404 returned error can't find the container with id a78506357196a93797767b88e756bddec1f71a7045b55d442c64278b55085e80
Sep 18 20:03:18.569411 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.569378    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:03:18.569468 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.569443    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:03:18.569511 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.569472    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:03:18.618716 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.618689    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg" event={"ID":"c62f8b76-27f4-4b07-8d5e-5ab8f1d53764","Type":"ContainerStarted","Data":"c779f26f9af1d5c5fc25f2aa2eb107e1c3c478db6f9d80c7fffe3a2ceb0c8d59"}
Sep 18 20:03:18.618828 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.618738    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg" event={"ID":"c62f8b76-27f4-4b07-8d5e-5ab8f1d53764","Type":"ContainerStarted","Data":"3877e3b8057fb2ea18f170668cd111be9bc516b1af2740e11a53e6b0353630e6"}
Sep 18 20:03:18.620421 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.620401    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl" event={"ID":"0015137d-3932-4690-80cc-f4517c7b4686","Type":"ContainerStarted","Data":"a78506357196a93797767b88e756bddec1f71a7045b55d442c64278b55085e80"}
Sep 18 20:03:18.637510 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.637469    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg" podStartSLOduration=1.637454765 podStartE2EDuration="1.637454765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:03:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:03:18.636310511 +0000 UTC m=+1440.963404277" watchObservedRunningTime="2026-09-18 20:03:18.637454765 +0000 UTC m=+1440.964548535"
Sep 18 20:03:18.888440 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:18.888400    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:19.589410 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:19.589379    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:19.629239 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:19.629206    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl" event={"ID":"0015137d-3932-4690-80cc-f4517c7b4686","Type":"ContainerStarted","Data":"d9fa48f5cbd59789b547a23c2ec021096d19df3026e76510aabaef5cdaa56a85"}
Sep 18 20:03:19.630889 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:19.630862    2583 generic.go:356] "Generic (PLEG): container finished" podID="c62f8b76-27f4-4b07-8d5e-5ab8f1d53764" containerID="c779f26f9af1d5c5fc25f2aa2eb107e1c3c478db6f9d80c7fffe3a2ceb0c8d59" exitCode=0
Sep 18 20:03:19.630999 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:19.630943    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg" event={"ID":"c62f8b76-27f4-4b07-8d5e-5ab8f1d53764","Type":"ContainerDied","Data":"c779f26f9af1d5c5fc25f2aa2eb107e1c3c478db6f9d80c7fffe3a2ceb0c8d59"}
Sep 18 20:03:19.652014 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:19.651964    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl" podStartSLOduration=2.651950044 podStartE2EDuration="2.651950044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:03:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:03:19.64845325 +0000 UTC m=+1441.975547017" watchObservedRunningTime="2026-09-18 20:03:19.651950044 +0000 UTC m=+1441.979043807"
Sep 18 20:03:20.286012 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:20.285983    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:20.291440 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:20.291416    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:20.297713 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:20.297690    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:20.638053 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:20.638017    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:20.638473 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:20.638245    2583 scope.go:117] "RemoveContainer" containerID="502bd14107620f0639fecb3de21673b2556ca787f2c0aefb8d11ff8a27500d9f"
Sep 18 20:03:20.639099 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:20.639081    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:20.648716 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:20.648693    2583 scope.go:117] "RemoveContainer" containerID="887681f99ef5de821084ce37d747955889f7c7c8c27593f895fc40ac7cc7f253"
Sep 18 20:03:20.658673 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:20.658655    2583 scope.go:117] "RemoveContainer" containerID="e39311f945f2a2761cb416fa11159a592ac259f87292e7a7810a26d7e7be0dab"
Sep 18 20:03:20.794744 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:20.794719    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg"
Sep 18 20:03:20.847739 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:20.847715    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c62f8b76-27f4-4b07-8d5e-5ab8f1d53764-maas-api-service-ca\") pod \"c62f8b76-27f4-4b07-8d5e-5ab8f1d53764\" (UID: \"c62f8b76-27f4-4b07-8d5e-5ab8f1d53764\") "
Sep 18 20:03:20.848025 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:20.848005    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c62f8b76-27f4-4b07-8d5e-5ab8f1d53764-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c62f8b76-27f4-4b07-8d5e-5ab8f1d53764" (UID: "c62f8b76-27f4-4b07-8d5e-5ab8f1d53764"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:03:20.949259 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:20.949192    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c62f8b76-27f4-4b07-8d5e-5ab8f1d53764-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:03:21.270678 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:21.270599    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:21.646800 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:21.646773    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg"
Sep 18 20:03:21.647199 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:21.646805    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg" event={"ID":"c62f8b76-27f4-4b07-8d5e-5ab8f1d53764","Type":"ContainerDied","Data":"3877e3b8057fb2ea18f170668cd111be9bc516b1af2740e11a53e6b0353630e6"}
Sep 18 20:03:21.647199 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:21.646850    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3877e3b8057fb2ea18f170668cd111be9bc516b1af2740e11a53e6b0353630e6"
Sep 18 20:03:21.710250 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:21.710222    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:21.811371 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:21.811345    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:22.302288 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:22.302256    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:23.106625 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:23.106592    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:24.138241 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.138216    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:24.237269 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.237232    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:24.638200 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.638169    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:24.742504 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.742473    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:24.780467 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.780437    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"]
Sep 18 20:03:24.780894 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.780882    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c62f8b76-27f4-4b07-8d5e-5ab8f1d53764" containerName="revoke-keys"
Sep 18 20:03:24.780936 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.780896    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="c62f8b76-27f4-4b07-8d5e-5ab8f1d53764" containerName="revoke-keys"
Sep 18 20:03:24.780972 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.780966    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="c62f8b76-27f4-4b07-8d5e-5ab8f1d53764" containerName="revoke-keys"
Sep 18 20:03:24.784314 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.784296    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"
Sep 18 20:03:24.788066 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.788021    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-5547b6-dockercfg-p2td5\""
Sep 18 20:03:24.788873 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.788857    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-5547b6\""
Sep 18 20:03:24.799762 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.799731    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"]
Sep 18 20:03:24.848429 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.848403    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:24.889866 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.889764    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjmsb\" (UniqueName: \"kubernetes.io/projected/6c9d1a43-23fb-461e-afde-49e00021ede6-kube-api-access-tjmsb\") pod \"payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn\" (UID: \"6c9d1a43-23fb-461e-afde-49e00021ede6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"
Sep 18 20:03:24.890231 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.890205    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c9d1a43-23fb-461e-afde-49e00021ede6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn\" (UID: \"6c9d1a43-23fb-461e-afde-49e00021ede6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"
Sep 18 20:03:24.991123 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.991076    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjmsb\" (UniqueName: \"kubernetes.io/projected/6c9d1a43-23fb-461e-afde-49e00021ede6-kube-api-access-tjmsb\") pod \"payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn\" (UID: \"6c9d1a43-23fb-461e-afde-49e00021ede6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"
Sep 18 20:03:24.991307 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.991164    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c9d1a43-23fb-461e-afde-49e00021ede6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn\" (UID: \"6c9d1a43-23fb-461e-afde-49e00021ede6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"
Sep 18 20:03:24.991885 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.991863    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c9d1a43-23fb-461e-afde-49e00021ede6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn\" (UID: \"6c9d1a43-23fb-461e-afde-49e00021ede6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"
Sep 18 20:03:24.999337 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:24.999311    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjmsb\" (UniqueName: \"kubernetes.io/projected/6c9d1a43-23fb-461e-afde-49e00021ede6-kube-api-access-tjmsb\") pod \"payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn\" (UID: \"6c9d1a43-23fb-461e-afde-49e00021ede6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"
Sep 18 20:03:25.094974 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:25.094950    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"
Sep 18 20:03:25.111532 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:25.111499    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:25.371393 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:25.371370    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"]
Sep 18 20:03:25.372729 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:03:25.372700    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c9d1a43_23fb_461e_afde_49e00021ede6.slice/crio-64f42090bfd72dc4bc932712430136dcc1fa0398c9e2a1fb9658ec02525860e7 WatchSource:0}: Error finding container 64f42090bfd72dc4bc932712430136dcc1fa0398c9e2a1fb9658ec02525860e7: Status 404 returned error can't find the container with id 64f42090bfd72dc4bc932712430136dcc1fa0398c9e2a1fb9658ec02525860e7
Sep 18 20:03:25.674974 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:25.674887    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn" event={"ID":"6c9d1a43-23fb-461e-afde-49e00021ede6","Type":"ContainerStarted","Data":"e4829ea5919675a6daf91b45917cefb0061a487b4501aca8a653905b0f53d5dc"}
Sep 18 20:03:25.674974 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:25.674943    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn" event={"ID":"6c9d1a43-23fb-461e-afde-49e00021ede6","Type":"ContainerStarted","Data":"64f42090bfd72dc4bc932712430136dcc1fa0398c9e2a1fb9658ec02525860e7"}
Sep 18 20:03:25.675201 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:25.675100    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"
Sep 18 20:03:25.692734 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:25.692688    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn" podStartSLOduration=1.692669883 podStartE2EDuration="1.692669883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:03:25.691495432 +0000 UTC m=+1448.018589195" watchObservedRunningTime="2026-09-18 20:03:25.692669883 +0000 UTC m=+1448.019763648"
Sep 18 20:03:25.950716 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:25.950640    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:26.805824 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:26.805797    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:27.677499 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:27.677459    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:28.373452 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:28.373425    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:29.299312 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:29.299279    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:35.030449 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.030410    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"]
Sep 18 20:03:35.030921 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.030685    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv" podUID="d0c5b6af-4214-4955-b57e-1cff0a548399" containerName="payload-processing" containerID="cri-o://53bfae4cbeb7067117924720be6e99e868da4dcd6f6a7d920e79a9b32f2376dd" gracePeriod=30
Sep 18 20:03:35.042421 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.042393    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"]
Sep 18 20:03:35.042646 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.042625    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6" podUID="22292678-1ea6-4840-930d-1f3f65606bbe" containerName="payload-pre-processing" containerID="cri-o://fcc8a3d0092c4f136fa2f749da2a1bcd55e791a5f6db9b09e012106c028029a7" gracePeriod=30
Sep 18 20:03:35.200527 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.200487    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg"]
Sep 18 20:03:35.203517 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.203360    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-166dc9bb-8nqkg"]
Sep 18 20:03:35.311068 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.310695    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"
Sep 18 20:03:35.353315 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.353290    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"
Sep 18 20:03:35.396588 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.396549    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9l8l\" (UniqueName: \"kubernetes.io/projected/d0c5b6af-4214-4955-b57e-1cff0a548399-kube-api-access-n9l8l\") pod \"d0c5b6af-4214-4955-b57e-1cff0a548399\" (UID: \"d0c5b6af-4214-4955-b57e-1cff0a548399\") "
Sep 18 20:03:35.396770 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.396597    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0c5b6af-4214-4955-b57e-1cff0a548399-plugins-config-volume\") pod \"d0c5b6af-4214-4955-b57e-1cff0a548399\" (UID: \"d0c5b6af-4214-4955-b57e-1cff0a548399\") "
Sep 18 20:03:35.397055 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.397014    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0c5b6af-4214-4955-b57e-1cff0a548399-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d0c5b6af-4214-4955-b57e-1cff0a548399" (UID: "d0c5b6af-4214-4955-b57e-1cff0a548399"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:03:35.398627 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.398603    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0c5b6af-4214-4955-b57e-1cff0a548399-kube-api-access-n9l8l" (OuterVolumeSpecName: "kube-api-access-n9l8l") pod "d0c5b6af-4214-4955-b57e-1cff0a548399" (UID: "d0c5b6af-4214-4955-b57e-1cff0a548399"). InnerVolumeSpecName "kube-api-access-n9l8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:03:35.497588 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.497559    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22292678-1ea6-4840-930d-1f3f65606bbe-plugins-config-volume\") pod \"22292678-1ea6-4840-930d-1f3f65606bbe\" (UID: \"22292678-1ea6-4840-930d-1f3f65606bbe\") "
Sep 18 20:03:35.497692 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.497631    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwwsx\" (UniqueName: \"kubernetes.io/projected/22292678-1ea6-4840-930d-1f3f65606bbe-kube-api-access-vwwsx\") pod \"22292678-1ea6-4840-930d-1f3f65606bbe\" (UID: \"22292678-1ea6-4840-930d-1f3f65606bbe\") "
Sep 18 20:03:35.497904 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.497883    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22292678-1ea6-4840-930d-1f3f65606bbe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "22292678-1ea6-4840-930d-1f3f65606bbe" (UID: "22292678-1ea6-4840-930d-1f3f65606bbe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:03:35.497960 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.497943    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9l8l\" (UniqueName: \"kubernetes.io/projected/d0c5b6af-4214-4955-b57e-1cff0a548399-kube-api-access-n9l8l\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:03:35.498003 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.497966    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0c5b6af-4214-4955-b57e-1cff0a548399-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:03:35.499657 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.499639    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22292678-1ea6-4840-930d-1f3f65606bbe-kube-api-access-vwwsx" (OuterVolumeSpecName: "kube-api-access-vwwsx") pod "22292678-1ea6-4840-930d-1f3f65606bbe" (UID: "22292678-1ea6-4840-930d-1f3f65606bbe"). InnerVolumeSpecName "kube-api-access-vwwsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:03:35.598784 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.598755    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/22292678-1ea6-4840-930d-1f3f65606bbe-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:03:35.598784 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.598779    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwwsx\" (UniqueName: \"kubernetes.io/projected/22292678-1ea6-4840-930d-1f3f65606bbe-kube-api-access-vwwsx\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:03:35.744844 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.744809    2583 generic.go:356] "Generic (PLEG): container finished" podID="22292678-1ea6-4840-930d-1f3f65606bbe" containerID="fcc8a3d0092c4f136fa2f749da2a1bcd55e791a5f6db9b09e012106c028029a7" exitCode=0
Sep 18 20:03:35.745009 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.744857    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"
Sep 18 20:03:35.745009 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.744893    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6" event={"ID":"22292678-1ea6-4840-930d-1f3f65606bbe","Type":"ContainerDied","Data":"fcc8a3d0092c4f136fa2f749da2a1bcd55e791a5f6db9b09e012106c028029a7"}
Sep 18 20:03:35.745009 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.744947    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6" event={"ID":"22292678-1ea6-4840-930d-1f3f65606bbe","Type":"ContainerDied","Data":"c76b3c0970dd69dc3b58171ce35cfb3475a8bbd04868638d779d61943ca0a2c8"}
Sep 18 20:03:35.745009 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.744980    2583 scope.go:117] "RemoveContainer" containerID="fcc8a3d0092c4f136fa2f749da2a1bcd55e791a5f6db9b09e012106c028029a7"
Sep 18 20:03:35.746534 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.746502    2583 generic.go:356] "Generic (PLEG): container finished" podID="d0c5b6af-4214-4955-b57e-1cff0a548399" containerID="53bfae4cbeb7067117924720be6e99e868da4dcd6f6a7d920e79a9b32f2376dd" exitCode=0
Sep 18 20:03:35.746645 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.746547    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"
Sep 18 20:03:35.746645 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.746579    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv" event={"ID":"d0c5b6af-4214-4955-b57e-1cff0a548399","Type":"ContainerDied","Data":"53bfae4cbeb7067117924720be6e99e868da4dcd6f6a7d920e79a9b32f2376dd"}
Sep 18 20:03:35.746645 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.746621    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv" event={"ID":"d0c5b6af-4214-4955-b57e-1cff0a548399","Type":"ContainerDied","Data":"867e61dd4657c6e2aba02d0c6697513cec16cdd03a4bee9a6b93a0e9f0937aad"}
Sep 18 20:03:35.755527 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.755510    2583 scope.go:117] "RemoveContainer" containerID="fcc8a3d0092c4f136fa2f749da2a1bcd55e791a5f6db9b09e012106c028029a7"
Sep 18 20:03:35.755848 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:03:35.755829    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcc8a3d0092c4f136fa2f749da2a1bcd55e791a5f6db9b09e012106c028029a7\": container with ID starting with fcc8a3d0092c4f136fa2f749da2a1bcd55e791a5f6db9b09e012106c028029a7 not found: ID does not exist" containerID="fcc8a3d0092c4f136fa2f749da2a1bcd55e791a5f6db9b09e012106c028029a7"
Sep 18 20:03:35.755919 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.755853    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcc8a3d0092c4f136fa2f749da2a1bcd55e791a5f6db9b09e012106c028029a7"} err="failed to get container status \"fcc8a3d0092c4f136fa2f749da2a1bcd55e791a5f6db9b09e012106c028029a7\": rpc error: code = NotFound desc = could not find container \"fcc8a3d0092c4f136fa2f749da2a1bcd55e791a5f6db9b09e012106c028029a7\": container with ID starting with fcc8a3d0092c4f136fa2f749da2a1bcd55e791a5f6db9b09e012106c028029a7 not found: ID does not exist"
Sep 18 20:03:35.755919 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.755869    2583 scope.go:117] "RemoveContainer" containerID="53bfae4cbeb7067117924720be6e99e868da4dcd6f6a7d920e79a9b32f2376dd"
Sep 18 20:03:35.764456 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.764437    2583 scope.go:117] "RemoveContainer" containerID="53bfae4cbeb7067117924720be6e99e868da4dcd6f6a7d920e79a9b32f2376dd"
Sep 18 20:03:35.764703 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:03:35.764686    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53bfae4cbeb7067117924720be6e99e868da4dcd6f6a7d920e79a9b32f2376dd\": container with ID starting with 53bfae4cbeb7067117924720be6e99e868da4dcd6f6a7d920e79a9b32f2376dd not found: ID does not exist" containerID="53bfae4cbeb7067117924720be6e99e868da4dcd6f6a7d920e79a9b32f2376dd"
Sep 18 20:03:35.764746 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.764710    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53bfae4cbeb7067117924720be6e99e868da4dcd6f6a7d920e79a9b32f2376dd"} err="failed to get container status \"53bfae4cbeb7067117924720be6e99e868da4dcd6f6a7d920e79a9b32f2376dd\": rpc error: code = NotFound desc = could not find container \"53bfae4cbeb7067117924720be6e99e868da4dcd6f6a7d920e79a9b32f2376dd\": container with ID starting with 53bfae4cbeb7067117924720be6e99e868da4dcd6f6a7d920e79a9b32f2376dd not found: ID does not exist"
Sep 18 20:03:35.789344 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.789320    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"]
Sep 18 20:03:35.791885 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.791866    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-166dc9bb-7b4975fdc7-lrshv"]
Sep 18 20:03:35.811960 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.811940    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c62f8b76-27f4-4b07-8d5e-5ab8f1d53764" path="/var/lib/kubelet/pods/c62f8b76-27f4-4b07-8d5e-5ab8f1d53764/volumes"
Sep 18 20:03:35.812333 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.812320    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0c5b6af-4214-4955-b57e-1cff0a548399" path="/var/lib/kubelet/pods/d0c5b6af-4214-4955-b57e-1cff0a548399/volumes"
Sep 18 20:03:35.822781 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.822758    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"]
Sep 18 20:03:35.834497 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.834473    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-166dc9bb-7969584586-lhsz6"]
Sep 18 20:03:35.858348 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:35.858292    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:36.002640 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:36.002614    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:36.396734 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:36.396708    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:36.691098 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:36.691001    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"
Sep 18 20:03:37.201400 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:37.201362    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:37.812337 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:37.812303    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22292678-1ea6-4840-930d-1f3f65606bbe" path="/var/lib/kubelet/pods/22292678-1ea6-4840-930d-1f3f65606bbe/volumes"
Sep 18 20:03:37.944340 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:37.944308    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:38.481430 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:38.481384    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:38.636306 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:38.636275    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:39.514380 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:39.514352    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:40.251996 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:40.251962    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:41.074148 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:41.074111    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:41.444784 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:41.444734    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:41.740742 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:41.740667    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:43.506181 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:43.506137    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:45.113965 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:45.113926    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:54.891115 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:54.891077    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:03:55.896975 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:55.896939    2583 generic.go:356] "Generic (PLEG): container finished" podID="0015137d-3932-4690-80cc-f4517c7b4686" containerID="d9fa48f5cbd59789b547a23c2ec021096d19df3026e76510aabaef5cdaa56a85" exitCode=0
Sep 18 20:03:55.896975 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:55.896977    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl" event={"ID":"0015137d-3932-4690-80cc-f4517c7b4686","Type":"ContainerDied","Data":"d9fa48f5cbd59789b547a23c2ec021096d19df3026e76510aabaef5cdaa56a85"}
Sep 18 20:03:55.897450 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:55.897434    2583 scope.go:117] "RemoveContainer" containerID="d9fa48f5cbd59789b547a23c2ec021096d19df3026e76510aabaef5cdaa56a85"
Sep 18 20:03:55.898502 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:55.898472    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:03:55.898558 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:55.898542    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:03:55.898594 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:55.898576    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:03:56.906199 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:56.906169    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl" event={"ID":"0015137d-3932-4690-80cc-f4517c7b4686","Type":"ContainerStarted","Data":"b93c7185aa0bbb3b9480620bf91c241880be67a66cd64ffc6b415b70fd081739"}
Sep 18 20:03:57.286691 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:57.286592    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:03:57.286876 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:57.286823    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 18 20:03:57.286876 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:57.286864    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl" podUID="0015137d-3932-4690-80cc-f4517c7b4686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 18 20:03:58.286613 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:58.286580    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 18 20:03:58.287069 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:58.286636    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl" podUID="0015137d-3932-4690-80cc-f4517c7b4686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 18 20:03:59.285883 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:59.285849    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 18 20:03:59.286109 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:03:59.285901    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl" podUID="0015137d-3932-4690-80cc-f4517c7b4686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 18 20:04:00.286417 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:00.286383    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 18 20:04:00.286795 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:00.286441    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl" podUID="0015137d-3932-4690-80cc-f4517c7b4686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 18 20:04:01.286122 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:01.286088    2583 patch_prober.go:28] interesting pod/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Sep 18 20:04:01.286294 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:01.286149    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl" podUID="0015137d-3932-4690-80cc-f4517c7b4686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Sep 18 20:04:02.290119 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:02.290088    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:04:02.290578 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:02.290364    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:04:02.291144 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:02.291127    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:04:15.394559 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:15.394525    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:19.838470 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:19.838433    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 20:04:19.841762 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:19.841742    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 20:04:20.247354 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:20.247279    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:20.456296 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:20.456265    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:26.182144 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:26.182105    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:32.255387 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:32.255288    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:32.354615 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:32.354585    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:32.531209 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:32.531095    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:33.803791 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:33.803749    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:33.903125 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:33.903093    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:34.003905 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:34.003876    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:34.595804 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:34.595766    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:35.895728 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:35.895692    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:36.081455 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:36.081427    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:42.042353 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:42.042324    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:42.115403 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:42.115374    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:42.717864 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:42.717826    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:44.550404 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:44.550371    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:48.500185 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:48.500151    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:48.680292 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:48.680265    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:48.795928 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:48.795846    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:48.881370 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:48.881338    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:50.411093 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:50.411032    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:53.732626 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:53.732590    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:55.169894 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.169859    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"]
Sep 18 20:04:55.170528 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.170506    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22292678-1ea6-4840-930d-1f3f65606bbe" containerName="payload-pre-processing"
Sep 18 20:04:55.170618 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.170531    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="22292678-1ea6-4840-930d-1f3f65606bbe" containerName="payload-pre-processing"
Sep 18 20:04:55.170618 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.170547    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0c5b6af-4214-4955-b57e-1cff0a548399" containerName="payload-processing"
Sep 18 20:04:55.170618 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.170555    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0c5b6af-4214-4955-b57e-1cff0a548399" containerName="payload-processing"
Sep 18 20:04:55.170770 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.170683    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0c5b6af-4214-4955-b57e-1cff0a548399" containerName="payload-processing"
Sep 18 20:04:55.170770 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.170697    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="22292678-1ea6-4840-930d-1f3f65606bbe" containerName="payload-pre-processing"
Sep 18 20:04:55.173967 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.173947    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.176485 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.176467    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-674263\"/\"kube-root-ca.crt\""
Sep 18 20:04:55.177764 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.177739    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-674263\"/\"default-dockercfg-nlxpd\""
Sep 18 20:04:55.177908 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.177743    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-674263\"/\"openshift-service-ca.crt\""
Sep 18 20:04:55.178221 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.178198    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-674263\"/\"distinct-2-w4-674263-kserve-self-signed-certs\""
Sep 18 20:04:55.181795 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.181465    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"]
Sep 18 20:04:55.197192 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.197160    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:55.197427 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.197409    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-home\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.197492 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.197437    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-model-cache\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.197492 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.197484    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eace68a3-665f-4398-b5e3-142bca516e96-tls-certs\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.197574 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.197512    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wkn8\" (UniqueName: \"kubernetes.io/projected/eace68a3-665f-4398-b5e3-142bca516e96-kube-api-access-7wkn8\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.197670 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.197651    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-tmp-dir\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.197716 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.197689    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-dshm\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.299124 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.299086    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eace68a3-665f-4398-b5e3-142bca516e96-tls-certs\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.299325 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.299130    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wkn8\" (UniqueName: \"kubernetes.io/projected/eace68a3-665f-4398-b5e3-142bca516e96-kube-api-access-7wkn8\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.299325 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.299180    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-tmp-dir\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.299325 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.299208    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-dshm\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.299493 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.299359    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-home\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.299493 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.299388    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-model-cache\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.299569 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.299556    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-tmp-dir\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.299683 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.299664    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-home\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.299758 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.299742    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-model-cache\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.301536 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.301516    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-dshm\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.301791 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.301767    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eace68a3-665f-4398-b5e3-142bca516e96-tls-certs\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.313051 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.313018    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wkn8\" (UniqueName: \"kubernetes.io/projected/eace68a3-665f-4398-b5e3-142bca516e96-kube-api-access-7wkn8\") pod \"distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") " pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.484302 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.484209    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:04:55.759477 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:55.759446    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"]
Sep 18 20:04:55.760899 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:04:55.760869    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeace68a3_665f_4398_b5e3_142bca516e96.slice/crio-426d7a856ed097de645f8c4919943630f607a695da682cd9abbee662a812a362 WatchSource:0}: Error finding container 426d7a856ed097de645f8c4919943630f607a695da682cd9abbee662a812a362: Status 404 returned error can't find the container with id 426d7a856ed097de645f8c4919943630f607a695da682cd9abbee662a812a362
Sep 18 20:04:56.299150 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:56.299110    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr" event={"ID":"eace68a3-665f-4398-b5e3-142bca516e96","Type":"ContainerStarted","Data":"cf68fe1133acb22c21b91c12a2a55cef478a0951e136d798cba8c8766419ac96"}
Sep 18 20:04:56.299150 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:56.299152    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr" event={"ID":"eace68a3-665f-4398-b5e3-142bca516e96","Type":"ContainerStarted","Data":"426d7a856ed097de645f8c4919943630f607a695da682cd9abbee662a812a362"}
Sep 18 20:04:56.317685 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:56.317635    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr" podStartSLOduration=1.317618566 podStartE2EDuration="1.317618566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:04:56.316021226 +0000 UTC m=+1538.643114991" watchObservedRunningTime="2026-09-18 20:04:56.317618566 +0000 UTC m=+1538.644712339"
Sep 18 20:04:59.375057 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:59.375013    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:04:59.596824 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:04:59.596794    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:04.583482 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.583445    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"]
Sep 18 20:05:04.587930 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.587907    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.590745 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.590719    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-5547b6\"/\"openshift-service-ca.crt\""
Sep 18 20:05:04.591870 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.591845    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-5547b6\"/\"auth-test-model-5547b6-kserve-self-signed-certs\""
Sep 18 20:05:04.591870 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.591868    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-5547b6\"/\"kube-root-ca.crt\""
Sep 18 20:05:04.592092 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.591986    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-5547b6\"/\"default-dockercfg-fsn7d\""
Sep 18 20:05:04.604838 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.604803    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"]
Sep 18 20:05:04.611775 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.611748    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:04.691586 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.691540    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-model-cache\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.691785 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.691598    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-home\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.691785 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.691709    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-tmp-dir\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.691785 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.691767    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hx74\" (UniqueName: \"kubernetes.io/projected/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-kube-api-access-6hx74\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.691925 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.691845    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-dshm\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.691925 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.691867    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-tls-certs\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.792531 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.792480    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-dshm\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.792531 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.792535    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-tls-certs\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.792818 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.792567    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-model-cache\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.792818 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.792597    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-home\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.792818 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.792648    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-tmp-dir\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.792818 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.792691    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hx74\" (UniqueName: \"kubernetes.io/projected/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-kube-api-access-6hx74\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.793078 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.793014    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-model-cache\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.793139 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.793109    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-home\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.793179 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.793151    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-tmp-dir\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.795018 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.794994    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-dshm\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.795318 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.795297    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-tls-certs\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.801760 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.801737    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hx74\" (UniqueName: \"kubernetes.io/projected/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-kube-api-access-6hx74\") pod \"auth-test-model-5547b6-kserve-7f4bcb7567-rh929\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") " pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:04.906436 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:04.906350    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:05.189656 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:05.189623    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"]
Sep 18 20:05:05.191202 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:05:05.191173    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod844b09ed_2e51_4c56_9ec7_e96fba06ccb6.slice/crio-20a789267f8b61f5cfbd4535b9ac05caf01924dc50f0a8690249b4ad8f0cd38b WatchSource:0}: Error finding container 20a789267f8b61f5cfbd4535b9ac05caf01924dc50f0a8690249b4ad8f0cd38b: Status 404 returned error can't find the container with id 20a789267f8b61f5cfbd4535b9ac05caf01924dc50f0a8690249b4ad8f0cd38b
Sep 18 20:05:05.360873 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:05.360833    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929" event={"ID":"844b09ed-2e51-4c56-9ec7-e96fba06ccb6","Type":"ContainerStarted","Data":"0f9ad8776eb4392965bf29a7e92244f16adab9eccd89e931c39b28a102941757"}
Sep 18 20:05:05.360873 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:05.360885    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929" event={"ID":"844b09ed-2e51-4c56-9ec7-e96fba06ccb6","Type":"ContainerStarted","Data":"20a789267f8b61f5cfbd4535b9ac05caf01924dc50f0a8690249b4ad8f0cd38b"}
Sep 18 20:05:05.377423 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:05.377357    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929" podStartSLOduration=1.377335334 podStartE2EDuration="1.377335334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:05:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:05:05.377088369 +0000 UTC m=+1547.704182134" watchObservedRunningTime="2026-09-18 20:05:05.377335334 +0000 UTC m=+1547.704429099"
Sep 18 20:05:05.485319 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:05.485228    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:05:05.485319 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:05.485285    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:05:05.502316 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:05.502284    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:05:06.382170 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:06.382140    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:05:14.906945 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:14.906906    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:14.906945 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:14.906956    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:14.920145 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:14.920116    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:15.437890 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:15.437861    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:05:20.527993 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:20.527954    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:25.906690 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:25.906656    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:26.442539 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:26.442509    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:26.499946 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:26.499904    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:26.773800 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:26.773713    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:27.076430 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:27.076108    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:27.483241 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:27.483212    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:28.530830 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:28.530795    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:29.509527 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:29.509493    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:30.197112 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:30.197075    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:30.285790 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:30.285746    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:31.208839 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:31.208807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:31.948289 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:31.948259    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:32.707670 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:32.707639    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:33.610923 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:33.610897    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:34.325062 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:34.325022    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:35.079804 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.079771    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:35.179652 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.179618    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:35.391464 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.391432    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:35.530826 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.530797    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:35.630613 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.630585    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:35.640894 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.640865    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"]
Sep 18 20:05:35.645676 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.645623    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"
Sep 18 20:05:35.649027 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.648995    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-c3d85f-dockercfg-fkzb6\""
Sep 18 20:05:35.649027 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.649030    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-c3d85f\""
Sep 18 20:05:35.661288 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.661263    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"]
Sep 18 20:05:35.705545 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.705510    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd77d\" (UniqueName: \"kubernetes.io/projected/58456903-d621-4c85-b933-f1fa3f902539-kube-api-access-qd77d\") pod \"payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn\" (UID: \"58456903-d621-4c85-b933-f1fa3f902539\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"
Sep 18 20:05:35.705722 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.705588    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58456903-d621-4c85-b933-f1fa3f902539-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn\" (UID: \"58456903-d621-4c85-b933-f1fa3f902539\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"
Sep 18 20:05:35.806523 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.806488    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd77d\" (UniqueName: \"kubernetes.io/projected/58456903-d621-4c85-b933-f1fa3f902539-kube-api-access-qd77d\") pod \"payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn\" (UID: \"58456903-d621-4c85-b933-f1fa3f902539\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"
Sep 18 20:05:35.806728 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.806557    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58456903-d621-4c85-b933-f1fa3f902539-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn\" (UID: \"58456903-d621-4c85-b933-f1fa3f902539\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"
Sep 18 20:05:35.807476 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.807451    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58456903-d621-4c85-b933-f1fa3f902539-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn\" (UID: \"58456903-d621-4c85-b933-f1fa3f902539\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"
Sep 18 20:05:35.814495 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.814473    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd77d\" (UniqueName: \"kubernetes.io/projected/58456903-d621-4c85-b933-f1fa3f902539-kube-api-access-qd77d\") pod \"payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn\" (UID: \"58456903-d621-4c85-b933-f1fa3f902539\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"
Sep 18 20:05:35.956614 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:35.956526    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"
Sep 18 20:05:36.230534 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:36.230503    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"]
Sep 18 20:05:36.231851 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:05:36.231823    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58456903_d621_4c85_b933_f1fa3f902539.slice/crio-9db7df5219f49f546594e6dbf83a4d428858d02b5a9588cc9481a98e4f7c5576 WatchSource:0}: Error finding container 9db7df5219f49f546594e6dbf83a4d428858d02b5a9588cc9481a98e4f7c5576: Status 404 returned error can't find the container with id 9db7df5219f49f546594e6dbf83a4d428858d02b5a9588cc9481a98e4f7c5576
Sep 18 20:05:36.566475 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:36.566378    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn" event={"ID":"58456903-d621-4c85-b933-f1fa3f902539","Type":"ContainerStarted","Data":"35b4e3767daed1ae7705164216ff4041d90b58777a25eea79ab12e4b85e27a16"}
Sep 18 20:05:36.566475 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:36.566431    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn" event={"ID":"58456903-d621-4c85-b933-f1fa3f902539","Type":"ContainerStarted","Data":"9db7df5219f49f546594e6dbf83a4d428858d02b5a9588cc9481a98e4f7c5576"}
Sep 18 20:05:36.566971 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:36.566502    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"
Sep 18 20:05:36.583417 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:36.583362    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn" podStartSLOduration=1.583345988 podStartE2EDuration="1.583345988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:05:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:05:36.581077015 +0000 UTC m=+1578.908170783" watchObservedRunningTime="2026-09-18 20:05:36.583345988 +0000 UTC m=+1578.910439753"
Sep 18 20:05:46.427013 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:46.426974    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:47.575144 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:47.575111    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"
Sep 18 20:05:57.010345 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:57.010313    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:57.697107 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:57.697003    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:58.505180 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:58.505148    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:59.197759 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:59.197727    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:05:59.890961 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:05:59.890925    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:00.235112 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:00.234978    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:00.661444 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:00.661413    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:00.815451 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:00.815419    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:00.955563 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:00.955473    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"]
Sep 18 20:06:00.959323 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:00.959305    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:00.962019 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:00.962000    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-13f9e5-openshift-default-dockercfg-mdcz9\""
Sep 18 20:06:00.973223 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:00.973190    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"]
Sep 18 20:06:00.979583 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:00.979551    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:01.060692 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.060653    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-workload-certs\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.060893 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.060711    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-podinfo\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.060893 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.060807    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-envoy\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.060893 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.060882    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-credential-socket\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.061099 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.060917    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-data\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.061099 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.060987    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-workload-socket\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.061099 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.061017    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-token\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.061269 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.061106    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istiod-ca-cert\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.061269 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.061138    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bqst\" (UniqueName: \"kubernetes.io/projected/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-kube-api-access-8bqst\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.162539 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.162501    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-token\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.162726 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.162570    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istiod-ca-cert\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.162726 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.162599    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bqst\" (UniqueName: \"kubernetes.io/projected/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-kube-api-access-8bqst\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.162726 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.162649    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-workload-certs\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.162837 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.162776    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-podinfo\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.162873 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.162845    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-envoy\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.162931 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.162912    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-credential-socket\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.162985 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.162960    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-data\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.163081 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.163026    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-workload-socket\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.163150 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.163134    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-workload-certs\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.163306 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.163283    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-credential-socket\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.163394 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.163373    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-data\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.163431 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.163403    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-workload-socket\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.163508 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.163492    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istiod-ca-cert\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.165203 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.165182    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-envoy\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.165325 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.165309    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-podinfo\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.171486 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.171464    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-token\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.171581 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.171552    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bqst\" (UniqueName: \"kubernetes.io/projected/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-kube-api-access-8bqst\") pod \"e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") " pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.271832 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.271742    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:01.565221 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.565194    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"]
Sep 18 20:06:01.568569 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:06:01.568539    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9747ff9_a1e1_4647_9d43_f0940c6a87a6.slice/crio-8ad367e031ba1ebc32caafcd000e4ffa24df80d3ff2689d32edc313baead0928 WatchSource:0}: Error finding container 8ad367e031ba1ebc32caafcd000e4ffa24df80d3ff2689d32edc313baead0928: Status 404 returned error can't find the container with id 8ad367e031ba1ebc32caafcd000e4ffa24df80d3ff2689d32edc313baead0928
Sep 18 20:06:01.571707 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.571666    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:06:01.571789 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.571763    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:06:01.571846 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.571831    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:06:01.596233 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.596209    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:01.696095 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.696052    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:01.733385 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.733353    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp" event={"ID":"e9747ff9-a1e1-4647-9d43-f0940c6a87a6","Type":"ContainerStarted","Data":"b746a9c3c44366d73c7ae42be601094eeff1b767061aee0886b400f692ab65d1"}
Sep 18 20:06:01.733553 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.733452    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp" event={"ID":"e9747ff9-a1e1-4647-9d43-f0940c6a87a6","Type":"ContainerStarted","Data":"8ad367e031ba1ebc32caafcd000e4ffa24df80d3ff2689d32edc313baead0928"}
Sep 18 20:06:01.755457 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:01.755395    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp" podStartSLOduration=1.7553753589999999 podStartE2EDuration="1.755375359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:06:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:06:01.754279385 +0000 UTC m=+1604.081373148" watchObservedRunningTime="2026-09-18 20:06:01.755375359 +0000 UTC m=+1604.082469126"
Sep 18 20:06:02.272658 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:02.272619    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:02.277937 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:02.277911    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:02.294456 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:02.294420    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:02.740336 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:02.740308    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:02.741418 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:02.741396    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:06:03.063891 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:03.063763    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:03.883699 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:03.883667    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:03.986447 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:03.986419    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:04.084858 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:04.084817    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:04.800195 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:04.800164    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:05.620027 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:05.619995    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:06.292221 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:06.292174    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:07.009847 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:07.009812    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:07.936614 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:07.936584    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:08.611157 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:08.611120    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:09.603002 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:09.602973    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:09.689293 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:09.689258    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:09.787500 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:09.787472    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:10.131197 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.131140    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:10.229909 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.229880    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:10.271456 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.271419    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"]
Sep 18 20:06:10.276338 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.276321    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"
Sep 18 20:06:10.279270 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.279252    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-13f9e5\""
Sep 18 20:06:10.279536 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.279520    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-13f9e5-dockercfg-xkfb9\""
Sep 18 20:06:10.285940 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.285915    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"]
Sep 18 20:06:10.478149 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.478025    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwv2l\" (UniqueName: \"kubernetes.io/projected/10bcb6ab-2d96-4b34-8987-2284ac9dc212-kube-api-access-vwv2l\") pod \"payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b\" (UID: \"10bcb6ab-2d96-4b34-8987-2284ac9dc212\") " pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"
Sep 18 20:06:10.478311 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.478146    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10bcb6ab-2d96-4b34-8987-2284ac9dc212-plugins-config-volume\") pod \"payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b\" (UID: \"10bcb6ab-2d96-4b34-8987-2284ac9dc212\") " pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"
Sep 18 20:06:10.579462 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.579427    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwv2l\" (UniqueName: \"kubernetes.io/projected/10bcb6ab-2d96-4b34-8987-2284ac9dc212-kube-api-access-vwv2l\") pod \"payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b\" (UID: \"10bcb6ab-2d96-4b34-8987-2284ac9dc212\") " pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"
Sep 18 20:06:10.579633 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.579478    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10bcb6ab-2d96-4b34-8987-2284ac9dc212-plugins-config-volume\") pod \"payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b\" (UID: \"10bcb6ab-2d96-4b34-8987-2284ac9dc212\") " pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"
Sep 18 20:06:10.580313 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.580284    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10bcb6ab-2d96-4b34-8987-2284ac9dc212-plugins-config-volume\") pod \"payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b\" (UID: \"10bcb6ab-2d96-4b34-8987-2284ac9dc212\") " pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"
Sep 18 20:06:10.587951 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.587926    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwv2l\" (UniqueName: \"kubernetes.io/projected/10bcb6ab-2d96-4b34-8987-2284ac9dc212-kube-api-access-vwv2l\") pod \"payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b\" (UID: \"10bcb6ab-2d96-4b34-8987-2284ac9dc212\") " pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"
Sep 18 20:06:10.589756 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.589738    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"
Sep 18 20:06:10.868707 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:10.868670    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"]
Sep 18 20:06:10.869111 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:06:10.869089    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10bcb6ab_2d96_4b34_8987_2284ac9dc212.slice/crio-d3bf9134e5e484955a7b98f84e979db4ecffb44238120ee9862a3eb34b0a7168 WatchSource:0}: Error finding container d3bf9134e5e484955a7b98f84e979db4ecffb44238120ee9862a3eb34b0a7168: Status 404 returned error can't find the container with id d3bf9134e5e484955a7b98f84e979db4ecffb44238120ee9862a3eb34b0a7168
Sep 18 20:06:11.804544 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:11.804506    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b" event={"ID":"10bcb6ab-2d96-4b34-8987-2284ac9dc212","Type":"ContainerStarted","Data":"8d2e4110eec19963160a495decf6a9a8d98e912d3e61f4ae5c59218f5e48393b"}
Sep 18 20:06:11.811154 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:11.811129    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b" event={"ID":"10bcb6ab-2d96-4b34-8987-2284ac9dc212","Type":"ContainerStarted","Data":"d3bf9134e5e484955a7b98f84e979db4ecffb44238120ee9862a3eb34b0a7168"}
Sep 18 20:06:11.811292 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:11.811170    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"
Sep 18 20:06:11.820909 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:11.820859    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b" podStartSLOduration=1.820845461 podStartE2EDuration="1.820845461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:06:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:06:11.820250844 +0000 UTC m=+1614.147344611" watchObservedRunningTime="2026-09-18 20:06:11.820845461 +0000 UTC m=+1614.147939226"
Sep 18 20:06:15.482339 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:15.482306    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:15.600554 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:15.600517    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f"]
Sep 18 20:06:15.604344 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:15.604325    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f"
Sep 18 20:06:15.607229 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:15.607211    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 20:06:15.607287 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:15.607214    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 20:06:15.612702 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:15.612675    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f"]
Sep 18 20:06:15.632987 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:15.632947    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565bf657-eac2-4f75-8091-22d6f7da18c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f\" (UID: \"565bf657-eac2-4f75-8091-22d6f7da18c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f"
Sep 18 20:06:15.734399 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:15.734306    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565bf657-eac2-4f75-8091-22d6f7da18c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f\" (UID: \"565bf657-eac2-4f75-8091-22d6f7da18c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f"
Sep 18 20:06:15.734961 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:15.734941    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565bf657-eac2-4f75-8091-22d6f7da18c1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f\" (UID: \"565bf657-eac2-4f75-8091-22d6f7da18c1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f"
Sep 18 20:06:15.917880 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:15.917843    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f"
Sep 18 20:06:16.069974 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:16.069901    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:16.192498 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:16.192469    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f"]
Sep 18 20:06:16.193244 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:06:16.193219    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod565bf657_eac2_4f75_8091_22d6f7da18c1.slice/crio-c98850e7467887b9c44bfefd98c950b7aa045217c0f031448ed0d9dfad8f6132 WatchSource:0}: Error finding container c98850e7467887b9c44bfefd98c950b7aa045217c0f031448ed0d9dfad8f6132: Status 404 returned error can't find the container with id c98850e7467887b9c44bfefd98c950b7aa045217c0f031448ed0d9dfad8f6132
Sep 18 20:06:16.837893 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:16.837863    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f" event={"ID":"565bf657-eac2-4f75-8091-22d6f7da18c1","Type":"ContainerStarted","Data":"c6fbfbdde0c718bdf0ff4d44c6352af0b14409e4a53c3dec69dcfeb3ddc25ddc"}
Sep 18 20:06:16.838334 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:16.837918    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f" event={"ID":"565bf657-eac2-4f75-8091-22d6f7da18c1","Type":"ContainerStarted","Data":"c98850e7467887b9c44bfefd98c950b7aa045217c0f031448ed0d9dfad8f6132"}
Sep 18 20:06:16.857137 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:16.857073    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f" podStartSLOduration=1.8570532659999999 podStartE2EDuration="1.857053266s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:06:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:06:16.854065422 +0000 UTC m=+1619.181159186" watchObservedRunningTime="2026-09-18 20:06:16.857053266 +0000 UTC m=+1619.184147030"
Sep 18 20:06:16.923556 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:16.923530    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:17.845857 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:17.845817    2583 generic.go:356] "Generic (PLEG): container finished" podID="565bf657-eac2-4f75-8091-22d6f7da18c1" containerID="c6fbfbdde0c718bdf0ff4d44c6352af0b14409e4a53c3dec69dcfeb3ddc25ddc" exitCode=0
Sep 18 20:06:17.846264 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:17.845918    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f" event={"ID":"565bf657-eac2-4f75-8091-22d6f7da18c1","Type":"ContainerDied","Data":"c6fbfbdde0c718bdf0ff4d44c6352af0b14409e4a53c3dec69dcfeb3ddc25ddc"}
Sep 18 20:06:18.025243 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:18.025204    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:18.772977 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:18.772943    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:18.996613 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:18.996590    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f"
Sep 18 20:06:19.070174 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:19.070074    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565bf657-eac2-4f75-8091-22d6f7da18c1-maas-api-service-ca\") pod \"565bf657-eac2-4f75-8091-22d6f7da18c1\" (UID: \"565bf657-eac2-4f75-8091-22d6f7da18c1\") "
Sep 18 20:06:19.070452 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:19.070429    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/565bf657-eac2-4f75-8091-22d6f7da18c1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "565bf657-eac2-4f75-8091-22d6f7da18c1" (UID: "565bf657-eac2-4f75-8091-22d6f7da18c1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:06:19.171181 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:19.171149    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/565bf657-eac2-4f75-8091-22d6f7da18c1-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:19.688975 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:19.688944    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:19.862014 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:19.861987    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f"
Sep 18 20:06:19.862229 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:19.862028    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f" event={"ID":"565bf657-eac2-4f75-8091-22d6f7da18c1","Type":"ContainerDied","Data":"c98850e7467887b9c44bfefd98c950b7aa045217c0f031448ed0d9dfad8f6132"}
Sep 18 20:06:19.862229 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:19.862093    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c98850e7467887b9c44bfefd98c950b7aa045217c0f031448ed0d9dfad8f6132"
Sep 18 20:06:20.435733 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:20.435702    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:20.654727 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:20.654690    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"]
Sep 18 20:06:20.718900 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:20.718816    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"]
Sep 18 20:06:20.747098 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:20.747069    2583 scope.go:117] "RemoveContainer" containerID="bf556e433addb3e5d70df3bb5c1bcaba28a26f438cbc2b63e4708eee2cb46afe"
Sep 18 20:06:20.757318 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:20.757298    2583 scope.go:117] "RemoveContainer" containerID="52837ffa00dcecff09ccb82ce8043cc9d3b28b9f6e13c20c36e4ac1495254f77"
Sep 18 20:06:20.766221 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:20.766199    2583 scope.go:117] "RemoveContainer" containerID="155d8086977ae8cbabf28fe7f76dc78751bab7c3f8048c81c99df5701bc899fe"
Sep 18 20:06:20.838046 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:20.838021    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:21.761501 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:21.761468    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:22.537739 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:22.537685    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:23.495812 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:23.495762    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:23.594505 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:23.594468    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:23.818536 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:23.818447    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"
Sep 18 20:06:24.425108 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:24.425069    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:25.123510 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:25.123481    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:25.869298 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:25.869262    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:26.816449 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:26.816415    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:27.502653 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:27.502615    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:28.319642 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:28.319614    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:29.021485 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:29.021449    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:29.985947 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:29.985917    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:30.710385 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:30.710340    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:31.523915 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:31.523882    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:32.837451 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:32.837423    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:33.661999 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:33.661971    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:34.688075 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:34.688028    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:34.791971 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:34.791941    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:34.892338 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:34.892305    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:34.977989 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:34.977905    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f"]
Sep 18 20:06:34.978694 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:34.978675    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:34.981484 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:34.981461    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-d94b9e-mqv8f"]
Sep 18 20:06:35.062404 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:35.062354    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:35.339142 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:35.339115    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:35.427960 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:35.427932    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:35.674526 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:35.674443    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db" podUID="dec88288-e2a0-416d-b2c9-9dcde525e7a5" containerName="main" containerID="cri-o://6a4337fc7fa42588f89b574d1e105c4b8c0d5f217adaef92a5c3dd891f0ca3d7" gracePeriod=45
Sep 18 20:06:35.738939 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:35.738893    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l" podUID="f81bea2d-4d78-472f-bbdc-ba2b84f24009" containerName="main" containerID="cri-o://b269dff0e17c5dc667991f90e95fecd56527e59b7ff28b0841b3fa555e227146" gracePeriod=45
Sep 18 20:06:35.812986 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:35.812950    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="565bf657-eac2-4f75-8091-22d6f7da18c1" path="/var/lib/kubelet/pods/565bf657-eac2-4f75-8091-22d6f7da18c1/volumes"
Sep 18 20:06:35.974909 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:35.974877    2583 generic.go:356] "Generic (PLEG): container finished" podID="f81bea2d-4d78-472f-bbdc-ba2b84f24009" containerID="b269dff0e17c5dc667991f90e95fecd56527e59b7ff28b0841b3fa555e227146" exitCode=0
Sep 18 20:06:35.975157 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:35.974954    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l" event={"ID":"f81bea2d-4d78-472f-bbdc-ba2b84f24009","Type":"ContainerDied","Data":"b269dff0e17c5dc667991f90e95fecd56527e59b7ff28b0841b3fa555e227146"}
Sep 18 20:06:35.976928 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:35.976901    2583 generic.go:356] "Generic (PLEG): container finished" podID="dec88288-e2a0-416d-b2c9-9dcde525e7a5" containerID="6a4337fc7fa42588f89b574d1e105c4b8c0d5f217adaef92a5c3dd891f0ca3d7" exitCode=0
Sep 18 20:06:35.977074 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:35.976936    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db" event={"ID":"dec88288-e2a0-416d-b2c9-9dcde525e7a5","Type":"ContainerDied","Data":"6a4337fc7fa42588f89b574d1e105c4b8c0d5f217adaef92a5c3dd891f0ca3d7"}
Sep 18 20:06:36.023794 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.023772    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:06:36.027159 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.027137    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 20:06:36.153349 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153320    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-home\") pod \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") "
Sep 18 20:06:36.153556 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153376    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-tmp-dir\") pod \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") "
Sep 18 20:06:36.153556 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153418    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hq9cx\" (UniqueName: \"kubernetes.io/projected/f81bea2d-4d78-472f-bbdc-ba2b84f24009-kube-api-access-hq9cx\") pod \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") "
Sep 18 20:06:36.153556 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153442    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-model-cache\") pod \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") "
Sep 18 20:06:36.153556 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153481    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-dshm\") pod \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") "
Sep 18 20:06:36.153782 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153623    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-home\") pod \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") "
Sep 18 20:06:36.153782 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153643    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-home" (OuterVolumeSpecName: "home") pod "dec88288-e2a0-416d-b2c9-9dcde525e7a5" (UID: "dec88288-e2a0-416d-b2c9-9dcde525e7a5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:36.153782 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153665    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dec88288-e2a0-416d-b2c9-9dcde525e7a5-tls-certs\") pod \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") "
Sep 18 20:06:36.153782 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153693    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-model-cache" (OuterVolumeSpecName: "model-cache") pod "f81bea2d-4d78-472f-bbdc-ba2b84f24009" (UID: "f81bea2d-4d78-472f-bbdc-ba2b84f24009"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:36.153782 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153719    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f81bea2d-4d78-472f-bbdc-ba2b84f24009" (UID: "f81bea2d-4d78-472f-bbdc-ba2b84f24009"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:36.153782 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153727    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-dshm\") pod \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") "
Sep 18 20:06:36.154177 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153804    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcqkr\" (UniqueName: \"kubernetes.io/projected/dec88288-e2a0-416d-b2c9-9dcde525e7a5-kube-api-access-mcqkr\") pod \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") "
Sep 18 20:06:36.154177 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153888    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-home" (OuterVolumeSpecName: "home") pod "f81bea2d-4d78-472f-bbdc-ba2b84f24009" (UID: "f81bea2d-4d78-472f-bbdc-ba2b84f24009"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:36.154177 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153912    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-model-cache\") pod \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") "
Sep 18 20:06:36.154177 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.153969    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-tmp-dir\") pod \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\" (UID: \"dec88288-e2a0-416d-b2c9-9dcde525e7a5\") "
Sep 18 20:06:36.154177 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.154008    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f81bea2d-4d78-472f-bbdc-ba2b84f24009-tls-certs\") pod \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\" (UID: \"f81bea2d-4d78-472f-bbdc-ba2b84f24009\") "
Sep 18 20:06:36.154505 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.154482    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:36.154583 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.154509    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:36.154583 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.154510    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-model-cache" (OuterVolumeSpecName: "model-cache") pod "dec88288-e2a0-416d-b2c9-9dcde525e7a5" (UID: "dec88288-e2a0-416d-b2c9-9dcde525e7a5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:36.154583 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.154523    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:36.154583 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.154560    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:36.155456 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.155432    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dec88288-e2a0-416d-b2c9-9dcde525e7a5" (UID: "dec88288-e2a0-416d-b2c9-9dcde525e7a5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:36.156289 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.156258    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-dshm" (OuterVolumeSpecName: "dshm") pod "f81bea2d-4d78-472f-bbdc-ba2b84f24009" (UID: "f81bea2d-4d78-472f-bbdc-ba2b84f24009"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:36.156289 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.156287    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-dshm" (OuterVolumeSpecName: "dshm") pod "dec88288-e2a0-416d-b2c9-9dcde525e7a5" (UID: "dec88288-e2a0-416d-b2c9-9dcde525e7a5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:36.156289 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.156291    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dec88288-e2a0-416d-b2c9-9dcde525e7a5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dec88288-e2a0-416d-b2c9-9dcde525e7a5" (UID: "dec88288-e2a0-416d-b2c9-9dcde525e7a5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:06:36.156469 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.156339    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f81bea2d-4d78-472f-bbdc-ba2b84f24009-kube-api-access-hq9cx" (OuterVolumeSpecName: "kube-api-access-hq9cx") pod "f81bea2d-4d78-472f-bbdc-ba2b84f24009" (UID: "f81bea2d-4d78-472f-bbdc-ba2b84f24009"). InnerVolumeSpecName "kube-api-access-hq9cx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:06:36.156469 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.156376    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dec88288-e2a0-416d-b2c9-9dcde525e7a5-kube-api-access-mcqkr" (OuterVolumeSpecName: "kube-api-access-mcqkr") pod "dec88288-e2a0-416d-b2c9-9dcde525e7a5" (UID: "dec88288-e2a0-416d-b2c9-9dcde525e7a5"). InnerVolumeSpecName "kube-api-access-mcqkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:06:36.156724 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.156707    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f81bea2d-4d78-472f-bbdc-ba2b84f24009-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f81bea2d-4d78-472f-bbdc-ba2b84f24009" (UID: "f81bea2d-4d78-472f-bbdc-ba2b84f24009"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:06:36.255664 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.255577    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hq9cx\" (UniqueName: \"kubernetes.io/projected/f81bea2d-4d78-472f-bbdc-ba2b84f24009-kube-api-access-hq9cx\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:36.255664 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.255608    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:36.255664 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.255621    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dec88288-e2a0-416d-b2c9-9dcde525e7a5-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:36.255664 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.255629    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f81bea2d-4d78-472f-bbdc-ba2b84f24009-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:36.255664 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.255638    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcqkr\" (UniqueName: \"kubernetes.io/projected/dec88288-e2a0-416d-b2c9-9dcde525e7a5-kube-api-access-mcqkr\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:36.255664 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.255645    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:36.255664 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.255653    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dec88288-e2a0-416d-b2c9-9dcde525e7a5-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:36.255664 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.255660    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f81bea2d-4d78-472f-bbdc-ba2b84f24009-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:36.492753 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.492718    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:36.984421 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.984398    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"
Sep 18 20:06:36.984891 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.984396    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l" event={"ID":"f81bea2d-4d78-472f-bbdc-ba2b84f24009","Type":"ContainerDied","Data":"39e0790b1841d5b85f14dc0dc81c006754aac99bbf1563a8c6ee74128b2fd2b4"}
Sep 18 20:06:36.984891 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.984526    2583 scope.go:117] "RemoveContainer" containerID="b269dff0e17c5dc667991f90e95fecd56527e59b7ff28b0841b3fa555e227146"
Sep 18 20:06:36.985945 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.985921    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"
Sep 18 20:06:36.986009 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.985957    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db" event={"ID":"dec88288-e2a0-416d-b2c9-9dcde525e7a5","Type":"ContainerDied","Data":"5b769b08ef2b927bcb865d2a6b37b95683ebd00cfa3d95efe739447bf980ac16"}
Sep 18 20:06:36.995107 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:36.995086    2583 scope.go:117] "RemoveContainer" containerID="6a4337fc7fa42588f89b574d1e105c4b8c0d5f217adaef92a5c3dd891f0ca3d7"
Sep 18 20:06:37.011815 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:37.011787    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"]
Sep 18 20:06:37.017186 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:37.017160    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-d94b9e/distinct-2-w0-d94b9e-kserve-959b4487-9p4db"]
Sep 18 20:06:37.028143 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:37.028110    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"]
Sep 18 20:06:37.037002 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:37.036976    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-d94b9e/premium-w0-d94b9e-kserve-577797b64f-xpq8l"]
Sep 18 20:06:37.217686 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:37.217656    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:37.812365 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:37.812329    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dec88288-e2a0-416d-b2c9-9dcde525e7a5" path="/var/lib/kubelet/pods/dec88288-e2a0-416d-b2c9-9dcde525e7a5/volumes"
Sep 18 20:06:37.812756 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:37.812742    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f81bea2d-4d78-472f-bbdc-ba2b84f24009" path="/var/lib/kubelet/pods/f81bea2d-4d78-472f-bbdc-ba2b84f24009/volumes"
Sep 18 20:06:37.921220 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:37.921188    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:38.710516 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:38.710462    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:39.404395 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:39.404365    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:40.209874 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:40.209845    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:40.910097 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:40.910071    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:41.718998 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:41.718973    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:41.821694 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:41.821482    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:41.989688 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:41.989608    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"]
Sep 18 20:06:41.989894 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:41.989867    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy" containerID="cri-o://bfab0dcc1270bf27fc0a3f1f9f911a88c6a3e90c2e520d7af3b94f262fb9bcf6" gracePeriod=30
Sep 18 20:06:42.002233 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:42.002210    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:46.637939 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:46.637904    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:46.676513 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:46.676481    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"]
Sep 18 20:06:46.677510 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:46.677467    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn" podUID="58456903-d621-4c85-b933-f1fa3f902539" containerName="payload-pre-processing" containerID="cri-o://35b4e3767daed1ae7705164216ff4041d90b58777a25eea79ab12e4b85e27a16" gracePeriod=30
Sep 18 20:06:46.740562 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:46.740530    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:46.841432 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:46.841402    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:46.939474 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:46.939449    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"
Sep 18 20:06:46.939930 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:46.939913    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:46.967075 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:46.967033    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qd77d\" (UniqueName: \"kubernetes.io/projected/58456903-d621-4c85-b933-f1fa3f902539-kube-api-access-qd77d\") pod \"58456903-d621-4c85-b933-f1fa3f902539\" (UID: \"58456903-d621-4c85-b933-f1fa3f902539\") "
Sep 18 20:06:46.967244 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:46.967099    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58456903-d621-4c85-b933-f1fa3f902539-plugins-config-volume\") pod \"58456903-d621-4c85-b933-f1fa3f902539\" (UID: \"58456903-d621-4c85-b933-f1fa3f902539\") "
Sep 18 20:06:46.967493 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:46.967471    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58456903-d621-4c85-b933-f1fa3f902539-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "58456903-d621-4c85-b933-f1fa3f902539" (UID: "58456903-d621-4c85-b933-f1fa3f902539"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:06:46.968970 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:46.968946    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58456903-d621-4c85-b933-f1fa3f902539-kube-api-access-qd77d" (OuterVolumeSpecName: "kube-api-access-qd77d") pod "58456903-d621-4c85-b933-f1fa3f902539" (UID: "58456903-d621-4c85-b933-f1fa3f902539"). InnerVolumeSpecName "kube-api-access-qd77d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:06:47.060722 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.060676    2583 generic.go:356] "Generic (PLEG): container finished" podID="58456903-d621-4c85-b933-f1fa3f902539" containerID="35b4e3767daed1ae7705164216ff4041d90b58777a25eea79ab12e4b85e27a16" exitCode=0
Sep 18 20:06:47.060722 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.060714    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn" event={"ID":"58456903-d621-4c85-b933-f1fa3f902539","Type":"ContainerDied","Data":"35b4e3767daed1ae7705164216ff4041d90b58777a25eea79ab12e4b85e27a16"}
Sep 18 20:06:47.060955 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.060726    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"
Sep 18 20:06:47.060955 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.060775    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn" event={"ID":"58456903-d621-4c85-b933-f1fa3f902539","Type":"ContainerDied","Data":"9db7df5219f49f546594e6dbf83a4d428858d02b5a9588cc9481a98e4f7c5576"}
Sep 18 20:06:47.060955 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.060807    2583 scope.go:117] "RemoveContainer" containerID="35b4e3767daed1ae7705164216ff4041d90b58777a25eea79ab12e4b85e27a16"
Sep 18 20:06:47.068504 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.068485    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd77d\" (UniqueName: \"kubernetes.io/projected/58456903-d621-4c85-b933-f1fa3f902539-kube-api-access-qd77d\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.068504 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.068503    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58456903-d621-4c85-b933-f1fa3f902539-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.102321 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.102296    2583 scope.go:117] "RemoveContainer" containerID="35b4e3767daed1ae7705164216ff4041d90b58777a25eea79ab12e4b85e27a16"
Sep 18 20:06:47.102658 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:06:47.102636    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35b4e3767daed1ae7705164216ff4041d90b58777a25eea79ab12e4b85e27a16\": container with ID starting with 35b4e3767daed1ae7705164216ff4041d90b58777a25eea79ab12e4b85e27a16 not found: ID does not exist" containerID="35b4e3767daed1ae7705164216ff4041d90b58777a25eea79ab12e4b85e27a16"
Sep 18 20:06:47.102716 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.102666    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35b4e3767daed1ae7705164216ff4041d90b58777a25eea79ab12e4b85e27a16"} err="failed to get container status \"35b4e3767daed1ae7705164216ff4041d90b58777a25eea79ab12e4b85e27a16\": rpc error: code = NotFound desc = could not find container \"35b4e3767daed1ae7705164216ff4041d90b58777a25eea79ab12e4b85e27a16\": container with ID starting with 35b4e3767daed1ae7705164216ff4041d90b58777a25eea79ab12e4b85e27a16 not found: ID does not exist"
Sep 18 20:06:47.109137 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.109114    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"]
Sep 18 20:06:47.113851 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.113817    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-c3d85f-98599d96b-ztqtn"]
Sep 18 20:06:47.195846 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.195760    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:47.234171 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.234148    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.270305    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-istio-envoy\") pod \"321193d0-1af6-4ab1-a058-8a551ea80092\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") "
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.270366    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/321193d0-1af6-4ab1-a058-8a551ea80092-istio-podinfo\") pod \"321193d0-1af6-4ab1-a058-8a551ea80092\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") "
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.270408    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-credential-socket\") pod \"321193d0-1af6-4ab1-a058-8a551ea80092\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") "
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.270445    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rxdm7\" (UniqueName: \"kubernetes.io/projected/321193d0-1af6-4ab1-a058-8a551ea80092-kube-api-access-rxdm7\") pod \"321193d0-1af6-4ab1-a058-8a551ea80092\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") "
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.270474    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-workload-socket\") pod \"321193d0-1af6-4ab1-a058-8a551ea80092\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") "
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.270517    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-workload-certs\") pod \"321193d0-1af6-4ab1-a058-8a551ea80092\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") "
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.270561    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/321193d0-1af6-4ab1-a058-8a551ea80092-istio-token\") pod \"321193d0-1af6-4ab1-a058-8a551ea80092\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") "
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.270634    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-istio-data\") pod \"321193d0-1af6-4ab1-a058-8a551ea80092\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") "
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.270695    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/321193d0-1af6-4ab1-a058-8a551ea80092-istiod-ca-cert\") pod \"321193d0-1af6-4ab1-a058-8a551ea80092\" (UID: \"321193d0-1af6-4ab1-a058-8a551ea80092\") "
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.271284    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "321193d0-1af6-4ab1-a058-8a551ea80092" (UID: "321193d0-1af6-4ab1-a058-8a551ea80092"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.271492    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "321193d0-1af6-4ab1-a058-8a551ea80092" (UID: "321193d0-1af6-4ab1-a058-8a551ea80092"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.271598    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "321193d0-1af6-4ab1-a058-8a551ea80092" (UID: "321193d0-1af6-4ab1-a058-8a551ea80092"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.271623    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-istio-data" (OuterVolumeSpecName: "istio-data") pod "321193d0-1af6-4ab1-a058-8a551ea80092" (UID: "321193d0-1af6-4ab1-a058-8a551ea80092"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.271802    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-workload-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.271854    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-workload-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.271869    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-istio-data\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.271881    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-credential-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.273176 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.271979    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/321193d0-1af6-4ab1-a058-8a551ea80092-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "321193d0-1af6-4ab1-a058-8a551ea80092" (UID: "321193d0-1af6-4ab1-a058-8a551ea80092"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:06:47.274180 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.273025    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "321193d0-1af6-4ab1-a058-8a551ea80092" (UID: "321193d0-1af6-4ab1-a058-8a551ea80092"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:06:47.274180 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.273445    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/321193d0-1af6-4ab1-a058-8a551ea80092-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "321193d0-1af6-4ab1-a058-8a551ea80092" (UID: "321193d0-1af6-4ab1-a058-8a551ea80092"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:06:47.274180 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.273673    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/321193d0-1af6-4ab1-a058-8a551ea80092-istio-token" (OuterVolumeSpecName: "istio-token") pod "321193d0-1af6-4ab1-a058-8a551ea80092" (UID: "321193d0-1af6-4ab1-a058-8a551ea80092"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:06:47.274180 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.273975    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/321193d0-1af6-4ab1-a058-8a551ea80092-kube-api-access-rxdm7" (OuterVolumeSpecName: "kube-api-access-rxdm7") pod "321193d0-1af6-4ab1-a058-8a551ea80092" (UID: "321193d0-1af6-4ab1-a058-8a551ea80092"). InnerVolumeSpecName "kube-api-access-rxdm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:06:47.372977 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.372940    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/321193d0-1af6-4ab1-a058-8a551ea80092-istiod-ca-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.372977 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.372972    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/321193d0-1af6-4ab1-a058-8a551ea80092-istio-envoy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.372977 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.372984    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/321193d0-1af6-4ab1-a058-8a551ea80092-istio-podinfo\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.373257 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.372993    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rxdm7\" (UniqueName: \"kubernetes.io/projected/321193d0-1af6-4ab1-a058-8a551ea80092-kube-api-access-rxdm7\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.373257 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.373004    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/321193d0-1af6-4ab1-a058-8a551ea80092-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:06:47.385909 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.385883    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:47.812923 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:47.812887    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58456903-d621-4c85-b933-f1fa3f902539" path="/var/lib/kubelet/pods/58456903-d621-4c85-b933-f1fa3f902539/volumes"
Sep 18 20:06:48.070239 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:48.070145    2583 generic.go:356] "Generic (PLEG): container finished" podID="321193d0-1af6-4ab1-a058-8a551ea80092" containerID="bfab0dcc1270bf27fc0a3f1f9f911a88c6a3e90c2e520d7af3b94f262fb9bcf6" exitCode=0
Sep 18 20:06:48.070239 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:48.070222    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"
Sep 18 20:06:48.070424 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:48.070235    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" event={"ID":"321193d0-1af6-4ab1-a058-8a551ea80092","Type":"ContainerDied","Data":"bfab0dcc1270bf27fc0a3f1f9f911a88c6a3e90c2e520d7af3b94f262fb9bcf6"}
Sep 18 20:06:48.070424 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:48.070293    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5" event={"ID":"321193d0-1af6-4ab1-a058-8a551ea80092","Type":"ContainerDied","Data":"3270291258ade57077dd1d50fe86deae7a6e46b5842043a194c289bb4ef98120"}
Sep 18 20:06:48.070424 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:48.070315    2583 scope.go:117] "RemoveContainer" containerID="bfab0dcc1270bf27fc0a3f1f9f911a88c6a3e90c2e520d7af3b94f262fb9bcf6"
Sep 18 20:06:48.080111 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:48.080094    2583 scope.go:117] "RemoveContainer" containerID="1db0b5496f219a63632f23dbac4fb12ef25069787f0ca020e6e3440811e2a66f"
Sep 18 20:06:48.090497 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:48.090461    2583 scope.go:117] "RemoveContainer" containerID="bfab0dcc1270bf27fc0a3f1f9f911a88c6a3e90c2e520d7af3b94f262fb9bcf6"
Sep 18 20:06:48.090804 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:06:48.090780    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfab0dcc1270bf27fc0a3f1f9f911a88c6a3e90c2e520d7af3b94f262fb9bcf6\": container with ID starting with bfab0dcc1270bf27fc0a3f1f9f911a88c6a3e90c2e520d7af3b94f262fb9bcf6 not found: ID does not exist" containerID="bfab0dcc1270bf27fc0a3f1f9f911a88c6a3e90c2e520d7af3b94f262fb9bcf6"
Sep 18 20:06:48.090874 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:48.090813    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfab0dcc1270bf27fc0a3f1f9f911a88c6a3e90c2e520d7af3b94f262fb9bcf6"} err="failed to get container status \"bfab0dcc1270bf27fc0a3f1f9f911a88c6a3e90c2e520d7af3b94f262fb9bcf6\": rpc error: code = NotFound desc = could not find container \"bfab0dcc1270bf27fc0a3f1f9f911a88c6a3e90c2e520d7af3b94f262fb9bcf6\": container with ID starting with bfab0dcc1270bf27fc0a3f1f9f911a88c6a3e90c2e520d7af3b94f262fb9bcf6 not found: ID does not exist"
Sep 18 20:06:48.090874 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:48.090833    2583 scope.go:117] "RemoveContainer" containerID="1db0b5496f219a63632f23dbac4fb12ef25069787f0ca020e6e3440811e2a66f"
Sep 18 20:06:48.091211 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:06:48.091181    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1db0b5496f219a63632f23dbac4fb12ef25069787f0ca020e6e3440811e2a66f\": container with ID starting with 1db0b5496f219a63632f23dbac4fb12ef25069787f0ca020e6e3440811e2a66f not found: ID does not exist" containerID="1db0b5496f219a63632f23dbac4fb12ef25069787f0ca020e6e3440811e2a66f"
Sep 18 20:06:48.091310 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:48.091217    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1db0b5496f219a63632f23dbac4fb12ef25069787f0ca020e6e3440811e2a66f"} err="failed to get container status \"1db0b5496f219a63632f23dbac4fb12ef25069787f0ca020e6e3440811e2a66f\": rpc error: code = NotFound desc = could not find container \"1db0b5496f219a63632f23dbac4fb12ef25069787f0ca020e6e3440811e2a66f\": container with ID starting with 1db0b5496f219a63632f23dbac4fb12ef25069787f0ca020e6e3440811e2a66f not found: ID does not exist"
Sep 18 20:06:48.091977 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:48.091955    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"]
Sep 18 20:06:48.094947 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:48.094929    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-d94b9e-openshift-default-85797b5cc4-ngtn5"]
Sep 18 20:06:48.275283 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:48.275257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:48.981374 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:48.981347    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:49.812010 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:49.811981    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" path="/var/lib/kubelet/pods/321193d0-1af6-4ab1-a058-8a551ea80092/volumes"
Sep 18 20:06:49.813113 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:49.813091    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:50.501649 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:50.501621    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:50.912459 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:50.912429    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:51.163576 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:51.163498    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:52.022478 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:52.022444    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:53.223090 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:53.223031    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:53.300556 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:53.300497    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:53.494249 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:53.494180    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:54.066503 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:54.066466    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:54.831751 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:54.831723    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:55.706899 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:55.706872    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:56.582057 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:56.581998    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:57.332884 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:57.332858    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:57.431397 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:57.431356    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:57.532347 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:57.532315    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:58.199579 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:58.199552    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:58.563966 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:58.563881    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:59.202061 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:59.202015    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:06:59.898971 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:06:59.898935    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:09.353286 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.353254    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:09.384524 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.384490    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"]
Sep 18 20:07:09.384787 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.384758    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b" podUID="10bcb6ab-2d96-4b34-8987-2284ac9dc212" containerName="payload-processing" containerID="cri-o://8d2e4110eec19963160a495decf6a9a8d98e912d3e61f4ae5c59218f5e48393b" gracePeriod=30
Sep 18 20:07:09.454583 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.454528    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:09.549754 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.549720    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:09.616731 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.616468    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:09.686952 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.686930    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"
Sep 18 20:07:09.797370 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.797335    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10bcb6ab-2d96-4b34-8987-2284ac9dc212-plugins-config-volume\") pod \"10bcb6ab-2d96-4b34-8987-2284ac9dc212\" (UID: \"10bcb6ab-2d96-4b34-8987-2284ac9dc212\") "
Sep 18 20:07:09.797583 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.797488    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwv2l\" (UniqueName: \"kubernetes.io/projected/10bcb6ab-2d96-4b34-8987-2284ac9dc212-kube-api-access-vwv2l\") pod \"10bcb6ab-2d96-4b34-8987-2284ac9dc212\" (UID: \"10bcb6ab-2d96-4b34-8987-2284ac9dc212\") "
Sep 18 20:07:09.797757 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.797728    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10bcb6ab-2d96-4b34-8987-2284ac9dc212-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "10bcb6ab-2d96-4b34-8987-2284ac9dc212" (UID: "10bcb6ab-2d96-4b34-8987-2284ac9dc212"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:07:09.797865 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.797847    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10bcb6ab-2d96-4b34-8987-2284ac9dc212-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:09.799620 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.799601    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10bcb6ab-2d96-4b34-8987-2284ac9dc212-kube-api-access-vwv2l" (OuterVolumeSpecName: "kube-api-access-vwv2l") pod "10bcb6ab-2d96-4b34-8987-2284ac9dc212" (UID: "10bcb6ab-2d96-4b34-8987-2284ac9dc212"). InnerVolumeSpecName "kube-api-access-vwv2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:07:09.898836 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.898763    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwv2l\" (UniqueName: \"kubernetes.io/projected/10bcb6ab-2d96-4b34-8987-2284ac9dc212-kube-api-access-vwv2l\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:09.899947 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.899908    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:09.963317 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:09.963276    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:10.208003 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:10.207911    2583 generic.go:356] "Generic (PLEG): container finished" podID="10bcb6ab-2d96-4b34-8987-2284ac9dc212" containerID="8d2e4110eec19963160a495decf6a9a8d98e912d3e61f4ae5c59218f5e48393b" exitCode=0
Sep 18 20:07:10.208003 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:10.207968    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"
Sep 18 20:07:10.208003 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:10.207987    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b" event={"ID":"10bcb6ab-2d96-4b34-8987-2284ac9dc212","Type":"ContainerDied","Data":"8d2e4110eec19963160a495decf6a9a8d98e912d3e61f4ae5c59218f5e48393b"}
Sep 18 20:07:10.208309 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:10.208081    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b" event={"ID":"10bcb6ab-2d96-4b34-8987-2284ac9dc212","Type":"ContainerDied","Data":"d3bf9134e5e484955a7b98f84e979db4ecffb44238120ee9862a3eb34b0a7168"}
Sep 18 20:07:10.208309 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:10.208118    2583 scope.go:117] "RemoveContainer" containerID="8d2e4110eec19963160a495decf6a9a8d98e912d3e61f4ae5c59218f5e48393b"
Sep 18 20:07:10.224614 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:10.224567    2583 scope.go:117] "RemoveContainer" containerID="8d2e4110eec19963160a495decf6a9a8d98e912d3e61f4ae5c59218f5e48393b"
Sep 18 20:07:10.228299 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:07:10.226770    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d2e4110eec19963160a495decf6a9a8d98e912d3e61f4ae5c59218f5e48393b\": container with ID starting with 8d2e4110eec19963160a495decf6a9a8d98e912d3e61f4ae5c59218f5e48393b not found: ID does not exist" containerID="8d2e4110eec19963160a495decf6a9a8d98e912d3e61f4ae5c59218f5e48393b"
Sep 18 20:07:10.228299 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:10.226807    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d2e4110eec19963160a495decf6a9a8d98e912d3e61f4ae5c59218f5e48393b"} err="failed to get container status \"8d2e4110eec19963160a495decf6a9a8d98e912d3e61f4ae5c59218f5e48393b\": rpc error: code = NotFound desc = could not find container \"8d2e4110eec19963160a495decf6a9a8d98e912d3e61f4ae5c59218f5e48393b\": container with ID starting with 8d2e4110eec19963160a495decf6a9a8d98e912d3e61f4ae5c59218f5e48393b not found: ID does not exist"
Sep 18 20:07:10.234061 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:10.231126    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"]
Sep 18 20:07:10.236910 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:10.236866    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-13f9e5-77d7c785cf-kcq5b"]
Sep 18 20:07:10.604345 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:10.604300    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:11.365531 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:11.365504    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:11.811988 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:11.811909    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10bcb6ab-2d96-4b34-8987-2284ac9dc212" path="/var/lib/kubelet/pods/10bcb6ab-2d96-4b34-8987-2284ac9dc212/volumes"
Sep 18 20:07:12.301719 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:12.301685    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:12.952143 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:12.952104    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:13.619884 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:13.619846    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:15.245916 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:15.245884    2583 generic.go:356] "Generic (PLEG): container finished" podID="e9747ff9-a1e1-4647-9d43-f0940c6a87a6" containerID="b746a9c3c44366d73c7ae42be601094eeff1b767061aee0886b400f692ab65d1" exitCode=0
Sep 18 20:07:15.246381 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:15.245960    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp" event={"ID":"e9747ff9-a1e1-4647-9d43-f0940c6a87a6","Type":"ContainerDied","Data":"b746a9c3c44366d73c7ae42be601094eeff1b767061aee0886b400f692ab65d1"}
Sep 18 20:07:15.246514 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:15.246497    2583 scope.go:117] "RemoveContainer" containerID="b746a9c3c44366d73c7ae42be601094eeff1b767061aee0886b400f692ab65d1"
Sep 18 20:07:15.247776 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:15.247746    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:07:15.247884 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:15.247820    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:07:15.247884 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:15.247863    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:07:15.713075 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:15.713030    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:15.813424 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:15.813394    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:15.971141 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:15.971063    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"]
Sep 18 20:07:15.996986 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:15.996956    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:16.254686 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:16.254591    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp" event={"ID":"e9747ff9-a1e1-4647-9d43-f0940c6a87a6","Type":"ContainerStarted","Data":"e8f9aaafe07bd41aaa1e041b6c858efd3d532ade0f713b9864867e9381f731ec"}
Sep 18 20:07:16.254686 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:16.254662    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp" podUID="e9747ff9-a1e1-4647-9d43-f0940c6a87a6" containerName="istio-proxy" containerID="cri-o://e8f9aaafe07bd41aaa1e041b6c858efd3d532ade0f713b9864867e9381f731ec" gracePeriod=30
Sep 18 20:07:16.474479 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:16.474447    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:17.293521 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:17.293492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:17.740387 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:17.740357    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:07:18.097219 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:18.097184    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:18.894317 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:18.894286    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:19.627303 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:19.627271    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:20.404522 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:20.404493    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:20.802719 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:20.802634    2583 scope.go:117] "RemoveContainer" containerID="04be7f221234eb90ee3217be070ac6fe83aa1222006ed68186e6a928b9f71f57"
Sep 18 20:07:21.050466 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.050434    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:21.517704 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.517651    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:07:21.607853 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.607825    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-credential-socket\") pod \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") "
Sep 18 20:07:21.608033 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.607873    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-podinfo\") pod \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") "
Sep 18 20:07:21.608033 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.607905    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-workload-certs\") pod \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") "
Sep 18 20:07:21.608033 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.607922    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-data\") pod \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") "
Sep 18 20:07:21.608033 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.607943    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bqst\" (UniqueName: \"kubernetes.io/projected/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-kube-api-access-8bqst\") pod \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") "
Sep 18 20:07:21.608033 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.607969    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-workload-socket\") pod \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") "
Sep 18 20:07:21.608391 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.608098    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istiod-ca-cert\") pod \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") "
Sep 18 20:07:21.608391 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.608142    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e9747ff9-a1e1-4647-9d43-f0940c6a87a6" (UID: "e9747ff9-a1e1-4647-9d43-f0940c6a87a6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:21.608391 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.608214    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-envoy\") pod \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") "
Sep 18 20:07:21.608391 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.608245    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-token\") pod \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\" (UID: \"e9747ff9-a1e1-4647-9d43-f0940c6a87a6\") "
Sep 18 20:07:21.608391 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.608293    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-data" (OuterVolumeSpecName: "istio-data") pod "e9747ff9-a1e1-4647-9d43-f0940c6a87a6" (UID: "e9747ff9-a1e1-4647-9d43-f0940c6a87a6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:21.608391 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.608334    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e9747ff9-a1e1-4647-9d43-f0940c6a87a6" (UID: "e9747ff9-a1e1-4647-9d43-f0940c6a87a6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:21.608391 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.608350    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e9747ff9-a1e1-4647-9d43-f0940c6a87a6" (UID: "e9747ff9-a1e1-4647-9d43-f0940c6a87a6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:21.608691 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.608570    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e9747ff9-a1e1-4647-9d43-f0940c6a87a6" (UID: "e9747ff9-a1e1-4647-9d43-f0940c6a87a6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:07:21.608691 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.608643    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-workload-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:21.608691 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.608660    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-data\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:21.608691 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.608669    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-workload-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:21.608691 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.608677    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istiod-ca-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:21.608691 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.608685    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-credential-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:21.610472 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.610443    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-token" (OuterVolumeSpecName: "istio-token") pod "e9747ff9-a1e1-4647-9d43-f0940c6a87a6" (UID: "e9747ff9-a1e1-4647-9d43-f0940c6a87a6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:07:21.610589 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.610476    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-kube-api-access-8bqst" (OuterVolumeSpecName: "kube-api-access-8bqst") pod "e9747ff9-a1e1-4647-9d43-f0940c6a87a6" (UID: "e9747ff9-a1e1-4647-9d43-f0940c6a87a6"). InnerVolumeSpecName "kube-api-access-8bqst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:07:21.610658 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.610625    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e9747ff9-a1e1-4647-9d43-f0940c6a87a6" (UID: "e9747ff9-a1e1-4647-9d43-f0940c6a87a6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:21.610658 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.610636    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e9747ff9-a1e1-4647-9d43-f0940c6a87a6" (UID: "e9747ff9-a1e1-4647-9d43-f0940c6a87a6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:07:21.709172 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.709140    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:21.709172 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.709166    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-podinfo\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:21.709172 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.709177    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bqst\" (UniqueName: \"kubernetes.io/projected/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-kube-api-access-8bqst\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:21.709399 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:21.709186    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9747ff9-a1e1-4647-9d43-f0940c6a87a6-istio-envoy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:22.173423 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:22.173391    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:22.295148 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:22.295114    2583 generic.go:356] "Generic (PLEG): container finished" podID="e9747ff9-a1e1-4647-9d43-f0940c6a87a6" containerID="e8f9aaafe07bd41aaa1e041b6c858efd3d532ade0f713b9864867e9381f731ec" exitCode=0
Sep 18 20:07:22.295355 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:22.295181    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"
Sep 18 20:07:22.295355 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:22.295204    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp" event={"ID":"e9747ff9-a1e1-4647-9d43-f0940c6a87a6","Type":"ContainerDied","Data":"e8f9aaafe07bd41aaa1e041b6c858efd3d532ade0f713b9864867e9381f731ec"}
Sep 18 20:07:22.295355 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:22.295292    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp" event={"ID":"e9747ff9-a1e1-4647-9d43-f0940c6a87a6","Type":"ContainerDied","Data":"8ad367e031ba1ebc32caafcd000e4ffa24df80d3ff2689d32edc313baead0928"}
Sep 18 20:07:22.295355 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:22.295323    2583 scope.go:117] "RemoveContainer" containerID="e8f9aaafe07bd41aaa1e041b6c858efd3d532ade0f713b9864867e9381f731ec"
Sep 18 20:07:22.304936 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:22.304920    2583 scope.go:117] "RemoveContainer" containerID="b746a9c3c44366d73c7ae42be601094eeff1b767061aee0886b400f692ab65d1"
Sep 18 20:07:22.313374 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:22.313350    2583 scope.go:117] "RemoveContainer" containerID="e8f9aaafe07bd41aaa1e041b6c858efd3d532ade0f713b9864867e9381f731ec"
Sep 18 20:07:22.313644 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:07:22.313622    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8f9aaafe07bd41aaa1e041b6c858efd3d532ade0f713b9864867e9381f731ec\": container with ID starting with e8f9aaafe07bd41aaa1e041b6c858efd3d532ade0f713b9864867e9381f731ec not found: ID does not exist" containerID="e8f9aaafe07bd41aaa1e041b6c858efd3d532ade0f713b9864867e9381f731ec"
Sep 18 20:07:22.313701 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:22.313657    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8f9aaafe07bd41aaa1e041b6c858efd3d532ade0f713b9864867e9381f731ec"} err="failed to get container status \"e8f9aaafe07bd41aaa1e041b6c858efd3d532ade0f713b9864867e9381f731ec\": rpc error: code = NotFound desc = could not find container \"e8f9aaafe07bd41aaa1e041b6c858efd3d532ade0f713b9864867e9381f731ec\": container with ID starting with e8f9aaafe07bd41aaa1e041b6c858efd3d532ade0f713b9864867e9381f731ec not found: ID does not exist"
Sep 18 20:07:22.313701 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:22.313680    2583 scope.go:117] "RemoveContainer" containerID="b746a9c3c44366d73c7ae42be601094eeff1b767061aee0886b400f692ab65d1"
Sep 18 20:07:22.313937 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:07:22.313921    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b746a9c3c44366d73c7ae42be601094eeff1b767061aee0886b400f692ab65d1\": container with ID starting with b746a9c3c44366d73c7ae42be601094eeff1b767061aee0886b400f692ab65d1 not found: ID does not exist" containerID="b746a9c3c44366d73c7ae42be601094eeff1b767061aee0886b400f692ab65d1"
Sep 18 20:07:22.313981 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:22.313943    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b746a9c3c44366d73c7ae42be601094eeff1b767061aee0886b400f692ab65d1"} err="failed to get container status \"b746a9c3c44366d73c7ae42be601094eeff1b767061aee0886b400f692ab65d1\": rpc error: code = NotFound desc = could not find container \"b746a9c3c44366d73c7ae42be601094eeff1b767061aee0886b400f692ab65d1\": container with ID starting with b746a9c3c44366d73c7ae42be601094eeff1b767061aee0886b400f692ab65d1 not found: ID does not exist"
Sep 18 20:07:22.316295 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:22.316252    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"]
Sep 18 20:07:22.319252 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:22.319234    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-13f9e5-openshift-default-6bbbc64d48-6qvzp"]
Sep 18 20:07:23.811492 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:23.811451    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9747ff9-a1e1-4647-9d43-f0940c6a87a6" path="/var/lib/kubelet/pods/e9747ff9-a1e1-4647-9d43-f0940c6a87a6/volumes"
Sep 18 20:07:26.311519 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:26.311489    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:26.411495 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:26.411469    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:26.846438 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:26.846406    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:26.873740 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:26.873710    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"]
Sep 18 20:07:26.873969 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:26.873944    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f" podUID="4a688ef1-04dc-4339-9b8a-35580391fd63" containerName="payload-processing" containerID="cri-o://d3d2ab79c4e44b6d13b4bcba6028820d67ba857270c1b21641e2a20b7881aca6" gracePeriod=30
Sep 18 20:07:26.882441 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:26.882413    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"]
Sep 18 20:07:26.882807 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:26.882779    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8" podUID="283bb088-5ae9-45d2-8950-ed8ee537bc23" containerName="payload-pre-processing" containerID="cri-o://4a4144ddb68d502ac364d918fbb6d59b347b174bf4fe87d95364f3ca807382c7" gracePeriod=30
Sep 18 20:07:26.916182 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:26.916152    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:26.990674 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:26.990643    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:27.064293 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.064252    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:27.133720 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.133689    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:27.137825 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.137805    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"
Sep 18 20:07:27.157791 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.157766    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcwjn\" (UniqueName: \"kubernetes.io/projected/4a688ef1-04dc-4339-9b8a-35580391fd63-kube-api-access-zcwjn\") pod \"4a688ef1-04dc-4339-9b8a-35580391fd63\" (UID: \"4a688ef1-04dc-4339-9b8a-35580391fd63\") "
Sep 18 20:07:27.157952 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.157935    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a688ef1-04dc-4339-9b8a-35580391fd63-plugins-config-volume\") pod \"4a688ef1-04dc-4339-9b8a-35580391fd63\" (UID: \"4a688ef1-04dc-4339-9b8a-35580391fd63\") "
Sep 18 20:07:27.158509 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.158469    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a688ef1-04dc-4339-9b8a-35580391fd63-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4a688ef1-04dc-4339-9b8a-35580391fd63" (UID: "4a688ef1-04dc-4339-9b8a-35580391fd63"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:07:27.160681 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.160272    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a688ef1-04dc-4339-9b8a-35580391fd63-kube-api-access-zcwjn" (OuterVolumeSpecName: "kube-api-access-zcwjn") pod "4a688ef1-04dc-4339-9b8a-35580391fd63" (UID: "4a688ef1-04dc-4339-9b8a-35580391fd63"). InnerVolumeSpecName "kube-api-access-zcwjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:07:27.160681 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.160488    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"
Sep 18 20:07:27.259536 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.259501    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwmpk\" (UniqueName: \"kubernetes.io/projected/283bb088-5ae9-45d2-8950-ed8ee537bc23-kube-api-access-xwmpk\") pod \"283bb088-5ae9-45d2-8950-ed8ee537bc23\" (UID: \"283bb088-5ae9-45d2-8950-ed8ee537bc23\") "
Sep 18 20:07:27.259745 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.259663    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/283bb088-5ae9-45d2-8950-ed8ee537bc23-plugins-config-volume\") pod \"283bb088-5ae9-45d2-8950-ed8ee537bc23\" (UID: \"283bb088-5ae9-45d2-8950-ed8ee537bc23\") "
Sep 18 20:07:27.259918 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.259901    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4a688ef1-04dc-4339-9b8a-35580391fd63-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:27.260057 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.259920    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcwjn\" (UniqueName: \"kubernetes.io/projected/4a688ef1-04dc-4339-9b8a-35580391fd63-kube-api-access-zcwjn\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:27.260123 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.260094    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/283bb088-5ae9-45d2-8950-ed8ee537bc23-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "283bb088-5ae9-45d2-8950-ed8ee537bc23" (UID: "283bb088-5ae9-45d2-8950-ed8ee537bc23"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:07:27.261759 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.261734    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/283bb088-5ae9-45d2-8950-ed8ee537bc23-kube-api-access-xwmpk" (OuterVolumeSpecName: "kube-api-access-xwmpk") pod "283bb088-5ae9-45d2-8950-ed8ee537bc23" (UID: "283bb088-5ae9-45d2-8950-ed8ee537bc23"). InnerVolumeSpecName "kube-api-access-xwmpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:07:27.326418 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.326387    2583 generic.go:356] "Generic (PLEG): container finished" podID="283bb088-5ae9-45d2-8950-ed8ee537bc23" containerID="4a4144ddb68d502ac364d918fbb6d59b347b174bf4fe87d95364f3ca807382c7" exitCode=0
Sep 18 20:07:27.326834 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.326442    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"
Sep 18 20:07:27.326834 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.326476    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8" event={"ID":"283bb088-5ae9-45d2-8950-ed8ee537bc23","Type":"ContainerDied","Data":"4a4144ddb68d502ac364d918fbb6d59b347b174bf4fe87d95364f3ca807382c7"}
Sep 18 20:07:27.326834 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.326554    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8" event={"ID":"283bb088-5ae9-45d2-8950-ed8ee537bc23","Type":"ContainerDied","Data":"d57f6cf762da62db8db2b2832b7ae6d9263ec748d03041c5395f26314ee7df49"}
Sep 18 20:07:27.326834 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.326583    2583 scope.go:117] "RemoveContainer" containerID="4a4144ddb68d502ac364d918fbb6d59b347b174bf4fe87d95364f3ca807382c7"
Sep 18 20:07:27.328082 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.328033    2583 generic.go:356] "Generic (PLEG): container finished" podID="4a688ef1-04dc-4339-9b8a-35580391fd63" containerID="d3d2ab79c4e44b6d13b4bcba6028820d67ba857270c1b21641e2a20b7881aca6" exitCode=0
Sep 18 20:07:27.328182 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.328087    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f" event={"ID":"4a688ef1-04dc-4339-9b8a-35580391fd63","Type":"ContainerDied","Data":"d3d2ab79c4e44b6d13b4bcba6028820d67ba857270c1b21641e2a20b7881aca6"}
Sep 18 20:07:27.328182 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.328115    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"
Sep 18 20:07:27.328182 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.328141    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f" event={"ID":"4a688ef1-04dc-4339-9b8a-35580391fd63","Type":"ContainerDied","Data":"b1fd67787f73e2be9752c34c10b25cf8af6095c29c30dd7c3c6736bfa53886a3"}
Sep 18 20:07:27.336379 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.336361    2583 scope.go:117] "RemoveContainer" containerID="4a4144ddb68d502ac364d918fbb6d59b347b174bf4fe87d95364f3ca807382c7"
Sep 18 20:07:27.336759 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:07:27.336733    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a4144ddb68d502ac364d918fbb6d59b347b174bf4fe87d95364f3ca807382c7\": container with ID starting with 4a4144ddb68d502ac364d918fbb6d59b347b174bf4fe87d95364f3ca807382c7 not found: ID does not exist" containerID="4a4144ddb68d502ac364d918fbb6d59b347b174bf4fe87d95364f3ca807382c7"
Sep 18 20:07:27.336842 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.336769    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a4144ddb68d502ac364d918fbb6d59b347b174bf4fe87d95364f3ca807382c7"} err="failed to get container status \"4a4144ddb68d502ac364d918fbb6d59b347b174bf4fe87d95364f3ca807382c7\": rpc error: code = NotFound desc = could not find container \"4a4144ddb68d502ac364d918fbb6d59b347b174bf4fe87d95364f3ca807382c7\": container with ID starting with 4a4144ddb68d502ac364d918fbb6d59b347b174bf4fe87d95364f3ca807382c7 not found: ID does not exist"
Sep 18 20:07:27.336842 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.336786    2583 scope.go:117] "RemoveContainer" containerID="d3d2ab79c4e44b6d13b4bcba6028820d67ba857270c1b21641e2a20b7881aca6"
Sep 18 20:07:27.345117 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.345096    2583 scope.go:117] "RemoveContainer" containerID="d3d2ab79c4e44b6d13b4bcba6028820d67ba857270c1b21641e2a20b7881aca6"
Sep 18 20:07:27.345367 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:07:27.345349    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3d2ab79c4e44b6d13b4bcba6028820d67ba857270c1b21641e2a20b7881aca6\": container with ID starting with d3d2ab79c4e44b6d13b4bcba6028820d67ba857270c1b21641e2a20b7881aca6 not found: ID does not exist" containerID="d3d2ab79c4e44b6d13b4bcba6028820d67ba857270c1b21641e2a20b7881aca6"
Sep 18 20:07:27.345434 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.345374    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d2ab79c4e44b6d13b4bcba6028820d67ba857270c1b21641e2a20b7881aca6"} err="failed to get container status \"d3d2ab79c4e44b6d13b4bcba6028820d67ba857270c1b21641e2a20b7881aca6\": rpc error: code = NotFound desc = could not find container \"d3d2ab79c4e44b6d13b4bcba6028820d67ba857270c1b21641e2a20b7881aca6\": container with ID starting with d3d2ab79c4e44b6d13b4bcba6028820d67ba857270c1b21641e2a20b7881aca6 not found: ID does not exist"
Sep 18 20:07:27.352010 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.351987    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"]
Sep 18 20:07:27.355673 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.355619    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-047bea-79c8548487-pl44f"]
Sep 18 20:07:27.360379 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.360359    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/283bb088-5ae9-45d2-8950-ed8ee537bc23-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:27.360379 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.360380    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwmpk\" (UniqueName: \"kubernetes.io/projected/283bb088-5ae9-45d2-8950-ed8ee537bc23-kube-api-access-xwmpk\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:27.367735 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.367712    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"]
Sep 18 20:07:27.371756 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.371738    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-047bea-b5bb575b6-pwps8"]
Sep 18 20:07:27.410137 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.410111    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:27.584724 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.584683    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:27.812587 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.812510    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="283bb088-5ae9-45d2-8950-ed8ee537bc23" path="/var/lib/kubelet/pods/283bb088-5ae9-45d2-8950-ed8ee537bc23/volumes"
Sep 18 20:07:27.812895 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:27.812881    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a688ef1-04dc-4339-9b8a-35580391fd63" path="/var/lib/kubelet/pods/4a688ef1-04dc-4339-9b8a-35580391fd63/volumes"
Sep 18 20:07:28.391746 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:28.391721    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:29.194387 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:29.194352    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:30.009726 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:30.009697    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:30.802106 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:30.802079    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:33.357143 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.357067    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:33.428843 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.428811    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:33.673064 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.672968    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:33.972962 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.972878    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5"]
Sep 18 20:07:33.973318 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973303    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9747ff9-a1e1-4647-9d43-f0940c6a87a6" containerName="istio-proxy"
Sep 18 20:07:33.973361 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973321    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9747ff9-a1e1-4647-9d43-f0940c6a87a6" containerName="istio-proxy"
Sep 18 20:07:33.973361 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973334    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9747ff9-a1e1-4647-9d43-f0940c6a87a6" containerName="istio-proxy"
Sep 18 20:07:33.973361 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973339    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9747ff9-a1e1-4647-9d43-f0940c6a87a6" containerName="istio-proxy"
Sep 18 20:07:33.973361 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973346    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f81bea2d-4d78-472f-bbdc-ba2b84f24009" containerName="main"
Sep 18 20:07:33.973361 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973352    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f81bea2d-4d78-472f-bbdc-ba2b84f24009" containerName="main"
Sep 18 20:07:33.973361 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973359    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973366    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973375    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a688ef1-04dc-4339-9b8a-35580391fd63" containerName="payload-processing"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973381    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a688ef1-04dc-4339-9b8a-35580391fd63" containerName="payload-processing"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973387    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973392    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973402    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="283bb088-5ae9-45d2-8950-ed8ee537bc23" containerName="payload-pre-processing"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973409    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="283bb088-5ae9-45d2-8950-ed8ee537bc23" containerName="payload-pre-processing"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973418    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58456903-d621-4c85-b933-f1fa3f902539" containerName="payload-pre-processing"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973428    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="58456903-d621-4c85-b933-f1fa3f902539" containerName="payload-pre-processing"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973440    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="565bf657-eac2-4f75-8091-22d6f7da18c1" containerName="revoke-keys"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973448    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="565bf657-eac2-4f75-8091-22d6f7da18c1" containerName="revoke-keys"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973463    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10bcb6ab-2d96-4b34-8987-2284ac9dc212" containerName="payload-processing"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973468    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="10bcb6ab-2d96-4b34-8987-2284ac9dc212" containerName="payload-processing"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973478    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec88288-e2a0-416d-b2c9-9dcde525e7a5" containerName="main"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973483    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec88288-e2a0-416d-b2c9-9dcde525e7a5" containerName="main"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973563    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="283bb088-5ae9-45d2-8950-ed8ee537bc23" containerName="payload-pre-processing"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973570    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="10bcb6ab-2d96-4b34-8987-2284ac9dc212" containerName="payload-processing"
Sep 18 20:07:33.973571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973578    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9747ff9-a1e1-4647-9d43-f0940c6a87a6" containerName="istio-proxy"
Sep 18 20:07:33.974147 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973585    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy"
Sep 18 20:07:33.974147 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973590    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="565bf657-eac2-4f75-8091-22d6f7da18c1" containerName="revoke-keys"
Sep 18 20:07:33.974147 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973596    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f81bea2d-4d78-472f-bbdc-ba2b84f24009" containerName="main"
Sep 18 20:07:33.974147 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973601    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9747ff9-a1e1-4647-9d43-f0940c6a87a6" containerName="istio-proxy"
Sep 18 20:07:33.974147 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973606    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dec88288-e2a0-416d-b2c9-9dcde525e7a5" containerName="main"
Sep 18 20:07:33.974147 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973612    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="58456903-d621-4c85-b933-f1fa3f902539" containerName="payload-pre-processing"
Sep 18 20:07:33.974147 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973617    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="321193d0-1af6-4ab1-a058-8a551ea80092" containerName="istio-proxy"
Sep 18 20:07:33.974147 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.973623    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a688ef1-04dc-4339-9b8a-35580391fd63" containerName="payload-processing"
Sep 18 20:07:33.978175 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.978155    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5"
Sep 18 20:07:33.980892 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.980872    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 20:07:33.981107 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.981086    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 20:07:33.986024 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:33.985987    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5"]
Sep 18 20:07:34.034429 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:34.034400    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9694a955-17f9-4d8a-99e7-fc2d51240241-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5\" (UID: \"9694a955-17f9-4d8a-99e7-fc2d51240241\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5"
Sep 18 20:07:34.135964 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:34.135926    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9694a955-17f9-4d8a-99e7-fc2d51240241-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5\" (UID: \"9694a955-17f9-4d8a-99e7-fc2d51240241\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5"
Sep 18 20:07:34.136570 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:34.136551    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9694a955-17f9-4d8a-99e7-fc2d51240241-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5\" (UID: \"9694a955-17f9-4d8a-99e7-fc2d51240241\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5"
Sep 18 20:07:34.291382 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:34.291307    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5"
Sep 18 20:07:34.316243 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:34.316220    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:34.569614 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:34.569580    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5"]
Sep 18 20:07:34.570300 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:07:34.570275    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9694a955_17f9_4d8a_99e7_fc2d51240241.slice/crio-1567f097efc6866adf9378c34ad727ac92dc740b7f62eec63d2423e5a108475b WatchSource:0}: Error finding container 1567f097efc6866adf9378c34ad727ac92dc740b7f62eec63d2423e5a108475b: Status 404 returned error can't find the container with id 1567f097efc6866adf9378c34ad727ac92dc740b7f62eec63d2423e5a108475b
Sep 18 20:07:35.024762 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:35.024730    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:35.389772 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:35.389738    2583 generic.go:356] "Generic (PLEG): container finished" podID="9694a955-17f9-4d8a-99e7-fc2d51240241" containerID="6bf5255c89387a632a095a8fb56de54c6dc1caad6ddd616776f6cf51ef13f46f" exitCode=0
Sep 18 20:07:35.389978 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:35.389824    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5" event={"ID":"9694a955-17f9-4d8a-99e7-fc2d51240241","Type":"ContainerDied","Data":"6bf5255c89387a632a095a8fb56de54c6dc1caad6ddd616776f6cf51ef13f46f"}
Sep 18 20:07:35.389978 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:35.389890    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5" event={"ID":"9694a955-17f9-4d8a-99e7-fc2d51240241","Type":"ContainerStarted","Data":"1567f097efc6866adf9378c34ad727ac92dc740b7f62eec63d2423e5a108475b"}
Sep 18 20:07:35.715506 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:35.715419    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:36.513634 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:36.513591    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:36.532337 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:36.532315    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5"
Sep 18 20:07:36.661568 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:36.661485    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9694a955-17f9-4d8a-99e7-fc2d51240241-maas-api-service-ca\") pod \"9694a955-17f9-4d8a-99e7-fc2d51240241\" (UID: \"9694a955-17f9-4d8a-99e7-fc2d51240241\") "
Sep 18 20:07:36.661804 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:36.661783    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9694a955-17f9-4d8a-99e7-fc2d51240241-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9694a955-17f9-4d8a-99e7-fc2d51240241" (UID: "9694a955-17f9-4d8a-99e7-fc2d51240241"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:07:36.762503 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:36.762475    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9694a955-17f9-4d8a-99e7-fc2d51240241-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:37.194564 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:37.194536    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:37.403276 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:37.403253    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5"
Sep 18 20:07:37.403276 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:37.403261    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5" event={"ID":"9694a955-17f9-4d8a-99e7-fc2d51240241","Type":"ContainerDied","Data":"1567f097efc6866adf9378c34ad727ac92dc740b7f62eec63d2423e5a108475b"}
Sep 18 20:07:37.403480 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:37.403299    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1567f097efc6866adf9378c34ad727ac92dc740b7f62eec63d2423e5a108475b"
Sep 18 20:07:37.909927 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:37.909896    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:44.591687 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:44.591645    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:44.650928 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:44.650892    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"]
Sep 18 20:07:44.651193 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:44.651168    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8" podUID="733f96f7-c46f-476e-93ca-b97347780652" containerName="payload-processing" containerID="cri-o://52d643c19b174762ac2054a941fb7cd4ff33527dd12302469a0e022c1f1ca77f" gracePeriod=30
Sep 18 20:07:44.681815 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:44.681791    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:44.783659 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:44.783626    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:44.840814 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:44.840702    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5"]
Sep 18 20:07:44.844890 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:44.844822    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-9838c2-z5sh5"]
Sep 18 20:07:44.861447 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:44.861404    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:44.915988 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:44.915942    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"
Sep 18 20:07:45.043679 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.043645    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/733f96f7-c46f-476e-93ca-b97347780652-plugins-config-volume\") pod \"733f96f7-c46f-476e-93ca-b97347780652\" (UID: \"733f96f7-c46f-476e-93ca-b97347780652\") "
Sep 18 20:07:45.043882 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.043688    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bvbp\" (UniqueName: \"kubernetes.io/projected/733f96f7-c46f-476e-93ca-b97347780652-kube-api-access-7bvbp\") pod \"733f96f7-c46f-476e-93ca-b97347780652\" (UID: \"733f96f7-c46f-476e-93ca-b97347780652\") "
Sep 18 20:07:45.044179 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.044150    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/733f96f7-c46f-476e-93ca-b97347780652-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "733f96f7-c46f-476e-93ca-b97347780652" (UID: "733f96f7-c46f-476e-93ca-b97347780652"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:07:45.046032 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.045997    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/733f96f7-c46f-476e-93ca-b97347780652-kube-api-access-7bvbp" (OuterVolumeSpecName: "kube-api-access-7bvbp") pod "733f96f7-c46f-476e-93ca-b97347780652" (UID: "733f96f7-c46f-476e-93ca-b97347780652"). InnerVolumeSpecName "kube-api-access-7bvbp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:07:45.145273 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.145193    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/733f96f7-c46f-476e-93ca-b97347780652-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:45.145273 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.145222    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bvbp\" (UniqueName: \"kubernetes.io/projected/733f96f7-c46f-476e-93ca-b97347780652-kube-api-access-7bvbp\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:45.188538 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.188507    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:45.250799 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.250764    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:45.452065 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.451954    2583 generic.go:356] "Generic (PLEG): container finished" podID="733f96f7-c46f-476e-93ca-b97347780652" containerID="52d643c19b174762ac2054a941fb7cd4ff33527dd12302469a0e022c1f1ca77f" exitCode=0
Sep 18 20:07:45.452065 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.452014    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"
Sep 18 20:07:45.452065 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.452055    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8" event={"ID":"733f96f7-c46f-476e-93ca-b97347780652","Type":"ContainerDied","Data":"52d643c19b174762ac2054a941fb7cd4ff33527dd12302469a0e022c1f1ca77f"}
Sep 18 20:07:45.452283 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.452131    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8" event={"ID":"733f96f7-c46f-476e-93ca-b97347780652","Type":"ContainerDied","Data":"f746930722f624f4019dc8ba7cb1d07bdebcf171db3212651cb27cb62745ad89"}
Sep 18 20:07:45.452283 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.452155    2583 scope.go:117] "RemoveContainer" containerID="52d643c19b174762ac2054a941fb7cd4ff33527dd12302469a0e022c1f1ca77f"
Sep 18 20:07:45.462049 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.462018    2583 scope.go:117] "RemoveContainer" containerID="52d643c19b174762ac2054a941fb7cd4ff33527dd12302469a0e022c1f1ca77f"
Sep 18 20:07:45.462353 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:07:45.462330    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52d643c19b174762ac2054a941fb7cd4ff33527dd12302469a0e022c1f1ca77f\": container with ID starting with 52d643c19b174762ac2054a941fb7cd4ff33527dd12302469a0e022c1f1ca77f not found: ID does not exist" containerID="52d643c19b174762ac2054a941fb7cd4ff33527dd12302469a0e022c1f1ca77f"
Sep 18 20:07:45.462410 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.462363    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52d643c19b174762ac2054a941fb7cd4ff33527dd12302469a0e022c1f1ca77f"} err="failed to get container status \"52d643c19b174762ac2054a941fb7cd4ff33527dd12302469a0e022c1f1ca77f\": rpc error: code = NotFound desc = could not find container \"52d643c19b174762ac2054a941fb7cd4ff33527dd12302469a0e022c1f1ca77f\": container with ID starting with 52d643c19b174762ac2054a941fb7cd4ff33527dd12302469a0e022c1f1ca77f not found: ID does not exist"
Sep 18 20:07:45.475242 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.475218    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"]
Sep 18 20:07:45.477583 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.477564    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-9838c2-5c97498b45-2xqz8"]
Sep 18 20:07:45.812355 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.812280    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="733f96f7-c46f-476e-93ca-b97347780652" path="/var/lib/kubelet/pods/733f96f7-c46f-476e-93ca-b97347780652/volumes"
Sep 18 20:07:45.812712 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:45.812631    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9694a955-17f9-4d8a-99e7-fc2d51240241" path="/var/lib/kubelet/pods/9694a955-17f9-4d8a-99e7-fc2d51240241/volumes"
Sep 18 20:07:46.033658 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:46.033627    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:46.714950 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:46.714908    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:47.395899 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:47.395866    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:51.145467 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:51.145429    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:51.220207 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:51.220180    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:51.372843 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:51.372807    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"]
Sep 18 20:07:51.373127 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:51.373078    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m" podUID="06c38514-0a40-4293-b06d-3ccdf0a46688" containerName="istio-proxy" containerID="cri-o://d6a3ba33be03b7aa5e9913219f9cb4dc3e6c25245620b51e0fc60c817227d1ad" gracePeriod=30
Sep 18 20:07:51.390993 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:51.390970    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:56.538737 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.538703    2583 generic.go:356] "Generic (PLEG): container finished" podID="06c38514-0a40-4293-b06d-3ccdf0a46688" containerID="d6a3ba33be03b7aa5e9913219f9cb4dc3e6c25245620b51e0fc60c817227d1ad" exitCode=0
Sep 18 20:07:56.539199 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.538780    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m" event={"ID":"06c38514-0a40-4293-b06d-3ccdf0a46688","Type":"ContainerDied","Data":"d6a3ba33be03b7aa5e9913219f9cb4dc3e6c25245620b51e0fc60c817227d1ad"}
Sep 18 20:07:56.539199 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.538842    2583 scope.go:117] "RemoveContainer" containerID="557de4117508b507db440e942eaffa600366f06b988af8b4a619baf69d9278f2"
Sep 18 20:07:56.627819 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.627798    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:07:56.650420 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.650295    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-token\") pod \"06c38514-0a40-4293-b06d-3ccdf0a46688\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") "
Sep 18 20:07:56.650420 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.650361    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-podinfo\") pod \"06c38514-0a40-4293-b06d-3ccdf0a46688\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") "
Sep 18 20:07:56.650420 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.650403    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-workload-certs\") pod \"06c38514-0a40-4293-b06d-3ccdf0a46688\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") "
Sep 18 20:07:56.650420 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.650424    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-data\") pod \"06c38514-0a40-4293-b06d-3ccdf0a46688\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") "
Sep 18 20:07:56.650751 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.650489    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drpd7\" (UniqueName: \"kubernetes.io/projected/06c38514-0a40-4293-b06d-3ccdf0a46688-kube-api-access-drpd7\") pod \"06c38514-0a40-4293-b06d-3ccdf0a46688\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") "
Sep 18 20:07:56.650751 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.650527    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-credential-socket\") pod \"06c38514-0a40-4293-b06d-3ccdf0a46688\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") "
Sep 18 20:07:56.650751 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.650554    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06c38514-0a40-4293-b06d-3ccdf0a46688-istiod-ca-cert\") pod \"06c38514-0a40-4293-b06d-3ccdf0a46688\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") "
Sep 18 20:07:56.650751 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.650576    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-workload-socket\") pod \"06c38514-0a40-4293-b06d-3ccdf0a46688\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") "
Sep 18 20:07:56.650751 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.650605    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-envoy\") pod \"06c38514-0a40-4293-b06d-3ccdf0a46688\" (UID: \"06c38514-0a40-4293-b06d-3ccdf0a46688\") "
Sep 18 20:07:56.652116 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.651371    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "06c38514-0a40-4293-b06d-3ccdf0a46688" (UID: "06c38514-0a40-4293-b06d-3ccdf0a46688"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:56.652116 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.651539    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-data" (OuterVolumeSpecName: "istio-data") pod "06c38514-0a40-4293-b06d-3ccdf0a46688" (UID: "06c38514-0a40-4293-b06d-3ccdf0a46688"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:56.652116 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.651841    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "06c38514-0a40-4293-b06d-3ccdf0a46688" (UID: "06c38514-0a40-4293-b06d-3ccdf0a46688"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:56.652116 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.651905    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "06c38514-0a40-4293-b06d-3ccdf0a46688" (UID: "06c38514-0a40-4293-b06d-3ccdf0a46688"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:56.652116 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.652079    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06c38514-0a40-4293-b06d-3ccdf0a46688-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "06c38514-0a40-4293-b06d-3ccdf0a46688" (UID: "06c38514-0a40-4293-b06d-3ccdf0a46688"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:07:56.653218 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.653193    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c38514-0a40-4293-b06d-3ccdf0a46688-kube-api-access-drpd7" (OuterVolumeSpecName: "kube-api-access-drpd7") pod "06c38514-0a40-4293-b06d-3ccdf0a46688" (UID: "06c38514-0a40-4293-b06d-3ccdf0a46688"). InnerVolumeSpecName "kube-api-access-drpd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:07:56.653325 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.653192    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-token" (OuterVolumeSpecName: "istio-token") pod "06c38514-0a40-4293-b06d-3ccdf0a46688" (UID: "06c38514-0a40-4293-b06d-3ccdf0a46688"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:07:56.654179 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.654154    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "06c38514-0a40-4293-b06d-3ccdf0a46688" (UID: "06c38514-0a40-4293-b06d-3ccdf0a46688"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:07:56.654957 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.654938    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "06c38514-0a40-4293-b06d-3ccdf0a46688" (UID: "06c38514-0a40-4293-b06d-3ccdf0a46688"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:07:56.752013 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.751983    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-workload-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:56.752013 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.752006    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-data\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:56.752013 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.752014    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drpd7\" (UniqueName: \"kubernetes.io/projected/06c38514-0a40-4293-b06d-3ccdf0a46688-kube-api-access-drpd7\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:56.752283 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.752025    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-credential-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:56.752283 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.752035    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/06c38514-0a40-4293-b06d-3ccdf0a46688-istiod-ca-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:56.752283 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.752070    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-workload-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:56.752283 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.752078    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-envoy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:56.752283 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.752086    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:56.752283 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:56.752093    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/06c38514-0a40-4293-b06d-3ccdf0a46688-istio-podinfo\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:07:57.546254 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:57.546224    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"
Sep 18 20:07:57.546671 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:57.546263    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m" event={"ID":"06c38514-0a40-4293-b06d-3ccdf0a46688","Type":"ContainerDied","Data":"6bdae1df9e986e76c92a3981bdaefc34c45c159d82cebcbd6e08bf257358535b"}
Sep 18 20:07:57.546671 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:57.546319    2583 scope.go:117] "RemoveContainer" containerID="d6a3ba33be03b7aa5e9913219f9cb4dc3e6c25245620b51e0fc60c817227d1ad"
Sep 18 20:07:57.571683 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:57.571657    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"]
Sep 18 20:07:57.578412 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:57.578392    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-9838c2-openshift-default-7cb447d75d-qjh9m"]
Sep 18 20:07:57.812063 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:57.811933    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06c38514-0a40-4293-b06d-3ccdf0a46688" path="/var/lib/kubelet/pods/06c38514-0a40-4293-b06d-3ccdf0a46688/volumes"
Sep 18 20:07:58.784530 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.784496    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:58.897082 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.897021    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc"]
Sep 18 20:07:58.897499 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.897480    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="733f96f7-c46f-476e-93ca-b97347780652" containerName="payload-processing"
Sep 18 20:07:58.897590 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.897502    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="733f96f7-c46f-476e-93ca-b97347780652" containerName="payload-processing"
Sep 18 20:07:58.897590 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.897522    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9694a955-17f9-4d8a-99e7-fc2d51240241" containerName="revoke-keys"
Sep 18 20:07:58.897590 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.897529    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9694a955-17f9-4d8a-99e7-fc2d51240241" containerName="revoke-keys"
Sep 18 20:07:58.897590 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.897542    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06c38514-0a40-4293-b06d-3ccdf0a46688" containerName="istio-proxy"
Sep 18 20:07:58.897590 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.897551    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c38514-0a40-4293-b06d-3ccdf0a46688" containerName="istio-proxy"
Sep 18 20:07:58.897838 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.897674    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="06c38514-0a40-4293-b06d-3ccdf0a46688" containerName="istio-proxy"
Sep 18 20:07:58.897838 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.897686    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="733f96f7-c46f-476e-93ca-b97347780652" containerName="payload-processing"
Sep 18 20:07:58.897838 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.897698    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9694a955-17f9-4d8a-99e7-fc2d51240241" containerName="revoke-keys"
Sep 18 20:07:58.897838 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.897706    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="06c38514-0a40-4293-b06d-3ccdf0a46688" containerName="istio-proxy"
Sep 18 20:07:58.902233 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.902214    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc"
Sep 18 20:07:58.905622 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.905592    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 20:07:58.905850 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.905821    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 20:07:58.907857 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.907832    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc"]
Sep 18 20:07:58.976268 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:58.976237    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc\" (UID: \"ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc"
Sep 18 20:07:59.077425 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:59.077347    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc\" (UID: \"ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc"
Sep 18 20:07:59.077934 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:59.077917    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc\" (UID: \"ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc"
Sep 18 20:07:59.198459 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:59.198422    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:07:59.214393 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:59.214371    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc"
Sep 18 20:07:59.495183 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:59.495158    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc"]
Sep 18 20:07:59.496620 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:07:59.496595    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef2b72f5_8a88_42ea_b112_0c0a2fa7d99b.slice/crio-02c6041effc0d8d39144084dce2e5e573f7ec1d359f56437070ca485bf40016c WatchSource:0}: Error finding container 02c6041effc0d8d39144084dce2e5e573f7ec1d359f56437070ca485bf40016c: Status 404 returned error can't find the container with id 02c6041effc0d8d39144084dce2e5e573f7ec1d359f56437070ca485bf40016c
Sep 18 20:07:59.558772 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:07:59.558745    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc" event={"ID":"ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b","Type":"ContainerStarted","Data":"02c6041effc0d8d39144084dce2e5e573f7ec1d359f56437070ca485bf40016c"}
Sep 18 20:08:00.122362 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:00.122321    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:00.565919 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:00.565817    2583 generic.go:356] "Generic (PLEG): container finished" podID="ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b" containerID="9e495cce8b6e01818e9df181a2790c6530a1e55285880708c6ab424676728837" exitCode=0
Sep 18 20:08:00.565919 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:00.565905    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc" event={"ID":"ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b","Type":"ContainerDied","Data":"9e495cce8b6e01818e9df181a2790c6530a1e55285880708c6ab424676728837"}
Sep 18 20:08:00.804215 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:00.804180    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:01.532943 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:01.532901    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:01.705940 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:01.705913    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc"
Sep 18 20:08:01.804595 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:01.804523    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b-maas-api-service-ca\") pod \"ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b\" (UID: \"ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b\") "
Sep 18 20:08:01.804844 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:01.804820    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b" (UID: "ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:08:01.906314 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:01.906279    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:02.334074 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:02.334019    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:02.580425 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:02.580394    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc"
Sep 18 20:08:02.580782 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:02.580427    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc" event={"ID":"ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b","Type":"ContainerDied","Data":"02c6041effc0d8d39144084dce2e5e573f7ec1d359f56437070ca485bf40016c"}
Sep 18 20:08:02.580782 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:02.580469    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02c6041effc0d8d39144084dce2e5e573f7ec1d359f56437070ca485bf40016c"
Sep 18 20:08:03.768670 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:03.768643    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"]
Sep 18 20:08:03.854765 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:03.854733    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:13.337214 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:13.337181    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:14.638100 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:14.638066    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-674263-29829360-49cg2"]
Sep 18 20:08:14.640623 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:14.640592    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-674263-29829360-49cg2"]
Sep 18 20:08:14.647624 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:14.647599    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:14.684519 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:14.684479    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"]
Sep 18 20:08:14.684937 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:14.684883    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl" podUID="30f387e2-bba9-4cc8-a083-c76caf24002d" containerName="payload-pre-processing" containerID="cri-o://73d350d8bc3e8543194b77458d51969b4017c40158c472ece627cfeb165fa150" gracePeriod=30
Sep 18 20:08:14.745790 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:14.745760    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:14.850687 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:14.850650    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:14.869257 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:14.869228    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc"]
Sep 18 20:08:14.873302 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:14.873271    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-674263-qqdsc"]
Sep 18 20:08:14.938289 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:14.938263    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:14.946274 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:14.946255    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"
Sep 18 20:08:15.027419 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.027384    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9fpq\" (UniqueName: \"kubernetes.io/projected/30f387e2-bba9-4cc8-a083-c76caf24002d-kube-api-access-j9fpq\") pod \"30f387e2-bba9-4cc8-a083-c76caf24002d\" (UID: \"30f387e2-bba9-4cc8-a083-c76caf24002d\") "
Sep 18 20:08:15.027596 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.027470    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30f387e2-bba9-4cc8-a083-c76caf24002d-plugins-config-volume\") pod \"30f387e2-bba9-4cc8-a083-c76caf24002d\" (UID: \"30f387e2-bba9-4cc8-a083-c76caf24002d\") "
Sep 18 20:08:15.027965 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.027930    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30f387e2-bba9-4cc8-a083-c76caf24002d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "30f387e2-bba9-4cc8-a083-c76caf24002d" (UID: "30f387e2-bba9-4cc8-a083-c76caf24002d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:08:15.029746 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.029715    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30f387e2-bba9-4cc8-a083-c76caf24002d-kube-api-access-j9fpq" (OuterVolumeSpecName: "kube-api-access-j9fpq") pod "30f387e2-bba9-4cc8-a083-c76caf24002d" (UID: "30f387e2-bba9-4cc8-a083-c76caf24002d"). InnerVolumeSpecName "kube-api-access-j9fpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:08:15.128573 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.128539    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9fpq\" (UniqueName: \"kubernetes.io/projected/30f387e2-bba9-4cc8-a083-c76caf24002d-kube-api-access-j9fpq\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:15.128573 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.128567    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30f387e2-bba9-4cc8-a083-c76caf24002d-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:15.216466 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.216369    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:15.316304 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.316273    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:15.666167 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.666129    2583 generic.go:356] "Generic (PLEG): container finished" podID="30f387e2-bba9-4cc8-a083-c76caf24002d" containerID="73d350d8bc3e8543194b77458d51969b4017c40158c472ece627cfeb165fa150" exitCode=0
Sep 18 20:08:15.666573 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.666177    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"
Sep 18 20:08:15.666573 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.666206    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl" event={"ID":"30f387e2-bba9-4cc8-a083-c76caf24002d","Type":"ContainerDied","Data":"73d350d8bc3e8543194b77458d51969b4017c40158c472ece627cfeb165fa150"}
Sep 18 20:08:15.666573 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.666260    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl" event={"ID":"30f387e2-bba9-4cc8-a083-c76caf24002d","Type":"ContainerDied","Data":"b276227d402f1ddd2bf7c8622d1a550f046bc7bce0adc67ca4bf47dc19864a46"}
Sep 18 20:08:15.666573 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.666283    2583 scope.go:117] "RemoveContainer" containerID="73d350d8bc3e8543194b77458d51969b4017c40158c472ece627cfeb165fa150"
Sep 18 20:08:15.676474 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.676450    2583 scope.go:117] "RemoveContainer" containerID="73d350d8bc3e8543194b77458d51969b4017c40158c472ece627cfeb165fa150"
Sep 18 20:08:15.676761 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:08:15.676742    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d350d8bc3e8543194b77458d51969b4017c40158c472ece627cfeb165fa150\": container with ID starting with 73d350d8bc3e8543194b77458d51969b4017c40158c472ece627cfeb165fa150 not found: ID does not exist" containerID="73d350d8bc3e8543194b77458d51969b4017c40158c472ece627cfeb165fa150"
Sep 18 20:08:15.676818 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.676774    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d350d8bc3e8543194b77458d51969b4017c40158c472ece627cfeb165fa150"} err="failed to get container status \"73d350d8bc3e8543194b77458d51969b4017c40158c472ece627cfeb165fa150\": rpc error: code = NotFound desc = could not find container \"73d350d8bc3e8543194b77458d51969b4017c40158c472ece627cfeb165fa150\": container with ID starting with 73d350d8bc3e8543194b77458d51969b4017c40158c472ece627cfeb165fa150 not found: ID does not exist"
Sep 18 20:08:15.689086 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.689026    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"]
Sep 18 20:08:15.691633 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.691612    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-674263-579fb89d74-nrhfl"]
Sep 18 20:08:15.810926 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.810898    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30f387e2-bba9-4cc8-a083-c76caf24002d" path="/var/lib/kubelet/pods/30f387e2-bba9-4cc8-a083-c76caf24002d/volumes"
Sep 18 20:08:15.811243 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.811230    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6136b913-ec7e-4387-818e-b4242ea66554" path="/var/lib/kubelet/pods/6136b913-ec7e-4387-818e-b4242ea66554/volumes"
Sep 18 20:08:15.811487 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:15.811475    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b" path="/var/lib/kubelet/pods/ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b/volumes"
Sep 18 20:08:16.081162 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:16.081065    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:16.743796 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:16.743763    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:18.788284 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:18.788242    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr" podUID="eace68a3-665f-4398-b5e3-142bca516e96" containerName="main" containerID="cri-o://cf68fe1133acb22c21b91c12a2a55cef478a0951e136d798cba8c8766419ac96" gracePeriod=45
Sep 18 20:08:19.052953 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.052897    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:08:19.167390 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.167356    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wkn8\" (UniqueName: \"kubernetes.io/projected/eace68a3-665f-4398-b5e3-142bca516e96-kube-api-access-7wkn8\") pod \"eace68a3-665f-4398-b5e3-142bca516e96\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") "
Sep 18 20:08:19.167588 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.167434    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-home\") pod \"eace68a3-665f-4398-b5e3-142bca516e96\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") "
Sep 18 20:08:19.167588 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.167513    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-model-cache\") pod \"eace68a3-665f-4398-b5e3-142bca516e96\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") "
Sep 18 20:08:19.167588 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.167546    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-dshm\") pod \"eace68a3-665f-4398-b5e3-142bca516e96\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") "
Sep 18 20:08:19.167773 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.167602    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eace68a3-665f-4398-b5e3-142bca516e96-tls-certs\") pod \"eace68a3-665f-4398-b5e3-142bca516e96\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") "
Sep 18 20:08:19.167773 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.167625    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-tmp-dir\") pod \"eace68a3-665f-4398-b5e3-142bca516e96\" (UID: \"eace68a3-665f-4398-b5e3-142bca516e96\") "
Sep 18 20:08:19.167773 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.167697    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-model-cache" (OuterVolumeSpecName: "model-cache") pod "eace68a3-665f-4398-b5e3-142bca516e96" (UID: "eace68a3-665f-4398-b5e3-142bca516e96"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:08:19.167773 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.167711    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-home" (OuterVolumeSpecName: "home") pod "eace68a3-665f-4398-b5e3-142bca516e96" (UID: "eace68a3-665f-4398-b5e3-142bca516e96"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:08:19.167985 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.167916    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eace68a3-665f-4398-b5e3-142bca516e96" (UID: "eace68a3-665f-4398-b5e3-142bca516e96"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:08:19.168062 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.167992    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:19.168062 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.168011    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:19.169679 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.169656    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-dshm" (OuterVolumeSpecName: "dshm") pod "eace68a3-665f-4398-b5e3-142bca516e96" (UID: "eace68a3-665f-4398-b5e3-142bca516e96"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:08:19.169801 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.169783    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eace68a3-665f-4398-b5e3-142bca516e96-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eace68a3-665f-4398-b5e3-142bca516e96" (UID: "eace68a3-665f-4398-b5e3-142bca516e96"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:08:19.169849 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.169784    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eace68a3-665f-4398-b5e3-142bca516e96-kube-api-access-7wkn8" (OuterVolumeSpecName: "kube-api-access-7wkn8") pod "eace68a3-665f-4398-b5e3-142bca516e96" (UID: "eace68a3-665f-4398-b5e3-142bca516e96"). InnerVolumeSpecName "kube-api-access-7wkn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:08:19.269473 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.269436    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wkn8\" (UniqueName: \"kubernetes.io/projected/eace68a3-665f-4398-b5e3-142bca516e96-kube-api-access-7wkn8\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:19.269473 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.269468    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:19.269673 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.269481    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eace68a3-665f-4398-b5e3-142bca516e96-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:19.269673 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.269493    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eace68a3-665f-4398-b5e3-142bca516e96-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:19.693398 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.693367    2583 generic.go:356] "Generic (PLEG): container finished" podID="eace68a3-665f-4398-b5e3-142bca516e96" containerID="cf68fe1133acb22c21b91c12a2a55cef478a0951e136d798cba8c8766419ac96" exitCode=0
Sep 18 20:08:19.693575 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.693415    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"
Sep 18 20:08:19.693575 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.693446    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr" event={"ID":"eace68a3-665f-4398-b5e3-142bca516e96","Type":"ContainerDied","Data":"cf68fe1133acb22c21b91c12a2a55cef478a0951e136d798cba8c8766419ac96"}
Sep 18 20:08:19.693575 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.693487    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr" event={"ID":"eace68a3-665f-4398-b5e3-142bca516e96","Type":"ContainerDied","Data":"426d7a856ed097de645f8c4919943630f607a695da682cd9abbee662a812a362"}
Sep 18 20:08:19.693575 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.693503    2583 scope.go:117] "RemoveContainer" containerID="cf68fe1133acb22c21b91c12a2a55cef478a0951e136d798cba8c8766419ac96"
Sep 18 20:08:19.703550 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.703535    2583 scope.go:117] "RemoveContainer" containerID="cf68fe1133acb22c21b91c12a2a55cef478a0951e136d798cba8c8766419ac96"
Sep 18 20:08:19.703834 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:08:19.703817    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf68fe1133acb22c21b91c12a2a55cef478a0951e136d798cba8c8766419ac96\": container with ID starting with cf68fe1133acb22c21b91c12a2a55cef478a0951e136d798cba8c8766419ac96 not found: ID does not exist" containerID="cf68fe1133acb22c21b91c12a2a55cef478a0951e136d798cba8c8766419ac96"
Sep 18 20:08:19.703892 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.703842    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf68fe1133acb22c21b91c12a2a55cef478a0951e136d798cba8c8766419ac96"} err="failed to get container status \"cf68fe1133acb22c21b91c12a2a55cef478a0951e136d798cba8c8766419ac96\": rpc error: code = NotFound desc = could not find container \"cf68fe1133acb22c21b91c12a2a55cef478a0951e136d798cba8c8766419ac96\": container with ID starting with cf68fe1133acb22c21b91c12a2a55cef478a0951e136d798cba8c8766419ac96 not found: ID does not exist"
Sep 18 20:08:19.715118 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.715097    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"]
Sep 18 20:08:19.718666 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.718647    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-674263/distinct-2-w4-674263-kserve-6d4cd998cd-hbsqr"]
Sep 18 20:08:19.812849 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:19.812823    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eace68a3-665f-4398-b5e3-142bca516e96" path="/var/lib/kubelet/pods/eace68a3-665f-4398-b5e3-142bca516e96/volumes"
Sep 18 20:08:20.850981 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:20.850953    2583 scope.go:117] "RemoveContainer" containerID="63736577d7d5f5d69bd10647dc3759856e99b6b7e6a585121da1e1cb65d4bbb8"
Sep 18 20:08:21.298823 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:21.298737    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:21.366588 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:21.366555    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:21.534525 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:21.534488    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"]
Sep 18 20:08:21.534800 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:21.534770    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy" containerID="cri-o://85667c0e34aa2716fe5013a94d88871f0fa42346b0f4edda30e9014ec1c545e1" gracePeriod=30
Sep 18 20:08:21.549662 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:21.549563    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:21.603681 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:21.603642    2583 patch_prober.go:28] interesting pod/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 18 20:08:21.603834 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:21.603712    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 18 20:08:26.747726 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.747693    2583 generic.go:356] "Generic (PLEG): container finished" podID="59dd6c56-1408-480d-847c-ca28e133e492" containerID="85667c0e34aa2716fe5013a94d88871f0fa42346b0f4edda30e9014ec1c545e1" exitCode=0
Sep 18 20:08:26.748219 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.747745    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" event={"ID":"59dd6c56-1408-480d-847c-ca28e133e492","Type":"ContainerDied","Data":"85667c0e34aa2716fe5013a94d88871f0fa42346b0f4edda30e9014ec1c545e1"}
Sep 18 20:08:26.748219 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.747790    2583 scope.go:117] "RemoveContainer" containerID="8c88b92427faec31130b462ddc3836844fe235fb1e4c677266abe6dbb9d4c20e"
Sep 18 20:08:26.801573 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.801518    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 20:08:26.938869 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.938837    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-workload-certs\") pod \"59dd6c56-1408-480d-847c-ca28e133e492\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") "
Sep 18 20:08:26.938869 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.938870    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-workload-socket\") pod \"59dd6c56-1408-480d-847c-ca28e133e492\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") "
Sep 18 20:08:26.939170 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.938890    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nsmf\" (UniqueName: \"kubernetes.io/projected/59dd6c56-1408-480d-847c-ca28e133e492-kube-api-access-7nsmf\") pod \"59dd6c56-1408-480d-847c-ca28e133e492\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") "
Sep 18 20:08:26.939170 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.938927    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59dd6c56-1408-480d-847c-ca28e133e492-istio-podinfo\") pod \"59dd6c56-1408-480d-847c-ca28e133e492\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") "
Sep 18 20:08:26.939170 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.938950    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59dd6c56-1408-480d-847c-ca28e133e492-istio-token\") pod \"59dd6c56-1408-480d-847c-ca28e133e492\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") "
Sep 18 20:08:26.939170 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.939005    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-credential-socket\") pod \"59dd6c56-1408-480d-847c-ca28e133e492\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") "
Sep 18 20:08:26.939170 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.939088    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-istio-data\") pod \"59dd6c56-1408-480d-847c-ca28e133e492\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") "
Sep 18 20:08:26.939170 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.939120    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59dd6c56-1408-480d-847c-ca28e133e492-istiod-ca-cert\") pod \"59dd6c56-1408-480d-847c-ca28e133e492\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") "
Sep 18 20:08:26.939170 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.939160    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-istio-envoy\") pod \"59dd6c56-1408-480d-847c-ca28e133e492\" (UID: \"59dd6c56-1408-480d-847c-ca28e133e492\") "
Sep 18 20:08:26.939525 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.939157    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "59dd6c56-1408-480d-847c-ca28e133e492" (UID: "59dd6c56-1408-480d-847c-ca28e133e492"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:08:26.939525 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.939227    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "59dd6c56-1408-480d-847c-ca28e133e492" (UID: "59dd6c56-1408-480d-847c-ca28e133e492"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:08:26.939525 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.939391    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-istio-data" (OuterVolumeSpecName: "istio-data") pod "59dd6c56-1408-480d-847c-ca28e133e492" (UID: "59dd6c56-1408-480d-847c-ca28e133e492"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:08:26.939525 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.939409    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "59dd6c56-1408-480d-847c-ca28e133e492" (UID: "59dd6c56-1408-480d-847c-ca28e133e492"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:08:26.939525 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.939514    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59dd6c56-1408-480d-847c-ca28e133e492-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "59dd6c56-1408-480d-847c-ca28e133e492" (UID: "59dd6c56-1408-480d-847c-ca28e133e492"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:08:26.939773 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.939598    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-credential-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:26.939773 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.939613    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-istio-data\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:26.939773 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.939623    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59dd6c56-1408-480d-847c-ca28e133e492-istiod-ca-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:26.939773 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.939631    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-workload-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:26.939773 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.939642    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-workload-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:26.941351 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.941321    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59dd6c56-1408-480d-847c-ca28e133e492-kube-api-access-7nsmf" (OuterVolumeSpecName: "kube-api-access-7nsmf") pod "59dd6c56-1408-480d-847c-ca28e133e492" (UID: "59dd6c56-1408-480d-847c-ca28e133e492"). InnerVolumeSpecName "kube-api-access-7nsmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:08:26.941450 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.941364    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59dd6c56-1408-480d-847c-ca28e133e492-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "59dd6c56-1408-480d-847c-ca28e133e492" (UID: "59dd6c56-1408-480d-847c-ca28e133e492"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:08:26.941789 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.941770    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "59dd6c56-1408-480d-847c-ca28e133e492" (UID: "59dd6c56-1408-480d-847c-ca28e133e492"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:08:26.941789 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:26.941776    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59dd6c56-1408-480d-847c-ca28e133e492-istio-token" (OuterVolumeSpecName: "istio-token") pod "59dd6c56-1408-480d-847c-ca28e133e492" (UID: "59dd6c56-1408-480d-847c-ca28e133e492"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:08:27.040188 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:27.040147    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59dd6c56-1408-480d-847c-ca28e133e492-istio-envoy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:27.040188 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:27.040179    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nsmf\" (UniqueName: \"kubernetes.io/projected/59dd6c56-1408-480d-847c-ca28e133e492-kube-api-access-7nsmf\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:27.040188 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:27.040190    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59dd6c56-1408-480d-847c-ca28e133e492-istio-podinfo\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:27.040188 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:27.040198    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59dd6c56-1408-480d-847c-ca28e133e492-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:08:27.756429 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:27.756391    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"
Sep 18 20:08:27.756429 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:27.756417    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct" event={"ID":"59dd6c56-1408-480d-847c-ca28e133e492","Type":"ContainerDied","Data":"bcb96601d5ffaa9e5853cfa592dc84f10bd5e69945097de8cac0528db6fade06"}
Sep 18 20:08:27.756928 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:27.756508    2583 scope.go:117] "RemoveContainer" containerID="85667c0e34aa2716fe5013a94d88871f0fa42346b0f4edda30e9014ec1c545e1"
Sep 18 20:08:27.779935 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:27.779910    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"]
Sep 18 20:08:27.783583 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:27.783562    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-674263-openshift-default-6644996b96-mpjct"]
Sep 18 20:08:27.811033 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:27.811007    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59dd6c56-1408-480d-847c-ca28e133e492" path="/var/lib/kubelet/pods/59dd6c56-1408-480d-847c-ca28e133e492/volumes"
Sep 18 20:08:40.627550 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:40.627511    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:40.686566 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:40.686539    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:41.251004 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:41.250977    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:08:47.232887 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:08:47.232851    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:09:06.007540 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:06.007501    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:09:07.054639 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:07.054607    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"]
Sep 18 20:09:07.079866 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:07.079836    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:09:10.100719 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:10.100675    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:09:19.878059 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:19.878017    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 20:09:19.882533 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:19.882509    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 20:09:20.899423 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:20.899391    2583 scope.go:117] "RemoveContainer" containerID="c779f26f9af1d5c5fc25f2aa2eb107e1c3c478db6f9d80c7fffe3a2ceb0c8d59"
Sep 18 20:09:22.073950 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.073914    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929" podUID="844b09ed-2e51-4c56-9ec7-e96fba06ccb6" containerName="main" containerID="cri-o://0f9ad8776eb4392965bf29a7e92244f16adab9eccd89e931c39b28a102941757" gracePeriod=45
Sep 18 20:09:22.324215 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.324157    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:09:22.345389 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.345340    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-home\") pod \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") "
Sep 18 20:09:22.345532 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.345409    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-tls-certs\") pod \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") "
Sep 18 20:09:22.345532 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.345439    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-tmp-dir\") pod \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") "
Sep 18 20:09:22.345532 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.345481    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-model-cache\") pod \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") "
Sep 18 20:09:22.345848 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.345813    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-model-cache" (OuterVolumeSpecName: "model-cache") pod "844b09ed-2e51-4c56-9ec7-e96fba06ccb6" (UID: "844b09ed-2e51-4c56-9ec7-e96fba06ccb6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:09:22.345999 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.345959    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "844b09ed-2e51-4c56-9ec7-e96fba06ccb6" (UID: "844b09ed-2e51-4c56-9ec7-e96fba06ccb6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:09:22.346072 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.346010    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-home" (OuterVolumeSpecName: "home") pod "844b09ed-2e51-4c56-9ec7-e96fba06ccb6" (UID: "844b09ed-2e51-4c56-9ec7-e96fba06ccb6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:09:22.347855 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.347835    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "844b09ed-2e51-4c56-9ec7-e96fba06ccb6" (UID: "844b09ed-2e51-4c56-9ec7-e96fba06ccb6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:09:22.446126 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.446095    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hx74\" (UniqueName: \"kubernetes.io/projected/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-kube-api-access-6hx74\") pod \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") "
Sep 18 20:09:22.446301 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.446158    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-dshm\") pod \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\" (UID: \"844b09ed-2e51-4c56-9ec7-e96fba06ccb6\") "
Sep 18 20:09:22.446377 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.446332    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:09:22.446377 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.446341    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:09:22.446377 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.446351    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:09:22.446377 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.446359    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:09:22.448237 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.448204    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-dshm" (OuterVolumeSpecName: "dshm") pod "844b09ed-2e51-4c56-9ec7-e96fba06ccb6" (UID: "844b09ed-2e51-4c56-9ec7-e96fba06ccb6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:09:22.448237 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.448219    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-kube-api-access-6hx74" (OuterVolumeSpecName: "kube-api-access-6hx74") pod "844b09ed-2e51-4c56-9ec7-e96fba06ccb6" (UID: "844b09ed-2e51-4c56-9ec7-e96fba06ccb6"). InnerVolumeSpecName "kube-api-access-6hx74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:09:22.547326 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.547294    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:09:22.547326 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:22.547321    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hx74\" (UniqueName: \"kubernetes.io/projected/844b09ed-2e51-4c56-9ec7-e96fba06ccb6-kube-api-access-6hx74\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:09:23.077895 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:23.077860    2583 generic.go:356] "Generic (PLEG): container finished" podID="844b09ed-2e51-4c56-9ec7-e96fba06ccb6" containerID="0f9ad8776eb4392965bf29a7e92244f16adab9eccd89e931c39b28a102941757" exitCode=0
Sep 18 20:09:23.078341 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:23.077906    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"
Sep 18 20:09:23.078341 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:23.077943    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929" event={"ID":"844b09ed-2e51-4c56-9ec7-e96fba06ccb6","Type":"ContainerDied","Data":"0f9ad8776eb4392965bf29a7e92244f16adab9eccd89e931c39b28a102941757"}
Sep 18 20:09:23.078341 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:23.077985    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929" event={"ID":"844b09ed-2e51-4c56-9ec7-e96fba06ccb6","Type":"ContainerDied","Data":"20a789267f8b61f5cfbd4535b9ac05caf01924dc50f0a8690249b4ad8f0cd38b"}
Sep 18 20:09:23.078341 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:23.078001    2583 scope.go:117] "RemoveContainer" containerID="0f9ad8776eb4392965bf29a7e92244f16adab9eccd89e931c39b28a102941757"
Sep 18 20:09:23.087811 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:23.087793    2583 scope.go:117] "RemoveContainer" containerID="0f9ad8776eb4392965bf29a7e92244f16adab9eccd89e931c39b28a102941757"
Sep 18 20:09:23.088104 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:09:23.088085    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f9ad8776eb4392965bf29a7e92244f16adab9eccd89e931c39b28a102941757\": container with ID starting with 0f9ad8776eb4392965bf29a7e92244f16adab9eccd89e931c39b28a102941757 not found: ID does not exist" containerID="0f9ad8776eb4392965bf29a7e92244f16adab9eccd89e931c39b28a102941757"
Sep 18 20:09:23.088172 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:23.088112    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f9ad8776eb4392965bf29a7e92244f16adab9eccd89e931c39b28a102941757"} err="failed to get container status \"0f9ad8776eb4392965bf29a7e92244f16adab9eccd89e931c39b28a102941757\": rpc error: code = NotFound desc = could not find container \"0f9ad8776eb4392965bf29a7e92244f16adab9eccd89e931c39b28a102941757\": container with ID starting with 0f9ad8776eb4392965bf29a7e92244f16adab9eccd89e931c39b28a102941757 not found: ID does not exist"
Sep 18 20:09:23.100994 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:23.100969    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"]
Sep 18 20:09:23.104601 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:23.104579    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-5547b6/auth-test-model-5547b6-kserve-7f4bcb7567-rh929"]
Sep 18 20:09:23.811283 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:23.811252    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="844b09ed-2e51-4c56-9ec7-e96fba06ccb6" path="/var/lib/kubelet/pods/844b09ed-2e51-4c56-9ec7-e96fba06ccb6/volumes"
Sep 18 20:09:41.640510 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:09:41.640475    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:10:08.058630 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:08.058593    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:10:08.117767 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:08.117738    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:10:15.356117 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356081    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7525-09c493"]
Sep 18 20:10:15.356549 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356439    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy"
Sep 18 20:10:15.356549 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356450    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy"
Sep 18 20:10:15.356549 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356459    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b" containerName="revoke-keys"
Sep 18 20:10:15.356549 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356465    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b" containerName="revoke-keys"
Sep 18 20:10:15.356549 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356471    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="844b09ed-2e51-4c56-9ec7-e96fba06ccb6" containerName="main"
Sep 18 20:10:15.356549 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356476    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="844b09ed-2e51-4c56-9ec7-e96fba06ccb6" containerName="main"
Sep 18 20:10:15.356549 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356489    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06c38514-0a40-4293-b06d-3ccdf0a46688" containerName="istio-proxy"
Sep 18 20:10:15.356549 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356493    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="06c38514-0a40-4293-b06d-3ccdf0a46688" containerName="istio-proxy"
Sep 18 20:10:15.356549 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356502    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eace68a3-665f-4398-b5e3-142bca516e96" containerName="main"
Sep 18 20:10:15.356549 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356507    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="eace68a3-665f-4398-b5e3-142bca516e96" containerName="main"
Sep 18 20:10:15.356549 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356515    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30f387e2-bba9-4cc8-a083-c76caf24002d" containerName="payload-pre-processing"
Sep 18 20:10:15.356549 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356520    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="30f387e2-bba9-4cc8-a083-c76caf24002d" containerName="payload-pre-processing"
Sep 18 20:10:15.356915 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356581    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="844b09ed-2e51-4c56-9ec7-e96fba06ccb6" containerName="main"
Sep 18 20:10:15.356915 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356590    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy"
Sep 18 20:10:15.356915 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356596    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="30f387e2-bba9-4cc8-a083-c76caf24002d" containerName="payload-pre-processing"
Sep 18 20:10:15.356915 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356603    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="eace68a3-665f-4398-b5e3-142bca516e96" containerName="main"
Sep 18 20:10:15.356915 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.356610    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef2b72f5-8a88-42ea-b112-0c0a2fa7d99b" containerName="revoke-keys"
Sep 18 20:10:15.359531 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.359508    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7525-09c493"
Sep 18 20:10:15.362549 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.362526    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ls85n\""
Sep 18 20:10:15.368641 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.368600    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7525-09c493"]
Sep 18 20:10:15.412315 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.412291    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9gsv\" (UniqueName: \"kubernetes.io/projected/64b9d880-2bf5-4634-95aa-588c21c59904-kube-api-access-p9gsv\") pod \"test-curl-7525-09c493\" (UID: \"64b9d880-2bf5-4634-95aa-588c21c59904\") " pod="opendatahub/test-curl-7525-09c493"
Sep 18 20:10:15.513047 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.513017    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9gsv\" (UniqueName: \"kubernetes.io/projected/64b9d880-2bf5-4634-95aa-588c21c59904-kube-api-access-p9gsv\") pod \"test-curl-7525-09c493\" (UID: \"64b9d880-2bf5-4634-95aa-588c21c59904\") " pod="opendatahub/test-curl-7525-09c493"
Sep 18 20:10:15.529707 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.529675    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9gsv\" (UniqueName: \"kubernetes.io/projected/64b9d880-2bf5-4634-95aa-588c21c59904-kube-api-access-p9gsv\") pod \"test-curl-7525-09c493\" (UID: \"64b9d880-2bf5-4634-95aa-588c21c59904\") " pod="opendatahub/test-curl-7525-09c493"
Sep 18 20:10:15.670349 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.670263    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7525-09c493"
Sep 18 20:10:15.943901 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.943875    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7525-09c493"]
Sep 18 20:10:15.945141 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:10:15.945114    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64b9d880_2bf5_4634_95aa_588c21c59904.slice/crio-13e189a6ed5571887c36cb0332b5797af05d0e0cb54ac4d610235aeddcf35f81 WatchSource:0}: Error finding container 13e189a6ed5571887c36cb0332b5797af05d0e0cb54ac4d610235aeddcf35f81: Status 404 returned error can't find the container with id 13e189a6ed5571887c36cb0332b5797af05d0e0cb54ac4d610235aeddcf35f81
Sep 18 20:10:15.946928 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:15.946911    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 20:10:16.382387 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:16.382353    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7525-09c493" event={"ID":"64b9d880-2bf5-4634-95aa-588c21c59904","Type":"ContainerStarted","Data":"13e189a6ed5571887c36cb0332b5797af05d0e0cb54ac4d610235aeddcf35f81"}
Sep 18 20:10:19.402442 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:19.402404    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7525-09c493" event={"ID":"64b9d880-2bf5-4634-95aa-588c21c59904","Type":"ContainerStarted","Data":"31401ce4585f19cce6cca21cf3d946dd1f035d8e95b1b60c4fe256a947cb13b9"}
Sep 18 20:10:19.418681 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:19.418637    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7525-09c493" podStartSLOduration=1.3980127740000001 podStartE2EDuration="4.418622906s" totalImagesPullingTime="3.020610132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:10:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:10:19.417031596 +0000 UTC m=+1861.744125360" watchObservedRunningTime="2026-09-18 20:10:19.418622906 +0000 UTC m=+1861.745716670"
Sep 18 20:10:20.021149 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.021105    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7525-09c493"]
Sep 18 20:10:20.025357 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.025327    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7525-09c493"]
Sep 18 20:10:20.151431 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.151401    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7525-edeec3"]
Sep 18 20:10:20.151916 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.151890    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64b9d880-2bf5-4634-95aa-588c21c59904" containerName="test-curl-7525-09c493"
Sep 18 20:10:20.151916 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.151913    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="64b9d880-2bf5-4634-95aa-588c21c59904" containerName="test-curl-7525-09c493"
Sep 18 20:10:20.152015 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.151946    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy"
Sep 18 20:10:20.152015 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.151956    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy"
Sep 18 20:10:20.152113 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.152067    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="64b9d880-2bf5-4634-95aa-588c21c59904" containerName="test-curl-7525-09c493"
Sep 18 20:10:20.152113 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.152079    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="59dd6c56-1408-480d-847c-ca28e133e492" containerName="istio-proxy"
Sep 18 20:10:20.155230 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.155216    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7525-edeec3"
Sep 18 20:10:20.162452 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.162181    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7525-edeec3"]
Sep 18 20:10:20.257963 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.257922    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47rkt\" (UniqueName: \"kubernetes.io/projected/d7a77a74-dff8-48a8-9523-71e066ad7128-kube-api-access-47rkt\") pod \"test-curl-7525-edeec3\" (UID: \"d7a77a74-dff8-48a8-9523-71e066ad7128\") " pod="opendatahub/test-curl-7525-edeec3"
Sep 18 20:10:20.358961 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.358931    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47rkt\" (UniqueName: \"kubernetes.io/projected/d7a77a74-dff8-48a8-9523-71e066ad7128-kube-api-access-47rkt\") pod \"test-curl-7525-edeec3\" (UID: \"d7a77a74-dff8-48a8-9523-71e066ad7128\") " pod="opendatahub/test-curl-7525-edeec3"
Sep 18 20:10:20.367419 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.367390    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47rkt\" (UniqueName: \"kubernetes.io/projected/d7a77a74-dff8-48a8-9523-71e066ad7128-kube-api-access-47rkt\") pod \"test-curl-7525-edeec3\" (UID: \"d7a77a74-dff8-48a8-9523-71e066ad7128\") " pod="opendatahub/test-curl-7525-edeec3"
Sep 18 20:10:20.408398 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:10:20.408338    2583 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7525-09c493" container="test-curl-7525-09c493"
Sep 18 20:10:20.465456 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.465435    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7525-edeec3"
Sep 18 20:10:20.735260 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:20.735236    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7525-edeec3"]
Sep 18 20:10:20.737109 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:10:20.737080    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7a77a74_dff8_48a8_9523_71e066ad7128.slice/crio-07938745f6134205f88053a47013f636ff9de71c098d1a8bde6c370a9e33d694 WatchSource:0}: Error finding container 07938745f6134205f88053a47013f636ff9de71c098d1a8bde6c370a9e33d694: Status 404 returned error can't find the container with id 07938745f6134205f88053a47013f636ff9de71c098d1a8bde6c370a9e33d694
Sep 18 20:10:21.415466 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:21.415433    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7525-edeec3" event={"ID":"d7a77a74-dff8-48a8-9523-71e066ad7128","Type":"ContainerStarted","Data":"7614324159fb3c0a939d9f88dd397ae72f6bd573c0dbf4c0ec604c7ceed5f298"}
Sep 18 20:10:21.415466 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:21.415472    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7525-edeec3" event={"ID":"d7a77a74-dff8-48a8-9523-71e066ad7128","Type":"ContainerStarted","Data":"07938745f6134205f88053a47013f636ff9de71c098d1a8bde6c370a9e33d694"}
Sep 18 20:10:21.415905 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:21.415663    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7525-09c493" podUID="64b9d880-2bf5-4634-95aa-588c21c59904" containerName="test-curl-7525-09c493" containerID="cri-o://31401ce4585f19cce6cca21cf3d946dd1f035d8e95b1b60c4fe256a947cb13b9" gracePeriod=2
Sep 18 20:10:21.432946 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:21.432891    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7525-edeec3" podStartSLOduration=1.432877524 podStartE2EDuration="1.432877524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:10:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:10:21.430877383 +0000 UTC m=+1863.757971145" watchObservedRunningTime="2026-09-18 20:10:21.432877524 +0000 UTC m=+1863.759971288"
Sep 18 20:10:21.433191 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:10:21.433168    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7525-09c493\" is forbidden: User \"system:node:ip-10-0-135-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-240.ec2.internal' and this object" podUID="64b9d880-2bf5-4634-95aa-588c21c59904" pod="opendatahub/test-curl-7525-09c493"
Sep 18 20:10:22.015591 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:22.015561    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7525-edeec3"]
Sep 18 20:10:22.019592 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:22.019564    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7525-edeec3"]
Sep 18 20:10:22.421614 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:10:22.421578    2583 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7525-edeec3" container="test-curl-7525-edeec3"
Sep 18 20:10:23.427516 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:23.427479    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7525-edeec3" podUID="d7a77a74-dff8-48a8-9523-71e066ad7128" containerName="test-curl-7525-edeec3" containerID="cri-o://7614324159fb3c0a939d9f88dd397ae72f6bd573c0dbf4c0ec604c7ceed5f298" gracePeriod=2
Sep 18 20:10:23.431830 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:10:23.431803    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7525-edeec3\" is forbidden: User \"system:node:ip-10-0-135-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-240.ec2.internal' and this object" podUID="d7a77a74-dff8-48a8-9523-71e066ad7128" pod="opendatahub/test-curl-7525-edeec3"
Sep 18 20:10:23.582697 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:23.582674    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7525-09c493"
Sep 18 20:10:23.585025 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:10:23.584997    2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7525-edeec3\" is forbidden: User \"system:node:ip-10-0-135-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-240.ec2.internal' and this object" podUID="d7a77a74-dff8-48a8-9523-71e066ad7128" pod="opendatahub/test-curl-7525-edeec3"
Sep 18 20:10:23.687522 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:23.687459    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9gsv\" (UniqueName: \"kubernetes.io/projected/64b9d880-2bf5-4634-95aa-588c21c59904-kube-api-access-p9gsv\") pod \"64b9d880-2bf5-4634-95aa-588c21c59904\" (UID: \"64b9d880-2bf5-4634-95aa-588c21c59904\") "
Sep 18 20:10:23.689490 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:23.689467    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64b9d880-2bf5-4634-95aa-588c21c59904-kube-api-access-p9gsv" (OuterVolumeSpecName: "kube-api-access-p9gsv") pod "64b9d880-2bf5-4634-95aa-588c21c59904" (UID: "64b9d880-2bf5-4634-95aa-588c21c59904"). InnerVolumeSpecName "kube-api-access-p9gsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:10:23.789134 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:23.789108    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9gsv\" (UniqueName: \"kubernetes.io/projected/64b9d880-2bf5-4634-95aa-588c21c59904-kube-api-access-p9gsv\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:10:23.811226 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:23.811200    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64b9d880-2bf5-4634-95aa-588c21c59904" path="/var/lib/kubelet/pods/64b9d880-2bf5-4634-95aa-588c21c59904/volumes"
Sep 18 20:10:24.139227 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:24.139199    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:10:24.434819 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:24.434703    2583 generic.go:356] "Generic (PLEG): container finished" podID="64b9d880-2bf5-4634-95aa-588c21c59904" containerID="31401ce4585f19cce6cca21cf3d946dd1f035d8e95b1b60c4fe256a947cb13b9" exitCode=137
Sep 18 20:10:24.434819 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:24.434756    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7525-09c493"
Sep 18 20:10:24.434819 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:24.434808    2583 scope.go:117] "RemoveContainer" containerID="31401ce4585f19cce6cca21cf3d946dd1f035d8e95b1b60c4fe256a947cb13b9"
Sep 18 20:10:24.443822 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:24.443800    2583 scope.go:117] "RemoveContainer" containerID="31401ce4585f19cce6cca21cf3d946dd1f035d8e95b1b60c4fe256a947cb13b9"
Sep 18 20:10:24.444095 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:10:24.444077    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31401ce4585f19cce6cca21cf3d946dd1f035d8e95b1b60c4fe256a947cb13b9\": container with ID starting with 31401ce4585f19cce6cca21cf3d946dd1f035d8e95b1b60c4fe256a947cb13b9 not found: ID does not exist" containerID="31401ce4585f19cce6cca21cf3d946dd1f035d8e95b1b60c4fe256a947cb13b9"
Sep 18 20:10:24.444171 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:24.444103    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31401ce4585f19cce6cca21cf3d946dd1f035d8e95b1b60c4fe256a947cb13b9"} err="failed to get container status \"31401ce4585f19cce6cca21cf3d946dd1f035d8e95b1b60c4fe256a947cb13b9\": rpc error: code = NotFound desc = could not find container \"31401ce4585f19cce6cca21cf3d946dd1f035d8e95b1b60c4fe256a947cb13b9\": container with ID starting with 31401ce4585f19cce6cca21cf3d946dd1f035d8e95b1b60c4fe256a947cb13b9 not found: ID does not exist"
Sep 18 20:10:25.213141 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:25.213112    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:10:25.601474 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:25.601452    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7525-edeec3"
Sep 18 20:10:25.705964 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:25.705934    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47rkt\" (UniqueName: \"kubernetes.io/projected/d7a77a74-dff8-48a8-9523-71e066ad7128-kube-api-access-47rkt\") pod \"d7a77a74-dff8-48a8-9523-71e066ad7128\" (UID: \"d7a77a74-dff8-48a8-9523-71e066ad7128\") "
Sep 18 20:10:25.708001 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:25.707978    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7a77a74-dff8-48a8-9523-71e066ad7128-kube-api-access-47rkt" (OuterVolumeSpecName: "kube-api-access-47rkt") pod "d7a77a74-dff8-48a8-9523-71e066ad7128" (UID: "d7a77a74-dff8-48a8-9523-71e066ad7128"). InnerVolumeSpecName "kube-api-access-47rkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:10:25.806768 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:25.806703    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47rkt\" (UniqueName: \"kubernetes.io/projected/d7a77a74-dff8-48a8-9523-71e066ad7128-kube-api-access-47rkt\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:10:25.811443 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:25.811419    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7a77a74-dff8-48a8-9523-71e066ad7128" path="/var/lib/kubelet/pods/d7a77a74-dff8-48a8-9523-71e066ad7128/volumes"
Sep 18 20:10:26.449402 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:26.449372    2583 generic.go:356] "Generic (PLEG): container finished" podID="d7a77a74-dff8-48a8-9523-71e066ad7128" containerID="7614324159fb3c0a939d9f88dd397ae72f6bd573c0dbf4c0ec604c7ceed5f298" exitCode=137
Sep 18 20:10:26.449567 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:26.449418    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7525-edeec3"
Sep 18 20:10:26.449567 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:26.449469    2583 scope.go:117] "RemoveContainer" containerID="7614324159fb3c0a939d9f88dd397ae72f6bd573c0dbf4c0ec604c7ceed5f298"
Sep 18 20:10:26.458460 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:26.458433    2583 scope.go:117] "RemoveContainer" containerID="7614324159fb3c0a939d9f88dd397ae72f6bd573c0dbf4c0ec604c7ceed5f298"
Sep 18 20:10:26.458762 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:10:26.458743    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7614324159fb3c0a939d9f88dd397ae72f6bd573c0dbf4c0ec604c7ceed5f298\": container with ID starting with 7614324159fb3c0a939d9f88dd397ae72f6bd573c0dbf4c0ec604c7ceed5f298 not found: ID does not exist" containerID="7614324159fb3c0a939d9f88dd397ae72f6bd573c0dbf4c0ec604c7ceed5f298"
Sep 18 20:10:26.458822 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:26.458771    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7614324159fb3c0a939d9f88dd397ae72f6bd573c0dbf4c0ec604c7ceed5f298"} err="failed to get container status \"7614324159fb3c0a939d9f88dd397ae72f6bd573c0dbf4c0ec604c7ceed5f298\": rpc error: code = NotFound desc = could not find container \"7614324159fb3c0a939d9f88dd397ae72f6bd573c0dbf4c0ec604c7ceed5f298\": container with ID starting with 7614324159fb3c0a939d9f88dd397ae72f6bd573c0dbf4c0ec604c7ceed5f298 not found: ID does not exist"
Sep 18 20:10:31.898316 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.898240    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"]
Sep 18 20:10:31.898696 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.898595    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a77a74-dff8-48a8-9523-71e066ad7128" containerName="test-curl-7525-edeec3"
Sep 18 20:10:31.898696 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.898607    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a77a74-dff8-48a8-9523-71e066ad7128" containerName="test-curl-7525-edeec3"
Sep 18 20:10:31.898696 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.898673    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a77a74-dff8-48a8-9523-71e066ad7128" containerName="test-curl-7525-edeec3"
Sep 18 20:10:31.903096 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.903079    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:31.906872 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.906843    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-57b6ce\"/\"default-dockercfg-mrlqv\""
Sep 18 20:10:31.906872 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.906860    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-57b6ce\"/\"openshift-service-ca.crt\""
Sep 18 20:10:31.907083 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.906865    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-57b6ce\"/\"rate-test-model-57b6ce-kserve-self-signed-certs\""
Sep 18 20:10:31.907083 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.906843    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-57b6ce\"/\"kube-root-ca.crt\""
Sep 18 20:10:31.914712 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.914690    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"]
Sep 18 20:10:31.921184 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.921154    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:10:31.957678 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.957644    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-dshm\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:31.957841 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.957701    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-model-cache\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:31.957841 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.957770    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-tmp-dir\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:31.957962 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.957875    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-home\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:31.957962 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.957928    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njgz8\" (UniqueName: \"kubernetes.io/projected/4725d497-b041-4180-96b7-8011220923d1-kube-api-access-njgz8\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:31.958103 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:31.957988    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4725d497-b041-4180-96b7-8011220923d1-tls-certs\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:32.059363 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:32.059333    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-model-cache\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:32.059363 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:32.059368    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-tmp-dir\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:32.059609 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:32.059412    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-home\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:32.059609 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:32.059439    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njgz8\" (UniqueName: \"kubernetes.io/projected/4725d497-b041-4180-96b7-8011220923d1-kube-api-access-njgz8\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:32.059609 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:32.059464    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4725d497-b041-4180-96b7-8011220923d1-tls-certs\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:32.059609 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:32.059492    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-dshm\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:32.059817 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:32.059781    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-model-cache\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:32.059879 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:32.059833    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-home\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:32.059879 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:32.059866    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-tmp-dir\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:32.061729 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:32.061707    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-dshm\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:32.061942 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:32.061923    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4725d497-b041-4180-96b7-8011220923d1-tls-certs\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:32.068108 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:32.068089    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njgz8\" (UniqueName: \"kubernetes.io/projected/4725d497-b041-4180-96b7-8011220923d1-kube-api-access-njgz8\") pod \"rate-test-model-57b6ce-kserve-849d9599dc-98826\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") " pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:32.212526 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:32.212441    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:32.485938 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:32.485910    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"]
Sep 18 20:10:32.487185 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:10:32.487145    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4725d497_b041_4180_96b7_8011220923d1.slice/crio-de9f30080c09dc30fca27b9e7b1380afdaf6914e582cb655cebfd272c58fa8b2 WatchSource:0}: Error finding container de9f30080c09dc30fca27b9e7b1380afdaf6914e582cb655cebfd272c58fa8b2: Status 404 returned error can't find the container with id de9f30080c09dc30fca27b9e7b1380afdaf6914e582cb655cebfd272c58fa8b2
Sep 18 20:10:33.493615 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:33.493583    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826" event={"ID":"4725d497-b041-4180-96b7-8011220923d1","Type":"ContainerStarted","Data":"33a2c8b58cff3bf33891c33a2218b6882ef06ce5d816b8507a51886cd6bfff2d"}
Sep 18 20:10:33.493615 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:33.493620    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826" event={"ID":"4725d497-b041-4180-96b7-8011220923d1","Type":"ContainerStarted","Data":"de9f30080c09dc30fca27b9e7b1380afdaf6914e582cb655cebfd272c58fa8b2"}
Sep 18 20:10:33.514676 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:33.514621    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826" podStartSLOduration=2.514602569 podStartE2EDuration="2.514602569s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:10:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:10:33.512294555 +0000 UTC m=+1875.839388316" watchObservedRunningTime="2026-09-18 20:10:33.514602569 +0000 UTC m=+1875.841696334"
Sep 18 20:10:42.213278 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:42.213246    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:42.213656 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:42.213295    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:42.225713 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:42.225689    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:42.562450 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:42.562366    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:10:49.160575 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:10:49.160545    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:05.464688 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:05.464605    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:37.909254 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:37.909199    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:50.361068 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:50.361021    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"]
Sep 18 20:11:50.378825 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:50.378793    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:51.367428 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:51.367404    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:51.809049 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:51.808962    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:52.096945 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.096914    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"]
Sep 18 20:11:52.100486 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.100467    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.103088 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.103062    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-953438-openshift-default-dockercfg-v5qbf\""
Sep 18 20:11:52.115292 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.115267    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"]
Sep 18 20:11:52.120238 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.120218    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:52.189107 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.189073    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-token\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.189310 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.189118    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-envoy\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.189310 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.189185    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-workload-certs\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.189310 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.189247    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-podinfo\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.189310 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.189277    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-credential-socket\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.189310 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.189303    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4s7n\" (UniqueName: \"kubernetes.io/projected/206b4006-42b6-42f8-8d86-5a17e31e57c2-kube-api-access-x4s7n\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.189551 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.189326    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-data\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.189551 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.189389    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-workload-socket\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.189551 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.189481    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/206b4006-42b6-42f8-8d86-5a17e31e57c2-istiod-ca-cert\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.290225 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.290188    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-envoy\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.290404 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.290248    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-workload-certs\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.290404 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.290278    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-podinfo\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.290404 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.290300    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-credential-socket\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.290404 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.290322    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4s7n\" (UniqueName: \"kubernetes.io/projected/206b4006-42b6-42f8-8d86-5a17e31e57c2-kube-api-access-x4s7n\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.290636 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.290474    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-data\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.290636 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.290518    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-workload-socket\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.290636 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.290595    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/206b4006-42b6-42f8-8d86-5a17e31e57c2-istiod-ca-cert\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.290792 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.290646    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-token\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.290792 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.290697    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-workload-certs\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.291028 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.291000    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-data\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.291028 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.291013    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-credential-socket\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.291214 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.291095    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-workload-socket\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.291380 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.291361    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/206b4006-42b6-42f8-8d86-5a17e31e57c2-istiod-ca-cert\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.292562 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.292543    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-envoy\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.292698 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.292682    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-podinfo\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.298648 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.298625    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-token\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.299467 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.299441    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4s7n\" (UniqueName: \"kubernetes.io/projected/206b4006-42b6-42f8-8d86-5a17e31e57c2-kube-api-access-x4s7n\") pod \"e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") " pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.411007 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.410929    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:52.603546 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.603510    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:52.686957 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.686931    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"]
Sep 18 20:11:52.688206 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:11:52.688181    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod206b4006_42b6_42f8_8d86_5a17e31e57c2.slice/crio-69b97635bb4df00ad478ac6705d7192c604cd0809de41e23dcdeda8dde8abef5 WatchSource:0}: Error finding container 69b97635bb4df00ad478ac6705d7192c604cd0809de41e23dcdeda8dde8abef5: Status 404 returned error can't find the container with id 69b97635bb4df00ad478ac6705d7192c604cd0809de41e23dcdeda8dde8abef5
Sep 18 20:11:52.690428 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.690394    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:11:52.690521 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.690456    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:11:52.690521 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.690483    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:11:52.953740 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.953650    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6" event={"ID":"206b4006-42b6-42f8-8d86-5a17e31e57c2","Type":"ContainerStarted","Data":"3fdaa13aaa51cdfb63dadb796b50c66af1d5699e5e006c3744afddf8c46a593b"}
Sep 18 20:11:52.953740 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.953718    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6" event={"ID":"206b4006-42b6-42f8-8d86-5a17e31e57c2","Type":"ContainerStarted","Data":"69b97635bb4df00ad478ac6705d7192c604cd0809de41e23dcdeda8dde8abef5"}
Sep 18 20:11:52.973955 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:52.973906    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6" podStartSLOduration=0.973890564 podStartE2EDuration="973.890564ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:11:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:11:52.972279207 +0000 UTC m=+1955.299372976" watchObservedRunningTime="2026-09-18 20:11:52.973890564 +0000 UTC m=+1955.300984388"
Sep 18 20:11:53.411963 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:53.411928    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:53.416910 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:53.416889    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:53.960329 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:53.960300    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:53.961236 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:53.961215    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:11:54.679136 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:54.679103    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:54.897796 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:54.897767    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:54.991132 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:54.991051    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:55.531827 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:55.531792    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:56.487123 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:56.487085    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:56.576225 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:56.576192    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:56.753842 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:56.753755    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:56.994786 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:56.994755    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:57.087379 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.087347    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:11:57.092794 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.092772    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"]
Sep 18 20:11:57.096333 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.096318    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"
Sep 18 20:11:57.099175 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.099151    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-953438-dockercfg-k9rz5\""
Sep 18 20:11:57.099282 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.099202    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-953438\""
Sep 18 20:11:57.107930 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.107905    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"]
Sep 18 20:11:57.128755 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.128726    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"]
Sep 18 20:11:57.132848 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.132828    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"
Sep 18 20:11:57.141327 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.141306    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"]
Sep 18 20:11:57.237406 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.237372    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8416c2ef-9849-4f37-acb1-c62b50b698bb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s\" (UID: \"8416c2ef-9849-4f37-acb1-c62b50b698bb\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"
Sep 18 20:11:57.237573 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.237440    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc8jw\" (UniqueName: \"kubernetes.io/projected/8416c2ef-9849-4f37-acb1-c62b50b698bb-kube-api-access-cc8jw\") pod \"payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s\" (UID: \"8416c2ef-9849-4f37-acb1-c62b50b698bb\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"
Sep 18 20:11:57.237573 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.237490    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a728fd3-bbbc-426e-9c80-b6eb669270b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7\" (UID: \"9a728fd3-bbbc-426e-9c80-b6eb669270b1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"
Sep 18 20:11:57.237573 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.237511    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28m6m\" (UniqueName: \"kubernetes.io/projected/9a728fd3-bbbc-426e-9c80-b6eb669270b1-kube-api-access-28m6m\") pod \"payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7\" (UID: \"9a728fd3-bbbc-426e-9c80-b6eb669270b1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"
Sep 18 20:11:57.338947 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.338866    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a728fd3-bbbc-426e-9c80-b6eb669270b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7\" (UID: \"9a728fd3-bbbc-426e-9c80-b6eb669270b1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"
Sep 18 20:11:57.338947 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.338899    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28m6m\" (UniqueName: \"kubernetes.io/projected/9a728fd3-bbbc-426e-9c80-b6eb669270b1-kube-api-access-28m6m\") pod \"payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7\" (UID: \"9a728fd3-bbbc-426e-9c80-b6eb669270b1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"
Sep 18 20:11:57.339155 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.338959    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8416c2ef-9849-4f37-acb1-c62b50b698bb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s\" (UID: \"8416c2ef-9849-4f37-acb1-c62b50b698bb\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"
Sep 18 20:11:57.339155 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.338992    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc8jw\" (UniqueName: \"kubernetes.io/projected/8416c2ef-9849-4f37-acb1-c62b50b698bb-kube-api-access-cc8jw\") pod \"payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s\" (UID: \"8416c2ef-9849-4f37-acb1-c62b50b698bb\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"
Sep 18 20:11:57.339591 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.339569    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a728fd3-bbbc-426e-9c80-b6eb669270b1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7\" (UID: \"9a728fd3-bbbc-426e-9c80-b6eb669270b1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"
Sep 18 20:11:57.339690 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.339670    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8416c2ef-9849-4f37-acb1-c62b50b698bb-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s\" (UID: \"8416c2ef-9849-4f37-acb1-c62b50b698bb\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"
Sep 18 20:11:57.347295 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.347270    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc8jw\" (UniqueName: \"kubernetes.io/projected/8416c2ef-9849-4f37-acb1-c62b50b698bb-kube-api-access-cc8jw\") pod \"payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s\" (UID: \"8416c2ef-9849-4f37-acb1-c62b50b698bb\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"
Sep 18 20:11:57.347564 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.347544    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28m6m\" (UniqueName: \"kubernetes.io/projected/9a728fd3-bbbc-426e-9c80-b6eb669270b1-kube-api-access-28m6m\") pod \"payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7\" (UID: \"9a728fd3-bbbc-426e-9c80-b6eb669270b1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"
Sep 18 20:11:57.408120 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.408087    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"
Sep 18 20:11:57.444510 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.444479    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"
Sep 18 20:11:57.682524 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.682500    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"]
Sep 18 20:11:57.684262 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:11:57.684241    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a728fd3_bbbc_426e_9c80_b6eb669270b1.slice/crio-96ad3114f215ed4694839b7c70637d4f7d8d103c7417796bcb8c2ab74b8be4a9 WatchSource:0}: Error finding container 96ad3114f215ed4694839b7c70637d4f7d8d103c7417796bcb8c2ab74b8be4a9: Status 404 returned error can't find the container with id 96ad3114f215ed4694839b7c70637d4f7d8d103c7417796bcb8c2ab74b8be4a9
Sep 18 20:11:57.736471 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.736424    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"]
Sep 18 20:11:57.738224 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:11:57.738194    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8416c2ef_9849_4f37_acb1_c62b50b698bb.slice/crio-88a4451fd760ab7ebd32b8f4aa018ef64d16bb587e59068250b147c2eb770708 WatchSource:0}: Error finding container 88a4451fd760ab7ebd32b8f4aa018ef64d16bb587e59068250b147c2eb770708: Status 404 returned error can't find the container with id 88a4451fd760ab7ebd32b8f4aa018ef64d16bb587e59068250b147c2eb770708
Sep 18 20:11:57.984577 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.984482    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s" event={"ID":"8416c2ef-9849-4f37-acb1-c62b50b698bb","Type":"ContainerStarted","Data":"e30cfc6c4f126e34cf91a693061ca64d9381539bea231cc89039b74b1f142f4d"}
Sep 18 20:11:57.984577 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.984537    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s" event={"ID":"8416c2ef-9849-4f37-acb1-c62b50b698bb","Type":"ContainerStarted","Data":"88a4451fd760ab7ebd32b8f4aa018ef64d16bb587e59068250b147c2eb770708"}
Sep 18 20:11:57.984865 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.984593    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"
Sep 18 20:11:57.986219 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.986192    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7" event={"ID":"9a728fd3-bbbc-426e-9c80-b6eb669270b1","Type":"ContainerStarted","Data":"214970a605a0482cddcc8c9255de014b3cc58f61a9317b3ed9fffedc309ec6d3"}
Sep 18 20:11:57.986346 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.986237    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7" event={"ID":"9a728fd3-bbbc-426e-9c80-b6eb669270b1","Type":"ContainerStarted","Data":"96ad3114f215ed4694839b7c70637d4f7d8d103c7417796bcb8c2ab74b8be4a9"}
Sep 18 20:11:57.986346 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:57.986270    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"
Sep 18 20:11:58.004425 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:11:58.004361    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s" podStartSLOduration=1.00434613 podStartE2EDuration="1.00434613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:11:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:11:58.001264916 +0000 UTC m=+1960.328358673" watchObservedRunningTime="2026-09-18 20:11:58.00434613 +0000 UTC m=+1960.331439893"
Sep 18 20:12:05.380873 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.380807    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826" podUID="4725d497-b041-4180-96b7-8011220923d1" containerName="main" containerID="cri-o://33a2c8b58cff3bf33891c33a2218b6882ef06ce5d816b8507a51886cd6bfff2d" gracePeriod=45
Sep 18 20:12:05.682377 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.682354    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:12:05.701384 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.701327    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7" podStartSLOduration=8.701306049 podStartE2EDuration="8.701306049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:11:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:11:58.017701412 +0000 UTC m=+1960.344795176" watchObservedRunningTime="2026-09-18 20:12:05.701306049 +0000 UTC m=+1968.028399814"
Sep 18 20:12:05.828407 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.828367    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-dshm\") pod \"4725d497-b041-4180-96b7-8011220923d1\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") "
Sep 18 20:12:05.828602 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.828446    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njgz8\" (UniqueName: \"kubernetes.io/projected/4725d497-b041-4180-96b7-8011220923d1-kube-api-access-njgz8\") pod \"4725d497-b041-4180-96b7-8011220923d1\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") "
Sep 18 20:12:05.828602 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.828489    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4725d497-b041-4180-96b7-8011220923d1-tls-certs\") pod \"4725d497-b041-4180-96b7-8011220923d1\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") "
Sep 18 20:12:05.828602 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.828518    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-home\") pod \"4725d497-b041-4180-96b7-8011220923d1\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") "
Sep 18 20:12:05.828602 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.828550    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-model-cache\") pod \"4725d497-b041-4180-96b7-8011220923d1\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") "
Sep 18 20:12:05.828602 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.828590    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-tmp-dir\") pod \"4725d497-b041-4180-96b7-8011220923d1\" (UID: \"4725d497-b041-4180-96b7-8011220923d1\") "
Sep 18 20:12:05.829650 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.829088    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4725d497-b041-4180-96b7-8011220923d1" (UID: "4725d497-b041-4180-96b7-8011220923d1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:12:05.831769 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.831727    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-home" (OuterVolumeSpecName: "home") pod "4725d497-b041-4180-96b7-8011220923d1" (UID: "4725d497-b041-4180-96b7-8011220923d1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:12:05.837060 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.831878    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-model-cache" (OuterVolumeSpecName: "model-cache") pod "4725d497-b041-4180-96b7-8011220923d1" (UID: "4725d497-b041-4180-96b7-8011220923d1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:12:05.837572 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.837541    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4725d497-b041-4180-96b7-8011220923d1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4725d497-b041-4180-96b7-8011220923d1" (UID: "4725d497-b041-4180-96b7-8011220923d1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:12:05.837830 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.837804    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4725d497-b041-4180-96b7-8011220923d1-kube-api-access-njgz8" (OuterVolumeSpecName: "kube-api-access-njgz8") pod "4725d497-b041-4180-96b7-8011220923d1" (UID: "4725d497-b041-4180-96b7-8011220923d1"). InnerVolumeSpecName "kube-api-access-njgz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:12:05.838137 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.838120    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-dshm" (OuterVolumeSpecName: "dshm") pod "4725d497-b041-4180-96b7-8011220923d1" (UID: "4725d497-b041-4180-96b7-8011220923d1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:12:05.929833 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.929718    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:12:05.929833 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.929763    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njgz8\" (UniqueName: \"kubernetes.io/projected/4725d497-b041-4180-96b7-8011220923d1-kube-api-access-njgz8\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:12:05.929833 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.929782    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4725d497-b041-4180-96b7-8011220923d1-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:12:05.929833 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.929796    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:12:05.929833 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.929808    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:12:05.929833 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:05.929826    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4725d497-b041-4180-96b7-8011220923d1-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:12:06.051606 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:06.051439    2583 generic.go:356] "Generic (PLEG): container finished" podID="4725d497-b041-4180-96b7-8011220923d1" containerID="33a2c8b58cff3bf33891c33a2218b6882ef06ce5d816b8507a51886cd6bfff2d" exitCode=0
Sep 18 20:12:06.051606 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:06.051482    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"
Sep 18 20:12:06.051606 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:06.051521    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826" event={"ID":"4725d497-b041-4180-96b7-8011220923d1","Type":"ContainerDied","Data":"33a2c8b58cff3bf33891c33a2218b6882ef06ce5d816b8507a51886cd6bfff2d"}
Sep 18 20:12:06.051606 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:06.051557    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826" event={"ID":"4725d497-b041-4180-96b7-8011220923d1","Type":"ContainerDied","Data":"de9f30080c09dc30fca27b9e7b1380afdaf6914e582cb655cebfd272c58fa8b2"}
Sep 18 20:12:06.051606 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:06.051573    2583 scope.go:117] "RemoveContainer" containerID="33a2c8b58cff3bf33891c33a2218b6882ef06ce5d816b8507a51886cd6bfff2d"
Sep 18 20:12:06.063269 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:06.063023    2583 scope.go:117] "RemoveContainer" containerID="33a2c8b58cff3bf33891c33a2218b6882ef06ce5d816b8507a51886cd6bfff2d"
Sep 18 20:12:06.063505 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:12:06.063481    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33a2c8b58cff3bf33891c33a2218b6882ef06ce5d816b8507a51886cd6bfff2d\": container with ID starting with 33a2c8b58cff3bf33891c33a2218b6882ef06ce5d816b8507a51886cd6bfff2d not found: ID does not exist" containerID="33a2c8b58cff3bf33891c33a2218b6882ef06ce5d816b8507a51886cd6bfff2d"
Sep 18 20:12:06.063547 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:06.063515    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33a2c8b58cff3bf33891c33a2218b6882ef06ce5d816b8507a51886cd6bfff2d"} err="failed to get container status \"33a2c8b58cff3bf33891c33a2218b6882ef06ce5d816b8507a51886cd6bfff2d\": rpc error: code = NotFound desc = could not find container \"33a2c8b58cff3bf33891c33a2218b6882ef06ce5d816b8507a51886cd6bfff2d\": container with ID starting with 33a2c8b58cff3bf33891c33a2218b6882ef06ce5d816b8507a51886cd6bfff2d not found: ID does not exist"
Sep 18 20:12:06.077961 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:06.077934    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"]
Sep 18 20:12:06.081948 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:06.081926    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-57b6ce/rate-test-model-57b6ce-kserve-849d9599dc-98826"]
Sep 18 20:12:07.812791 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:07.812752    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4725d497-b041-4180-96b7-8011220923d1" path="/var/lib/kubelet/pods/4725d497-b041-4180-96b7-8011220923d1/volumes"
Sep 18 20:12:08.995258 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:08.995226    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"
Sep 18 20:12:08.995604 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:08.995319    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"
Sep 18 20:12:10.002266 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:10.002221    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 18 20:12:10.002655 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:10.002292    2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6" podUID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 18 20:12:12.091321 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:12.091288    2583 generic.go:356] "Generic (PLEG): container finished" podID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerID="3fdaa13aaa51cdfb63dadb796b50c66af1d5699e5e006c3744afddf8c46a593b" exitCode=0
Sep 18 20:12:12.091857 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:12.091366    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6" event={"ID":"206b4006-42b6-42f8-8d86-5a17e31e57c2","Type":"ContainerDied","Data":"3fdaa13aaa51cdfb63dadb796b50c66af1d5699e5e006c3744afddf8c46a593b"}
Sep 18 20:12:12.091939 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:12.091870    2583 scope.go:117] "RemoveContainer" containerID="3fdaa13aaa51cdfb63dadb796b50c66af1d5699e5e006c3744afddf8c46a593b"
Sep 18 20:12:12.092960 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:12.092933    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:12:12.093015 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:12.093003    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:12:12.093069 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:12.093056    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:12:13.100298 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:13.100262    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6" event={"ID":"206b4006-42b6-42f8-8d86-5a17e31e57c2","Type":"ContainerStarted","Data":"60f627e776b3c23b3d3fa6d572382c7c4d2c8e0be9b7d9f9ecf488ae8c837a02"}
Sep 18 20:12:13.412227 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:13.412118    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:12:13.412552 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:13.412522    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Sep 18 20:12:13.412633 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:13.412600    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6" podUID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Sep 18 20:12:14.412060 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:14.412008    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Sep 18 20:12:14.412548 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:14.412107    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6" podUID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Sep 18 20:12:15.412107 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:15.412031    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Sep 18 20:12:15.412693 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:15.412659    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6" podUID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Sep 18 20:12:16.412142 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:16.412099    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Sep 18 20:12:16.412766 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:16.412725    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6" podUID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Sep 18 20:12:17.411495 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:17.411455    2583 patch_prober.go:28] interesting pod/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Sep 18 20:12:17.411808 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:17.411775    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6" podUID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Sep 18 20:12:18.415313 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:18.415281    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:12:18.415714 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:18.415563    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:12:18.416118 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:18.416102    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:12:18.546638 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:18.546611    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:19.291648 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:19.291613    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:19.889902 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:19.889873    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:20.161146 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.161066    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:20.534507 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.534403    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:20.808184 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.808111    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"]
Sep 18 20:12:20.808541 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.808527    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4725d497-b041-4180-96b7-8011220923d1" containerName="main"
Sep 18 20:12:20.808595 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.808543    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4725d497-b041-4180-96b7-8011220923d1" containerName="main"
Sep 18 20:12:20.808641 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.808605    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4725d497-b041-4180-96b7-8011220923d1" containerName="main"
Sep 18 20:12:20.811613 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.811589    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.814533 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.814509    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-9c0eb2-openshift-default-dockercfg-l48jc\""
Sep 18 20:12:20.826856 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.826826    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"]
Sep 18 20:12:20.836534 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.836502    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:20.877025 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.876990    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-envoy\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.877221 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.877097    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjhnr\" (UniqueName: \"kubernetes.io/projected/7d1d855f-ba5e-47a1-8751-c33748da2f49-kube-api-access-tjhnr\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.877282 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.877259    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-podinfo\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.877344 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.877294    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d1d855f-ba5e-47a1-8751-c33748da2f49-istiod-ca-cert\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.877406 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.877350    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-data\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.877469 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.877421    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-credential-socket\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.877469 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.877442    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-workload-certs\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.877469 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.877466    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-token\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.877585 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.877488    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-workload-socket\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.938071 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.938018    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:20.958920 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.958891    2583 scope.go:117] "RemoveContainer" containerID="c6fbfbdde0c718bdf0ff4d44c6352af0b14409e4a53c3dec69dcfeb3ddc25ddc"
Sep 18 20:12:20.978823 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.978786    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-credential-socket\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.978930 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.978839    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-workload-certs\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.978930 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.978874    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-token\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.978930 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.978902    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-workload-socket\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.979122 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.978931    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-envoy\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.979122 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.978972    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjhnr\" (UniqueName: \"kubernetes.io/projected/7d1d855f-ba5e-47a1-8751-c33748da2f49-kube-api-access-tjhnr\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.979122 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.979012    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-podinfo\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.979122 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.979059    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d1d855f-ba5e-47a1-8751-c33748da2f49-istiod-ca-cert\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.979122 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.979100    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-data\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.979563 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.979540    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-data\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.979804 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.979783    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-credential-socket\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.980055 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.980022    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-workload-certs\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.980761 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.980706    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-workload-socket\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.980933 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.980910    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d1d855f-ba5e-47a1-8751-c33748da2f49-istiod-ca-cert\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.982667 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.982646    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-podinfo\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.982919 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.982895    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-envoy\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.988083 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.988059    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjhnr\" (UniqueName: \"kubernetes.io/projected/7d1d855f-ba5e-47a1-8751-c33748da2f49-kube-api-access-tjhnr\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:20.988323 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:20.988303    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-token\") pod \"e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") " pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:21.038508 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:21.038473    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:21.124403 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:21.124368    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:21.402697 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:21.402664    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"]
Sep 18 20:12:21.404228 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:12:21.404203    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1d855f_ba5e_47a1_8751_c33748da2f49.slice/crio-44f9a7f0686047aef9b3b721c0fc4f58da3db1119b30791ce200c5304a1681b9 WatchSource:0}: Error finding container 44f9a7f0686047aef9b3b721c0fc4f58da3db1119b30791ce200c5304a1681b9: Status 404 returned error can't find the container with id 44f9a7f0686047aef9b3b721c0fc4f58da3db1119b30791ce200c5304a1681b9
Sep 18 20:12:21.406496 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:21.406459    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:12:21.406595 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:21.406528    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:12:21.406595 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:21.406557    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:12:22.173114 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:22.173078    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh" event={"ID":"7d1d855f-ba5e-47a1-8751-c33748da2f49","Type":"ContainerStarted","Data":"56cb6768cc5bcf604349d01dd22df47032d9ddceca7f870bb1636daf9f7e0a48"}
Sep 18 20:12:22.173504 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:22.173136    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh" event={"ID":"7d1d855f-ba5e-47a1-8751-c33748da2f49","Type":"ContainerStarted","Data":"44f9a7f0686047aef9b3b721c0fc4f58da3db1119b30791ce200c5304a1681b9"}
Sep 18 20:12:22.197232 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:22.197179    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh" podStartSLOduration=2.197164919 podStartE2EDuration="2.197164919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:12:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:12:22.195294761 +0000 UTC m=+1984.522388520" watchObservedRunningTime="2026-09-18 20:12:22.197164919 +0000 UTC m=+1984.524258687"
Sep 18 20:12:23.124989 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:23.124952    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:23.130072 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:23.130031    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:23.178391 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:23.178357    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:23.179225 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:23.179206    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:23.423101 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:23.422999    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:24.130401 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:24.130370    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:24.225988 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:24.225957    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:24.899089 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:24.899028    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:25.649521 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:25.649494    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:26.349781 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:26.349754    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:26.451606 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:26.451574    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:26.593196 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:26.593162    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:26.824543 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:26.824463    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:26.907731 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:26.907697    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:36.432410 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:36.432373    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:42.292052 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:42.292013    2583 generic.go:356] "Generic (PLEG): container finished" podID="7d1d855f-ba5e-47a1-8751-c33748da2f49" containerID="56cb6768cc5bcf604349d01dd22df47032d9ddceca7f870bb1636daf9f7e0a48" exitCode=0
Sep 18 20:12:42.292499 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:42.292086    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh" event={"ID":"7d1d855f-ba5e-47a1-8751-c33748da2f49","Type":"ContainerDied","Data":"56cb6768cc5bcf604349d01dd22df47032d9ddceca7f870bb1636daf9f7e0a48"}
Sep 18 20:12:42.292570 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:42.292553    2583 scope.go:117] "RemoveContainer" containerID="56cb6768cc5bcf604349d01dd22df47032d9ddceca7f870bb1636daf9f7e0a48"
Sep 18 20:12:42.293665 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:42.293637    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:12:42.293742 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:42.293730    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:12:42.293781 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:42.293763    2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 18 20:12:43.299967 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:43.299933    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh" event={"ID":"7d1d855f-ba5e-47a1-8751-c33748da2f49","Type":"ContainerStarted","Data":"ef7a33312365d28e17897233ec5603a0e47f9a2094d882e93ecb8c3cbededda6"}
Sep 18 20:12:44.124674 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:44.124630    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:44.125118 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:44.125091    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Sep 18 20:12:44.125250 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:44.125143    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh" podUID="7d1d855f-ba5e-47a1-8751-c33748da2f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Sep 18 20:12:45.125432 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:45.125385    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Sep 18 20:12:45.125944 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:45.125455    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh" podUID="7d1d855f-ba5e-47a1-8751-c33748da2f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Sep 18 20:12:46.125794 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:46.125754    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Sep 18 20:12:46.126286 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:46.125827    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh" podUID="7d1d855f-ba5e-47a1-8751-c33748da2f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Sep 18 20:12:47.125533 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:47.125478    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Sep 18 20:12:47.125738 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:47.125558    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh" podUID="7d1d855f-ba5e-47a1-8751-c33748da2f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Sep 18 20:12:48.125406 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:48.125353    2583 patch_prober.go:28] interesting pod/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Sep 18 20:12:48.125941 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:48.125431    2583 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh" podUID="7d1d855f-ba5e-47a1-8751-c33748da2f49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Sep 18 20:12:48.407735 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:48.407650    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:49.052268 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:49.052236    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:49.129362 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:49.129330    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:49.129795 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:49.129610    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:49.130293 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:49.130277    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:12:49.181308 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:49.181277    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:49.847684 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:49.847654    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:50.516449 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:50.516419    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:12:51.490785 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:12:51.490758    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:02.666835 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:02.666807    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:14.064964 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:14.064934    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:16.826200 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:16.826164    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:25.166285 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:25.166255    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s_8416c2ef-9849-4f37-acb1-c62b50b698bb/payload-processing/0.log"
Sep 18 20:13:25.710110 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:25.710079    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:26.058577 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:26.058498    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:26.385414 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:26.385378    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:28.369684 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:28.369648    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:28.984529 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:28.984492    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:29.102606 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:29.102570    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:29.613228 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:29.613196    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:30.790355 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:30.790317    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:31.731998 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:31.731920    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:32.523592 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:32.523560    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:33.436780 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:33.436746    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:33.536459 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:33.536430    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:33.689241 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:33.689163    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:33.942123 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:33.942027    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:34.041709 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.041679    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:34.055540 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.055511    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"]
Sep 18 20:13:34.059328 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.059311    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"
Sep 18 20:13:34.061815 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.061790    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-e91414\""
Sep 18 20:13:34.070403 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.070383    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"]
Sep 18 20:13:34.080151 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.080124    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"]
Sep 18 20:13:34.084490 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.084472    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"
Sep 18 20:13:34.087080 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.087060    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-e91414-dockercfg-6c5pp\""
Sep 18 20:13:34.096648 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.096629    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"]
Sep 18 20:13:34.167192 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.167163    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87f9677c-60fd-49ac-9dfb-3cb406fb00aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx\" (UID: \"87f9677c-60fd-49ac-9dfb-3cb406fb00aa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"
Sep 18 20:13:34.167192 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.167194    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebc6bc52-2996-4969-81a0-9c42203159b0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj\" (UID: \"ebc6bc52-2996-4969-81a0-9c42203159b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"
Sep 18 20:13:34.167379 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.167266    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfj4w\" (UniqueName: \"kubernetes.io/projected/ebc6bc52-2996-4969-81a0-9c42203159b0-kube-api-access-qfj4w\") pod \"payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj\" (UID: \"ebc6bc52-2996-4969-81a0-9c42203159b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"
Sep 18 20:13:34.167379 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.167309    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsskx\" (UniqueName: \"kubernetes.io/projected/87f9677c-60fd-49ac-9dfb-3cb406fb00aa-kube-api-access-xsskx\") pod \"payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx\" (UID: \"87f9677c-60fd-49ac-9dfb-3cb406fb00aa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"
Sep 18 20:13:34.268770 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.268674    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87f9677c-60fd-49ac-9dfb-3cb406fb00aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx\" (UID: \"87f9677c-60fd-49ac-9dfb-3cb406fb00aa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"
Sep 18 20:13:34.268770 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.268716    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebc6bc52-2996-4969-81a0-9c42203159b0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj\" (UID: \"ebc6bc52-2996-4969-81a0-9c42203159b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"
Sep 18 20:13:34.268988 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.268787    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfj4w\" (UniqueName: \"kubernetes.io/projected/ebc6bc52-2996-4969-81a0-9c42203159b0-kube-api-access-qfj4w\") pod \"payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj\" (UID: \"ebc6bc52-2996-4969-81a0-9c42203159b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"
Sep 18 20:13:34.268988 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.268825    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsskx\" (UniqueName: \"kubernetes.io/projected/87f9677c-60fd-49ac-9dfb-3cb406fb00aa-kube-api-access-xsskx\") pod \"payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx\" (UID: \"87f9677c-60fd-49ac-9dfb-3cb406fb00aa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"
Sep 18 20:13:34.269697 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.269671    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebc6bc52-2996-4969-81a0-9c42203159b0-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj\" (UID: \"ebc6bc52-2996-4969-81a0-9c42203159b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"
Sep 18 20:13:34.269742 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.269671    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87f9677c-60fd-49ac-9dfb-3cb406fb00aa-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx\" (UID: \"87f9677c-60fd-49ac-9dfb-3cb406fb00aa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"
Sep 18 20:13:34.278274 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.278247    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsskx\" (UniqueName: \"kubernetes.io/projected/87f9677c-60fd-49ac-9dfb-3cb406fb00aa-kube-api-access-xsskx\") pod \"payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx\" (UID: \"87f9677c-60fd-49ac-9dfb-3cb406fb00aa\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"
Sep 18 20:13:34.278420 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.278400    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfj4w\" (UniqueName: \"kubernetes.io/projected/ebc6bc52-2996-4969-81a0-9c42203159b0-kube-api-access-qfj4w\") pod \"payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj\" (UID: \"ebc6bc52-2996-4969-81a0-9c42203159b0\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"
Sep 18 20:13:34.371374 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.371341    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"
Sep 18 20:13:34.395852 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.395646    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"
Sep 18 20:13:34.650030 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.649999    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"]
Sep 18 20:13:34.650956 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:13:34.650932    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f9677c_60fd_49ac_9dfb_3cb406fb00aa.slice/crio-3acf08c95071b60faa264ea1ffa5153fe88456c4490d67649923e3ec6c725661 WatchSource:0}: Error finding container 3acf08c95071b60faa264ea1ffa5153fe88456c4490d67649923e3ec6c725661: Status 404 returned error can't find the container with id 3acf08c95071b60faa264ea1ffa5153fe88456c4490d67649923e3ec6c725661
Sep 18 20:13:34.683536 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:34.683511    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"]
Sep 18 20:13:34.687145 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:13:34.687122    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc6bc52_2996_4969_81a0_9c42203159b0.slice/crio-7bf08714f6e7ac422cdd8039540edd791e4175e0951056482df0a2d0f1530dd4 WatchSource:0}: Error finding container 7bf08714f6e7ac422cdd8039540edd791e4175e0951056482df0a2d0f1530dd4: Status 404 returned error can't find the container with id 7bf08714f6e7ac422cdd8039540edd791e4175e0951056482df0a2d0f1530dd4
Sep 18 20:13:35.610235 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:35.610201    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx" event={"ID":"87f9677c-60fd-49ac-9dfb-3cb406fb00aa","Type":"ContainerStarted","Data":"77dd57ffa0f7e6f48ea5346ecacb0221848bc060cbd33b8ded51289a826bb237"}
Sep 18 20:13:35.610417 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:35.610265    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"
Sep 18 20:13:35.610417 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:35.610288    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx" event={"ID":"87f9677c-60fd-49ac-9dfb-3cb406fb00aa","Type":"ContainerStarted","Data":"3acf08c95071b60faa264ea1ffa5153fe88456c4490d67649923e3ec6c725661"}
Sep 18 20:13:35.611941 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:35.611915    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj" event={"ID":"ebc6bc52-2996-4969-81a0-9c42203159b0","Type":"ContainerStarted","Data":"d832ad467f5f6bfdfba0967ead3451e6d2c63fd61286fcd103a2c95afdc20639"}
Sep 18 20:13:35.612098 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:35.611958    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj" event={"ID":"ebc6bc52-2996-4969-81a0-9c42203159b0","Type":"ContainerStarted","Data":"7bf08714f6e7ac422cdd8039540edd791e4175e0951056482df0a2d0f1530dd4"}
Sep 18 20:13:35.612098 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:35.611979    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"
Sep 18 20:13:35.627555 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:35.627515    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx" podStartSLOduration=1.627500123 podStartE2EDuration="1.627500123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:13:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:13:35.626137085 +0000 UTC m=+2057.953230851" watchObservedRunningTime="2026-09-18 20:13:35.627500123 +0000 UTC m=+2057.954593887"
Sep 18 20:13:35.644823 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:35.644780    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj" podStartSLOduration=1.64476455 podStartE2EDuration="1.64476455s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:13:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:13:35.64200014 +0000 UTC m=+2057.969093904" watchObservedRunningTime="2026-09-18 20:13:35.64476455 +0000 UTC m=+2057.971858314"
Sep 18 20:13:46.528763 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:46.528721    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:46.619752 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:46.619714    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"
Sep 18 20:13:46.620290 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:46.620267    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"
Sep 18 20:13:54.385638 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:54.385576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:56.011845 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:56.011783    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:56.739715 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:56.739683    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:57.399847 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:57.399804    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:58.137367 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:58.137336    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:58.237397 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:58.237365    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:58.337427 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:58.337399    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:58.989794 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:58.989752    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:59.089437 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:59.089409    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:59.759362 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:59.759329    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4"]
Sep 18 20:13:59.762716 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:59.762698    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4"
Sep 18 20:13:59.765621 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:59.765602    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 20:13:59.765738 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:59.765605    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 20:13:59.772545 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:59.772522    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4"]
Sep 18 20:13:59.784847 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:59.784822    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:13:59.803100 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:59.803078    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a73bef-0c05-4b13-a0dd-c7dc8375d677-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4\" (UID: \"72a73bef-0c05-4b13-a0dd-c7dc8375d677\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4"
Sep 18 20:13:59.903969 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:59.903937    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a73bef-0c05-4b13-a0dd-c7dc8375d677-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4\" (UID: \"72a73bef-0c05-4b13-a0dd-c7dc8375d677\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4"
Sep 18 20:13:59.904536 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:13:59.904520    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a73bef-0c05-4b13-a0dd-c7dc8375d677-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4\" (UID: \"72a73bef-0c05-4b13-a0dd-c7dc8375d677\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4"
Sep 18 20:14:00.075555 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:00.075473    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4"
Sep 18 20:14:00.348617 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:00.348590    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4"]
Sep 18 20:14:00.350278 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:14:00.350254    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a73bef_0c05_4b13_a0dd_c7dc8375d677.slice/crio-d72f8464604c502673d9910e82a831c18aa67e90d62850586257b01c2b52591e WatchSource:0}: Error finding container d72f8464604c502673d9910e82a831c18aa67e90d62850586257b01c2b52591e: Status 404 returned error can't find the container with id d72f8464604c502673d9910e82a831c18aa67e90d62850586257b01c2b52591e
Sep 18 20:14:00.510812 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:00.510780    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:00.760835 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:00.760797    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4" event={"ID":"72a73bef-0c05-4b13-a0dd-c7dc8375d677","Type":"ContainerStarted","Data":"cefee588f84df97b04f4106904da4b30d1f4ddc6dfc4d5d6d639d464a4c58784"}
Sep 18 20:14:00.761077 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:00.760851    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4" event={"ID":"72a73bef-0c05-4b13-a0dd-c7dc8375d677","Type":"ContainerStarted","Data":"d72f8464604c502673d9910e82a831c18aa67e90d62850586257b01c2b52591e"}
Sep 18 20:14:00.777980 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:00.777933    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4" podStartSLOduration=1.777917027 podStartE2EDuration="1.777917027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:13:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:14:00.776632115 +0000 UTC m=+2083.103725887" watchObservedRunningTime="2026-09-18 20:14:00.777917027 +0000 UTC m=+2083.105010791"
Sep 18 20:14:01.207752 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:01.207722    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:01.767945 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:01.767905    2583 generic.go:356] "Generic (PLEG): container finished" podID="72a73bef-0c05-4b13-a0dd-c7dc8375d677" containerID="cefee588f84df97b04f4106904da4b30d1f4ddc6dfc4d5d6d639d464a4c58784" exitCode=0
Sep 18 20:14:01.768135 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:01.767985    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4" event={"ID":"72a73bef-0c05-4b13-a0dd-c7dc8375d677","Type":"ContainerDied","Data":"cefee588f84df97b04f4106904da4b30d1f4ddc6dfc4d5d6d639d464a4c58784"}
Sep 18 20:14:02.017142 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:02.017116    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:02.675227 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:02.675199    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:02.905547 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:02.905525    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4"
Sep 18 20:14:03.032217 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:03.032143    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a73bef-0c05-4b13-a0dd-c7dc8375d677-maas-api-service-ca\") pod \"72a73bef-0c05-4b13-a0dd-c7dc8375d677\" (UID: \"72a73bef-0c05-4b13-a0dd-c7dc8375d677\") "
Sep 18 20:14:03.032547 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:03.032527    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72a73bef-0c05-4b13-a0dd-c7dc8375d677-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "72a73bef-0c05-4b13-a0dd-c7dc8375d677" (UID: "72a73bef-0c05-4b13-a0dd-c7dc8375d677"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:14:03.133591 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:03.133558    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/72a73bef-0c05-4b13-a0dd-c7dc8375d677-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:14:03.341087 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:03.341059    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:03.549131 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:03.549100    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:03.649263 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:03.649191    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:03.781569 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:03.781544    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4"
Sep 18 20:14:03.781569 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:03.781553    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4" event={"ID":"72a73bef-0c05-4b13-a0dd-c7dc8375d677","Type":"ContainerDied","Data":"d72f8464604c502673d9910e82a831c18aa67e90d62850586257b01c2b52591e"}
Sep 18 20:14:03.781998 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:03.781625    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d72f8464604c502673d9910e82a831c18aa67e90d62850586257b01c2b52591e"
Sep 18 20:14:04.118212 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:04.118181    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:10.890528 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:10.890479    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:10.958943 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:10.958908    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"]
Sep 18 20:14:10.959253 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:10.959223    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj" podUID="ebc6bc52-2996-4969-81a0-9c42203159b0" containerName="payload-processing" containerID="cri-o://d832ad467f5f6bfdfba0967ead3451e6d2c63fd61286fcd103a2c95afdc20639" gracePeriod=30
Sep 18 20:14:10.965339 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:10.965313    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"]
Sep 18 20:14:10.965738 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:10.965690    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx" podUID="87f9677c-60fd-49ac-9dfb-3cb406fb00aa" containerName="payload-pre-processing" containerID="cri-o://77dd57ffa0f7e6f48ea5346ecacb0221848bc060cbd33b8ded51289a826bb237" gracePeriod=30
Sep 18 20:14:10.992365 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:10.992329    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:11.092342 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.092310    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:11.124779 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.124744    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4"]
Sep 18 20:14:11.127490 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.127462    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-e91414-rt5m4"]
Sep 18 20:14:11.171440 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.171403    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:11.233758 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.233734    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"
Sep 18 20:14:11.279582 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.277068    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"
Sep 18 20:14:11.309173 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.309144    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebc6bc52-2996-4969-81a0-9c42203159b0-plugins-config-volume\") pod \"ebc6bc52-2996-4969-81a0-9c42203159b0\" (UID: \"ebc6bc52-2996-4969-81a0-9c42203159b0\") "
Sep 18 20:14:11.309341 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.309208    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfj4w\" (UniqueName: \"kubernetes.io/projected/ebc6bc52-2996-4969-81a0-9c42203159b0-kube-api-access-qfj4w\") pod \"ebc6bc52-2996-4969-81a0-9c42203159b0\" (UID: \"ebc6bc52-2996-4969-81a0-9c42203159b0\") "
Sep 18 20:14:11.309538 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.309517    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebc6bc52-2996-4969-81a0-9c42203159b0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ebc6bc52-2996-4969-81a0-9c42203159b0" (UID: "ebc6bc52-2996-4969-81a0-9c42203159b0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:14:11.309645 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.309624    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebc6bc52-2996-4969-81a0-9c42203159b0-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:14:11.311988 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.311963    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebc6bc52-2996-4969-81a0-9c42203159b0-kube-api-access-qfj4w" (OuterVolumeSpecName: "kube-api-access-qfj4w") pod "ebc6bc52-2996-4969-81a0-9c42203159b0" (UID: "ebc6bc52-2996-4969-81a0-9c42203159b0"). InnerVolumeSpecName "kube-api-access-qfj4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:14:11.410207 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.410177    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsskx\" (UniqueName: \"kubernetes.io/projected/87f9677c-60fd-49ac-9dfb-3cb406fb00aa-kube-api-access-xsskx\") pod \"87f9677c-60fd-49ac-9dfb-3cb406fb00aa\" (UID: \"87f9677c-60fd-49ac-9dfb-3cb406fb00aa\") "
Sep 18 20:14:11.410409 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.410237    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87f9677c-60fd-49ac-9dfb-3cb406fb00aa-plugins-config-volume\") pod \"87f9677c-60fd-49ac-9dfb-3cb406fb00aa\" (UID: \"87f9677c-60fd-49ac-9dfb-3cb406fb00aa\") "
Sep 18 20:14:11.410483 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.410424    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfj4w\" (UniqueName: \"kubernetes.io/projected/ebc6bc52-2996-4969-81a0-9c42203159b0-kube-api-access-qfj4w\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:14:11.410668 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.410643    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87f9677c-60fd-49ac-9dfb-3cb406fb00aa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "87f9677c-60fd-49ac-9dfb-3cb406fb00aa" (UID: "87f9677c-60fd-49ac-9dfb-3cb406fb00aa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:14:11.412310 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.412280    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87f9677c-60fd-49ac-9dfb-3cb406fb00aa-kube-api-access-xsskx" (OuterVolumeSpecName: "kube-api-access-xsskx") pod "87f9677c-60fd-49ac-9dfb-3cb406fb00aa" (UID: "87f9677c-60fd-49ac-9dfb-3cb406fb00aa"). InnerVolumeSpecName "kube-api-access-xsskx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:14:11.503474 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.503399    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:11.511711 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.511679    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87f9677c-60fd-49ac-9dfb-3cb406fb00aa-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:14:11.511711 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.511708    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsskx\" (UniqueName: \"kubernetes.io/projected/87f9677c-60fd-49ac-9dfb-3cb406fb00aa-kube-api-access-xsskx\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:14:11.605200 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.605169    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:11.811751 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.811655    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72a73bef-0c05-4b13-a0dd-c7dc8375d677" path="/var/lib/kubelet/pods/72a73bef-0c05-4b13-a0dd-c7dc8375d677/volumes"
Sep 18 20:14:11.828064 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.828024    2583 generic.go:356] "Generic (PLEG): container finished" podID="ebc6bc52-2996-4969-81a0-9c42203159b0" containerID="d832ad467f5f6bfdfba0967ead3451e6d2c63fd61286fcd103a2c95afdc20639" exitCode=0
Sep 18 20:14:11.828178 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.828070    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj" event={"ID":"ebc6bc52-2996-4969-81a0-9c42203159b0","Type":"ContainerDied","Data":"d832ad467f5f6bfdfba0967ead3451e6d2c63fd61286fcd103a2c95afdc20639"}
Sep 18 20:14:11.828178 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.828090    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"
Sep 18 20:14:11.828178 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.828120    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj" event={"ID":"ebc6bc52-2996-4969-81a0-9c42203159b0","Type":"ContainerDied","Data":"7bf08714f6e7ac422cdd8039540edd791e4175e0951056482df0a2d0f1530dd4"}
Sep 18 20:14:11.828178 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.828141    2583 scope.go:117] "RemoveContainer" containerID="d832ad467f5f6bfdfba0967ead3451e6d2c63fd61286fcd103a2c95afdc20639"
Sep 18 20:14:11.829579 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.829555    2583 generic.go:356] "Generic (PLEG): container finished" podID="87f9677c-60fd-49ac-9dfb-3cb406fb00aa" containerID="77dd57ffa0f7e6f48ea5346ecacb0221848bc060cbd33b8ded51289a826bb237" exitCode=0
Sep 18 20:14:11.829678 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.829600    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx" event={"ID":"87f9677c-60fd-49ac-9dfb-3cb406fb00aa","Type":"ContainerDied","Data":"77dd57ffa0f7e6f48ea5346ecacb0221848bc060cbd33b8ded51289a826bb237"}
Sep 18 20:14:11.829678 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.829605    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"
Sep 18 20:14:11.829678 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.829639    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx" event={"ID":"87f9677c-60fd-49ac-9dfb-3cb406fb00aa","Type":"ContainerDied","Data":"3acf08c95071b60faa264ea1ffa5153fe88456c4490d67649923e3ec6c725661"}
Sep 18 20:14:11.837556 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.837538    2583 scope.go:117] "RemoveContainer" containerID="d832ad467f5f6bfdfba0967ead3451e6d2c63fd61286fcd103a2c95afdc20639"
Sep 18 20:14:11.837807 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:14:11.837785    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d832ad467f5f6bfdfba0967ead3451e6d2c63fd61286fcd103a2c95afdc20639\": container with ID starting with d832ad467f5f6bfdfba0967ead3451e6d2c63fd61286fcd103a2c95afdc20639 not found: ID does not exist" containerID="d832ad467f5f6bfdfba0967ead3451e6d2c63fd61286fcd103a2c95afdc20639"
Sep 18 20:14:11.837880 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.837821    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d832ad467f5f6bfdfba0967ead3451e6d2c63fd61286fcd103a2c95afdc20639"} err="failed to get container status \"d832ad467f5f6bfdfba0967ead3451e6d2c63fd61286fcd103a2c95afdc20639\": rpc error: code = NotFound desc = could not find container \"d832ad467f5f6bfdfba0967ead3451e6d2c63fd61286fcd103a2c95afdc20639\": container with ID starting with d832ad467f5f6bfdfba0967ead3451e6d2c63fd61286fcd103a2c95afdc20639 not found: ID does not exist"
Sep 18 20:14:11.837880 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.837837    2583 scope.go:117] "RemoveContainer" containerID="77dd57ffa0f7e6f48ea5346ecacb0221848bc060cbd33b8ded51289a826bb237"
Sep 18 20:14:11.845708 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.845687    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"]
Sep 18 20:14:11.846624 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.846599    2583 scope.go:117] "RemoveContainer" containerID="77dd57ffa0f7e6f48ea5346ecacb0221848bc060cbd33b8ded51289a826bb237"
Sep 18 20:14:11.847003 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:14:11.846976    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77dd57ffa0f7e6f48ea5346ecacb0221848bc060cbd33b8ded51289a826bb237\": container with ID starting with 77dd57ffa0f7e6f48ea5346ecacb0221848bc060cbd33b8ded51289a826bb237 not found: ID does not exist" containerID="77dd57ffa0f7e6f48ea5346ecacb0221848bc060cbd33b8ded51289a826bb237"
Sep 18 20:14:11.847121 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.847014    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77dd57ffa0f7e6f48ea5346ecacb0221848bc060cbd33b8ded51289a826bb237"} err="failed to get container status \"77dd57ffa0f7e6f48ea5346ecacb0221848bc060cbd33b8ded51289a826bb237\": rpc error: code = NotFound desc = could not find container \"77dd57ffa0f7e6f48ea5346ecacb0221848bc060cbd33b8ded51289a826bb237\": container with ID starting with 77dd57ffa0f7e6f48ea5346ecacb0221848bc060cbd33b8ded51289a826bb237 not found: ID does not exist"
Sep 18 20:14:11.849161 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.849144    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-e91414-cd4f9f475-9t5fj"]
Sep 18 20:14:11.864961 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.864932    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"]
Sep 18 20:14:11.869368 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:11.869346    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-e91414-7d9fd955d6-k59zx"]
Sep 18 20:14:12.300201 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:12.300170    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:13.173603 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:13.173574    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:13.811442 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:13.811409    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87f9677c-60fd-49ac-9dfb-3cb406fb00aa" path="/var/lib/kubelet/pods/87f9677c-60fd-49ac-9dfb-3cb406fb00aa/volumes"
Sep 18 20:14:13.811785 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:13.811773    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebc6bc52-2996-4969-81a0-9c42203159b0" path="/var/lib/kubelet/pods/ebc6bc52-2996-4969-81a0-9c42203159b0/volumes"
Sep 18 20:14:14.020847 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:14.020818    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:14.694477 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:14.694450    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:17.577662 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:17.577627    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:17.678362 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:17.678315    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:17.846323 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:17.846294    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:19.919875 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:19.919849    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 20:14:19.924967 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:19.924946    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 20:14:20.997635 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:20.997601    2583 scope.go:117] "RemoveContainer" containerID="6bf5255c89387a632a095a8fb56de54c6dc1caad6ddd616776f6cf51ef13f46f"
Sep 18 20:14:21.006911 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.006893    2583 scope.go:117] "RemoveContainer" containerID="9e495cce8b6e01818e9df181a2790c6530a1e55285880708c6ab424676728837"
Sep 18 20:14:21.494908 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.494873    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd"]
Sep 18 20:14:21.495334 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.495320    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc6bc52-2996-4969-81a0-9c42203159b0" containerName="payload-processing"
Sep 18 20:14:21.495376 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.495336    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc6bc52-2996-4969-81a0-9c42203159b0" containerName="payload-processing"
Sep 18 20:14:21.495376 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.495351    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72a73bef-0c05-4b13-a0dd-c7dc8375d677" containerName="revoke-keys"
Sep 18 20:14:21.495376 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.495356    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="72a73bef-0c05-4b13-a0dd-c7dc8375d677" containerName="revoke-keys"
Sep 18 20:14:21.495376 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.495370    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87f9677c-60fd-49ac-9dfb-3cb406fb00aa" containerName="payload-pre-processing"
Sep 18 20:14:21.495376 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.495376    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="87f9677c-60fd-49ac-9dfb-3cb406fb00aa" containerName="payload-pre-processing"
Sep 18 20:14:21.495569 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.495442    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="72a73bef-0c05-4b13-a0dd-c7dc8375d677" containerName="revoke-keys"
Sep 18 20:14:21.495569 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.495453    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="87f9677c-60fd-49ac-9dfb-3cb406fb00aa" containerName="payload-pre-processing"
Sep 18 20:14:21.495569 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.495463    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebc6bc52-2996-4969-81a0-9c42203159b0" containerName="payload-processing"
Sep 18 20:14:21.499951 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.499930    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd"
Sep 18 20:14:21.502740 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.502721    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 20:14:21.502994 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.502976    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 20:14:21.512679 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.512657    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd"]
Sep 18 20:14:21.611189 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.611156    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd\" (UID: \"a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd"
Sep 18 20:14:21.680223 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.680193    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:21.712335 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.712312    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd\" (UID: \"a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd"
Sep 18 20:14:21.712876 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.712858    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd\" (UID: \"a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd"
Sep 18 20:14:21.810951 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:21.810859    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd"
Sep 18 20:14:22.088020 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:22.087990    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd"]
Sep 18 20:14:22.090316 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:14:22.090289    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1518f0a_4c1c_43d8_9c18_7fe7d9b2e63a.slice/crio-a985034084f7fea2ab1700bc255107c5f61250442e652bbc149d80716446c49f WatchSource:0}: Error finding container a985034084f7fea2ab1700bc255107c5f61250442e652bbc149d80716446c49f: Status 404 returned error can't find the container with id a985034084f7fea2ab1700bc255107c5f61250442e652bbc149d80716446c49f
Sep 18 20:14:22.409569 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:22.409488    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:22.897630 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:22.897594    2583 generic.go:356] "Generic (PLEG): container finished" podID="a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a" containerID="65c547e5d1184769b9fb0182f01e9a59ba7474a79dcab2339c71fa431f8c907c" exitCode=0
Sep 18 20:14:22.897808 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:22.897645    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd" event={"ID":"a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a","Type":"ContainerDied","Data":"65c547e5d1184769b9fb0182f01e9a59ba7474a79dcab2339c71fa431f8c907c"}
Sep 18 20:14:22.897808 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:22.897697    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd" event={"ID":"a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a","Type":"ContainerStarted","Data":"a985034084f7fea2ab1700bc255107c5f61250442e652bbc149d80716446c49f"}
Sep 18 20:14:23.222105 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:23.222065    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:24.037183 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:24.037159    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd"
Sep 18 20:14:24.111227 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:24.111202    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:24.134703 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:24.134676    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a-maas-api-service-ca\") pod \"a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a\" (UID: \"a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a\") "
Sep 18 20:14:24.135032 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:24.135011    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a" (UID: "a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:14:24.236107 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:24.236015    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:14:24.873891 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:24.873832    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:24.910156 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:24.910132    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd"
Sep 18 20:14:24.910302 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:24.910135    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd" event={"ID":"a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a","Type":"ContainerDied","Data":"a985034084f7fea2ab1700bc255107c5f61250442e652bbc149d80716446c49f"}
Sep 18 20:14:24.910302 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:24.910247    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a985034084f7fea2ab1700bc255107c5f61250442e652bbc149d80716446c49f"
Sep 18 20:14:25.561264 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:25.561234    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:37.052183 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.052136    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:37.086287 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.086253    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"]
Sep 18 20:14:37.086561 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.086517    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s" podUID="8416c2ef-9849-4f37-acb1-c62b50b698bb" containerName="payload-processing" containerID="cri-o://e30cfc6c4f126e34cf91a693061ca64d9381539bea231cc89039b74b1f142f4d" gracePeriod=30
Sep 18 20:14:37.092714 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.092440    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"]
Sep 18 20:14:37.092714 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.092664    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7" podUID="9a728fd3-bbbc-426e-9c80-b6eb669270b1" containerName="payload-pre-processing" containerID="cri-o://214970a605a0482cddcc8c9255de014b3cc58f61a9317b3ed9fffedc309ec6d3" gracePeriod=30
Sep 18 20:14:37.124628 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.124588    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:37.189724 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.189696    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:37.257646 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.257618    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd"]
Sep 18 20:14:37.260277 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.260183    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:37.263029 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.262973    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-953438-n7pwd"]
Sep 18 20:14:37.320665 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.320591    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:37.354630 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.354609    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"
Sep 18 20:14:37.367581 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.367564    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"
Sep 18 20:14:37.455632 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.455601    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8416c2ef-9849-4f37-acb1-c62b50b698bb-plugins-config-volume\") pod \"8416c2ef-9849-4f37-acb1-c62b50b698bb\" (UID: \"8416c2ef-9849-4f37-acb1-c62b50b698bb\") "
Sep 18 20:14:37.455819 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.455644    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a728fd3-bbbc-426e-9c80-b6eb669270b1-plugins-config-volume\") pod \"9a728fd3-bbbc-426e-9c80-b6eb669270b1\" (UID: \"9a728fd3-bbbc-426e-9c80-b6eb669270b1\") "
Sep 18 20:14:37.455819 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.455727    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cc8jw\" (UniqueName: \"kubernetes.io/projected/8416c2ef-9849-4f37-acb1-c62b50b698bb-kube-api-access-cc8jw\") pod \"8416c2ef-9849-4f37-acb1-c62b50b698bb\" (UID: \"8416c2ef-9849-4f37-acb1-c62b50b698bb\") "
Sep 18 20:14:37.455819 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.455751    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28m6m\" (UniqueName: \"kubernetes.io/projected/9a728fd3-bbbc-426e-9c80-b6eb669270b1-kube-api-access-28m6m\") pod \"9a728fd3-bbbc-426e-9c80-b6eb669270b1\" (UID: \"9a728fd3-bbbc-426e-9c80-b6eb669270b1\") "
Sep 18 20:14:37.456029 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.456004    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a728fd3-bbbc-426e-9c80-b6eb669270b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9a728fd3-bbbc-426e-9c80-b6eb669270b1" (UID: "9a728fd3-bbbc-426e-9c80-b6eb669270b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:14:37.456122 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.456027    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8416c2ef-9849-4f37-acb1-c62b50b698bb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8416c2ef-9849-4f37-acb1-c62b50b698bb" (UID: "8416c2ef-9849-4f37-acb1-c62b50b698bb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:14:37.457734 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.457716    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a728fd3-bbbc-426e-9c80-b6eb669270b1-kube-api-access-28m6m" (OuterVolumeSpecName: "kube-api-access-28m6m") pod "9a728fd3-bbbc-426e-9c80-b6eb669270b1" (UID: "9a728fd3-bbbc-426e-9c80-b6eb669270b1"). InnerVolumeSpecName "kube-api-access-28m6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:14:37.457828 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.457803    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8416c2ef-9849-4f37-acb1-c62b50b698bb-kube-api-access-cc8jw" (OuterVolumeSpecName: "kube-api-access-cc8jw") pod "8416c2ef-9849-4f37-acb1-c62b50b698bb" (UID: "8416c2ef-9849-4f37-acb1-c62b50b698bb"). InnerVolumeSpecName "kube-api-access-cc8jw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:14:37.557105 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.557078    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cc8jw\" (UniqueName: \"kubernetes.io/projected/8416c2ef-9849-4f37-acb1-c62b50b698bb-kube-api-access-cc8jw\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:14:37.557105 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.557101    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28m6m\" (UniqueName: \"kubernetes.io/projected/9a728fd3-bbbc-426e-9c80-b6eb669270b1-kube-api-access-28m6m\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:14:37.557105 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.557113    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8416c2ef-9849-4f37-acb1-c62b50b698bb-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:14:37.557297 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.557124    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a728fd3-bbbc-426e-9c80-b6eb669270b1-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:14:37.632074 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.632026    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:37.811823 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.811781    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a" path="/var/lib/kubelet/pods/a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a/volumes"
Sep 18 20:14:37.879258 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.879225    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:37.982131 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.982021    2583 generic.go:356] "Generic (PLEG): container finished" podID="8416c2ef-9849-4f37-acb1-c62b50b698bb" containerID="e30cfc6c4f126e34cf91a693061ca64d9381539bea231cc89039b74b1f142f4d" exitCode=0
Sep 18 20:14:37.982131 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.982074    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"
Sep 18 20:14:37.982131 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.982106    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s" event={"ID":"8416c2ef-9849-4f37-acb1-c62b50b698bb","Type":"ContainerDied","Data":"e30cfc6c4f126e34cf91a693061ca64d9381539bea231cc89039b74b1f142f4d"}
Sep 18 20:14:37.982380 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.982167    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s" event={"ID":"8416c2ef-9849-4f37-acb1-c62b50b698bb","Type":"ContainerDied","Data":"88a4451fd760ab7ebd32b8f4aa018ef64d16bb587e59068250b147c2eb770708"}
Sep 18 20:14:37.982380 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.982201    2583 scope.go:117] "RemoveContainer" containerID="e30cfc6c4f126e34cf91a693061ca64d9381539bea231cc89039b74b1f142f4d"
Sep 18 20:14:37.983572 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.983550    2583 generic.go:356] "Generic (PLEG): container finished" podID="9a728fd3-bbbc-426e-9c80-b6eb669270b1" containerID="214970a605a0482cddcc8c9255de014b3cc58f61a9317b3ed9fffedc309ec6d3" exitCode=0
Sep 18 20:14:37.983673 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.983599    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"
Sep 18 20:14:37.983673 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.983633    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7" event={"ID":"9a728fd3-bbbc-426e-9c80-b6eb669270b1","Type":"ContainerDied","Data":"214970a605a0482cddcc8c9255de014b3cc58f61a9317b3ed9fffedc309ec6d3"}
Sep 18 20:14:37.983785 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.983677    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7" event={"ID":"9a728fd3-bbbc-426e-9c80-b6eb669270b1","Type":"ContainerDied","Data":"96ad3114f215ed4694839b7c70637d4f7d8d103c7417796bcb8c2ab74b8be4a9"}
Sep 18 20:14:37.991743 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.991728    2583 scope.go:117] "RemoveContainer" containerID="e30cfc6c4f126e34cf91a693061ca64d9381539bea231cc89039b74b1f142f4d"
Sep 18 20:14:37.992014 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:14:37.991996    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e30cfc6c4f126e34cf91a693061ca64d9381539bea231cc89039b74b1f142f4d\": container with ID starting with e30cfc6c4f126e34cf91a693061ca64d9381539bea231cc89039b74b1f142f4d not found: ID does not exist" containerID="e30cfc6c4f126e34cf91a693061ca64d9381539bea231cc89039b74b1f142f4d"
Sep 18 20:14:37.992081 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.992025    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30cfc6c4f126e34cf91a693061ca64d9381539bea231cc89039b74b1f142f4d"} err="failed to get container status \"e30cfc6c4f126e34cf91a693061ca64d9381539bea231cc89039b74b1f142f4d\": rpc error: code = NotFound desc = could not find container \"e30cfc6c4f126e34cf91a693061ca64d9381539bea231cc89039b74b1f142f4d\": container with ID starting with e30cfc6c4f126e34cf91a693061ca64d9381539bea231cc89039b74b1f142f4d not found: ID does not exist"
Sep 18 20:14:37.992081 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:37.992058    2583 scope.go:117] "RemoveContainer" containerID="214970a605a0482cddcc8c9255de014b3cc58f61a9317b3ed9fffedc309ec6d3"
Sep 18 20:14:38.000403 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:38.000349    2583 scope.go:117] "RemoveContainer" containerID="214970a605a0482cddcc8c9255de014b3cc58f61a9317b3ed9fffedc309ec6d3"
Sep 18 20:14:38.000805 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:14:38.000781    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"214970a605a0482cddcc8c9255de014b3cc58f61a9317b3ed9fffedc309ec6d3\": container with ID starting with 214970a605a0482cddcc8c9255de014b3cc58f61a9317b3ed9fffedc309ec6d3 not found: ID does not exist" containerID="214970a605a0482cddcc8c9255de014b3cc58f61a9317b3ed9fffedc309ec6d3"
Sep 18 20:14:38.000959 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:38.000928    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"214970a605a0482cddcc8c9255de014b3cc58f61a9317b3ed9fffedc309ec6d3"} err="failed to get container status \"214970a605a0482cddcc8c9255de014b3cc58f61a9317b3ed9fffedc309ec6d3\": rpc error: code = NotFound desc = could not find container \"214970a605a0482cddcc8c9255de014b3cc58f61a9317b3ed9fffedc309ec6d3\": container with ID starting with 214970a605a0482cddcc8c9255de014b3cc58f61a9317b3ed9fffedc309ec6d3 not found: ID does not exist"
Sep 18 20:14:38.003398 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:38.003377    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"]
Sep 18 20:14:38.008812 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:38.008790    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-953438-649695df74-4d2z7"]
Sep 18 20:14:38.022108 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:38.022082    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"]
Sep 18 20:14:38.026730 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:38.026710    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-953438-79fd59b585-blp4s"]
Sep 18 20:14:38.610483 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:38.610454    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:39.407556 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:39.407528    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:39.817277 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:39.817201    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8416c2ef-9849-4f37-acb1-c62b50b698bb" path="/var/lib/kubelet/pods/8416c2ef-9849-4f37-acb1-c62b50b698bb/volumes"
Sep 18 20:14:39.817622 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:39.817565    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a728fd3-bbbc-426e-9c80-b6eb669270b1" path="/var/lib/kubelet/pods/9a728fd3-bbbc-426e-9c80-b6eb669270b1/volumes"
Sep 18 20:14:40.096245 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:40.096216    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:14:42.667698 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:14:42.667667    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:00.137352 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.137310    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829375-bg26m"]
Sep 18 20:15:00.137945 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.137919    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8416c2ef-9849-4f37-acb1-c62b50b698bb" containerName="payload-processing"
Sep 18 20:15:00.137945 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.137942    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="8416c2ef-9849-4f37-acb1-c62b50b698bb" containerName="payload-processing"
Sep 18 20:15:00.138190 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.137975    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a728fd3-bbbc-426e-9c80-b6eb669270b1" containerName="payload-pre-processing"
Sep 18 20:15:00.138190 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.137984    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a728fd3-bbbc-426e-9c80-b6eb669270b1" containerName="payload-pre-processing"
Sep 18 20:15:00.138190 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.137999    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a" containerName="revoke-keys"
Sep 18 20:15:00.138190 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.138009    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a" containerName="revoke-keys"
Sep 18 20:15:00.138190 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.138146    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1518f0a-4c1c-43d8-9c18-7fe7d9b2e63a" containerName="revoke-keys"
Sep 18 20:15:00.138190 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.138162    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="8416c2ef-9849-4f37-acb1-c62b50b698bb" containerName="payload-processing"
Sep 18 20:15:00.138190 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.138172    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a728fd3-bbbc-426e-9c80-b6eb669270b1" containerName="payload-pre-processing"
Sep 18 20:15:00.141471 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.141441    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-5547b6-29829375-96kb4"]
Sep 18 20:15:00.141636 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.141608    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829375-bg26m"
Sep 18 20:15:00.144520 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.144501    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 20:15:00.145390 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.145369    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-57b6ce-29829375-2hhd9"]
Sep 18 20:15:00.145476 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.145463    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-5547b6-29829375-96kb4"
Sep 18 20:15:00.148834 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.148795    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-57b6ce-29829375-2hhd9"
Sep 18 20:15:00.153098 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.153060    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829375-bg26m"]
Sep 18 20:15:00.155750 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.155730    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829375-bg26m"
Sep 18 20:15:00.157372 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.157349    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-5547b6-29829375-96kb4"]
Sep 18 20:15:00.166380 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.166354    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-57b6ce-29829375-2hhd9"]
Sep 18 20:15:00.188950 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.188919    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-5547b6-29829375-96kb4"
Sep 18 20:15:00.191232 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.191209    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-57b6ce-29829375-2hhd9"
Sep 18 20:15:00.439759 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.439734    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29829375-bg26m"]
Sep 18 20:15:00.440749 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:15:00.440723    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02acef5f_5e5d_4623_8aaf_e845c6c6bb4d.slice/crio-edcfa93eae620ccc93e4aa9b84bcd9fff2b982ad374ba7a11dc69d2ace61322c WatchSource:0}: Error finding container edcfa93eae620ccc93e4aa9b84bcd9fff2b982ad374ba7a11dc69d2ace61322c: Status 404 returned error can't find the container with id edcfa93eae620ccc93e4aa9b84bcd9fff2b982ad374ba7a11dc69d2ace61322c
Sep 18 20:15:00.483412 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.483389    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-5547b6-29829375-96kb4"]
Sep 18 20:15:00.484510 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:15:00.484485    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad925da_f775_4952_90f7_73748350a59b.slice/crio-84adced83cef29ddef8903368c285c8e51f5608a6231ae9a58808a3c5ac99b4d WatchSource:0}: Error finding container 84adced83cef29ddef8903368c285c8e51f5608a6231ae9a58808a3c5ac99b4d: Status 404 returned error can't find the container with id 84adced83cef29ddef8903368c285c8e51f5608a6231ae9a58808a3c5ac99b4d
Sep 18 20:15:00.494116 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:00.494094    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-57b6ce-29829375-2hhd9"]
Sep 18 20:15:00.497349 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:15:00.497325    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666f078e_ce0c_4387_8479_4bee7340415d.slice/crio-d93df0cf33eefb0dd0440cb8d4a7b37d71f3cf52f21eeec205f2a409c360e8e1 WatchSource:0}: Error finding container d93df0cf33eefb0dd0440cb8d4a7b37d71f3cf52f21eeec205f2a409c360e8e1: Status 404 returned error can't find the container with id d93df0cf33eefb0dd0440cb8d4a7b37d71f3cf52f21eeec205f2a409c360e8e1
Sep 18 20:15:01.128904 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:01.128868    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-5547b6-29829375-96kb4" event={"ID":"5ad925da-f775-4952-90f7-73748350a59b","Type":"ContainerStarted","Data":"753b629d8d53534439d3a8a385890589cade7f1e14f65feb06cd206021c271b1"}
Sep 18 20:15:01.129126 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:01.128923    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-5547b6-29829375-96kb4" event={"ID":"5ad925da-f775-4952-90f7-73748350a59b","Type":"ContainerStarted","Data":"84adced83cef29ddef8903368c285c8e51f5608a6231ae9a58808a3c5ac99b4d"}
Sep 18 20:15:01.130536 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:01.130510    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-57b6ce-29829375-2hhd9" event={"ID":"666f078e-ce0c-4387-8479-4bee7340415d","Type":"ContainerStarted","Data":"3a4800e223998c1fd40e0c446c651b11c6a68a4206bb1579747c655c9bb41a5a"}
Sep 18 20:15:01.130645 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:01.130562    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-57b6ce-29829375-2hhd9" event={"ID":"666f078e-ce0c-4387-8479-4bee7340415d","Type":"ContainerStarted","Data":"d93df0cf33eefb0dd0440cb8d4a7b37d71f3cf52f21eeec205f2a409c360e8e1"}
Sep 18 20:15:01.131989 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:01.131965    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829375-bg26m" event={"ID":"02acef5f-5e5d-4623-8aaf-e845c6c6bb4d","Type":"ContainerStarted","Data":"97d9ccdbbb309c269ddd3ea012881b59db178ca04185059c0b4d6c1277888311"}
Sep 18 20:15:01.132112 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:01.132012    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829375-bg26m" event={"ID":"02acef5f-5e5d-4623-8aaf-e845c6c6bb4d","Type":"ContainerStarted","Data":"edcfa93eae620ccc93e4aa9b84bcd9fff2b982ad374ba7a11dc69d2ace61322c"}
Sep 18 20:15:01.143971 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:01.143915    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-5547b6-29829375-96kb4" podStartSLOduration=1.143900803 podStartE2EDuration="1.143900803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:15:01.142775142 +0000 UTC m=+2143.469868902" watchObservedRunningTime="2026-09-18 20:15:01.143900803 +0000 UTC m=+2143.470994566"
Sep 18 20:15:01.158281 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:01.158240    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829375-bg26m" podStartSLOduration=1.158229491 podStartE2EDuration="1.158229491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:15:01.157332344 +0000 UTC m=+2143.484426108" watchObservedRunningTime="2026-09-18 20:15:01.158229491 +0000 UTC m=+2143.485323254"
Sep 18 20:15:01.172877 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:01.172837    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-57b6ce-29829375-2hhd9" podStartSLOduration=1.172823629 podStartE2EDuration="1.172823629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:15:01.170447618 +0000 UTC m=+2143.497541382" watchObservedRunningTime="2026-09-18 20:15:01.172823629 +0000 UTC m=+2143.499917405"
Sep 18 20:15:02.139517 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:02.139478    2583 generic.go:356] "Generic (PLEG): container finished" podID="02acef5f-5e5d-4623-8aaf-e845c6c6bb4d" containerID="97d9ccdbbb309c269ddd3ea012881b59db178ca04185059c0b4d6c1277888311" exitCode=0
Sep 18 20:15:02.139706 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:02.139566    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829375-bg26m" event={"ID":"02acef5f-5e5d-4623-8aaf-e845c6c6bb4d","Type":"ContainerDied","Data":"97d9ccdbbb309c269ddd3ea012881b59db178ca04185059c0b4d6c1277888311"}
Sep 18 20:15:02.141164 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:02.141142    2583 generic.go:356] "Generic (PLEG): container finished" podID="5ad925da-f775-4952-90f7-73748350a59b" containerID="753b629d8d53534439d3a8a385890589cade7f1e14f65feb06cd206021c271b1" exitCode=0
Sep 18 20:15:02.141280 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:02.141212    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-5547b6-29829375-96kb4" event={"ID":"5ad925da-f775-4952-90f7-73748350a59b","Type":"ContainerDied","Data":"753b629d8d53534439d3a8a385890589cade7f1e14f65feb06cd206021c271b1"}
Sep 18 20:15:02.142710 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:02.142691    2583 generic.go:356] "Generic (PLEG): container finished" podID="666f078e-ce0c-4387-8479-4bee7340415d" containerID="3a4800e223998c1fd40e0c446c651b11c6a68a4206bb1579747c655c9bb41a5a" exitCode=0
Sep 18 20:15:02.142803 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:02.142729    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-57b6ce-29829375-2hhd9" event={"ID":"666f078e-ce0c-4387-8479-4bee7340415d","Type":"ContainerDied","Data":"3a4800e223998c1fd40e0c446c651b11c6a68a4206bb1579747c655c9bb41a5a"}
Sep 18 20:15:03.327691 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:03.327667    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-5547b6-29829375-96kb4"
Sep 18 20:15:03.330892 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:03.330870    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-57b6ce-29829375-2hhd9"
Sep 18 20:15:03.334149 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:03.334127    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829375-bg26m"
Sep 18 20:15:04.156909 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:04.156879    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829375-bg26m"
Sep 18 20:15:04.157139 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:04.156922    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29829375-bg26m" event={"ID":"02acef5f-5e5d-4623-8aaf-e845c6c6bb4d","Type":"ContainerDied","Data":"edcfa93eae620ccc93e4aa9b84bcd9fff2b982ad374ba7a11dc69d2ace61322c"}
Sep 18 20:15:04.157139 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:04.156968    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edcfa93eae620ccc93e4aa9b84bcd9fff2b982ad374ba7a11dc69d2ace61322c"
Sep 18 20:15:04.158498 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:04.158479    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-5547b6-29829375-96kb4"
Sep 18 20:15:04.158622 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:04.158511    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-5547b6-29829375-96kb4" event={"ID":"5ad925da-f775-4952-90f7-73748350a59b","Type":"ContainerDied","Data":"84adced83cef29ddef8903368c285c8e51f5608a6231ae9a58808a3c5ac99b4d"}
Sep 18 20:15:04.158622 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:04.158549    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84adced83cef29ddef8903368c285c8e51f5608a6231ae9a58808a3c5ac99b4d"
Sep 18 20:15:04.159937 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:04.159920    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-57b6ce-29829375-2hhd9" event={"ID":"666f078e-ce0c-4387-8479-4bee7340415d","Type":"ContainerDied","Data":"d93df0cf33eefb0dd0440cb8d4a7b37d71f3cf52f21eeec205f2a409c360e8e1"}
Sep 18 20:15:04.160063 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:04.159968    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d93df0cf33eefb0dd0440cb8d4a7b37d71f3cf52f21eeec205f2a409c360e8e1"
Sep 18 20:15:04.160063 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:04.159929    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-57b6ce-29829375-2hhd9"
Sep 18 20:15:17.844661 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:17.844620    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:19.740957 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:19.740928    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:20.309178 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:20.309148    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:25.901655 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:25.901620    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:26.000193 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.000162    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:26.162718 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.162633    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"]
Sep 18 20:15:26.162934 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.162909    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6" podUID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerName="istio-proxy" containerID="cri-o://60f627e776b3c23b3d3fa6d572382c7c4d2c8e0be9b7d9f9ecf488ae8c837a02" gracePeriod=30
Sep 18 20:15:26.178416 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.178389    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:26.540690 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.540602    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g"]
Sep 18 20:15:26.540994 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.540982    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="666f078e-ce0c-4387-8479-4bee7340415d" containerName="cleanup"
Sep 18 20:15:26.541069 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.540995    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="666f078e-ce0c-4387-8479-4bee7340415d" containerName="cleanup"
Sep 18 20:15:26.541069 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.541003    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ad925da-f775-4952-90f7-73748350a59b" containerName="cleanup"
Sep 18 20:15:26.541069 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.541009    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ad925da-f775-4952-90f7-73748350a59b" containerName="cleanup"
Sep 18 20:15:26.541069 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.541032    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02acef5f-5e5d-4623-8aaf-e845c6c6bb4d" containerName="cleanup"
Sep 18 20:15:26.541069 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.541068    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="02acef5f-5e5d-4623-8aaf-e845c6c6bb4d" containerName="cleanup"
Sep 18 20:15:26.541248 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.541129    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ad925da-f775-4952-90f7-73748350a59b" containerName="cleanup"
Sep 18 20:15:26.541248 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.541137    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="02acef5f-5e5d-4623-8aaf-e845c6c6bb4d" containerName="cleanup"
Sep 18 20:15:26.541248 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.541145    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="666f078e-ce0c-4387-8479-4bee7340415d" containerName="cleanup"
Sep 18 20:15:26.545700 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.545680    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g"
Sep 18 20:15:26.548540 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.548519    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 20:15:26.549140 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.549113    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 20:15:26.552414 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.552351    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g"]
Sep 18 20:15:26.598090 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.598057    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/780305ff-bd00-4070-8269-8aca91eb5ad1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g\" (UID: \"780305ff-bd00-4070-8269-8aca91eb5ad1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g"
Sep 18 20:15:26.699090 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.699033    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/780305ff-bd00-4070-8269-8aca91eb5ad1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g\" (UID: \"780305ff-bd00-4070-8269-8aca91eb5ad1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g"
Sep 18 20:15:26.699639 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.699620    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/780305ff-bd00-4070-8269-8aca91eb5ad1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g\" (UID: \"780305ff-bd00-4070-8269-8aca91eb5ad1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g"
Sep 18 20:15:26.859085 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:26.859033    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g"
Sep 18 20:15:27.133539 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:27.133514    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g"]
Sep 18 20:15:27.135340 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:15:27.135303    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780305ff_bd00_4070_8269_8aca91eb5ad1.slice/crio-312ea0662354bb77d2169dbc86628d72ac4571958f45d98b23eec17ff2911300 WatchSource:0}: Error finding container 312ea0662354bb77d2169dbc86628d72ac4571958f45d98b23eec17ff2911300: Status 404 returned error can't find the container with id 312ea0662354bb77d2169dbc86628d72ac4571958f45d98b23eec17ff2911300
Sep 18 20:15:27.294713 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:27.294677    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g" event={"ID":"780305ff-bd00-4070-8269-8aca91eb5ad1","Type":"ContainerStarted","Data":"312ea0662354bb77d2169dbc86628d72ac4571958f45d98b23eec17ff2911300"}
Sep 18 20:15:27.484638 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:27.484608    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:28.256443 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:28.256349    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:28.303092 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:28.303030    2583 generic.go:356] "Generic (PLEG): container finished" podID="780305ff-bd00-4070-8269-8aca91eb5ad1" containerID="fd694305bb2352e407614bf6919e1fa2697e5598aca8b5470e4781c981b6630f" exitCode=0
Sep 18 20:15:28.303092 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:28.303084    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g" event={"ID":"780305ff-bd00-4070-8269-8aca91eb5ad1","Type":"ContainerDied","Data":"fd694305bb2352e407614bf6919e1fa2697e5598aca8b5470e4781c981b6630f"}
Sep 18 20:15:28.922597 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:28.922554    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:29.452571 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:29.452546    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g"
Sep 18 20:15:29.525346 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:29.525312    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/780305ff-bd00-4070-8269-8aca91eb5ad1-maas-api-service-ca\") pod \"780305ff-bd00-4070-8269-8aca91eb5ad1\" (UID: \"780305ff-bd00-4070-8269-8aca91eb5ad1\") "
Sep 18 20:15:29.525698 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:29.525675    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/780305ff-bd00-4070-8269-8aca91eb5ad1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "780305ff-bd00-4070-8269-8aca91eb5ad1" (UID: "780305ff-bd00-4070-8269-8aca91eb5ad1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:15:29.626626 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:29.626589    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/780305ff-bd00-4070-8269-8aca91eb5ad1-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:29.642135 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:29.642099    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:30.315502 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:30.315469    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g"
Sep 18 20:15:30.315502 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:30.315495    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g" event={"ID":"780305ff-bd00-4070-8269-8aca91eb5ad1","Type":"ContainerDied","Data":"312ea0662354bb77d2169dbc86628d72ac4571958f45d98b23eec17ff2911300"}
Sep 18 20:15:30.315717 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:30.315548    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="312ea0662354bb77d2169dbc86628d72ac4571958f45d98b23eec17ff2911300"
Sep 18 20:15:31.323455 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.323424    2583 generic.go:356] "Generic (PLEG): container finished" podID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerID="60f627e776b3c23b3d3fa6d572382c7c4d2c8e0be9b7d9f9ecf488ae8c837a02" exitCode=0
Sep 18 20:15:31.323850 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.323506    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6" event={"ID":"206b4006-42b6-42f8-8d86-5a17e31e57c2","Type":"ContainerDied","Data":"60f627e776b3c23b3d3fa6d572382c7c4d2c8e0be9b7d9f9ecf488ae8c837a02"}
Sep 18 20:15:31.323850 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.323592    2583 scope.go:117] "RemoveContainer" containerID="3fdaa13aaa51cdfb63dadb796b50c66af1d5699e5e006c3744afddf8c46a593b"
Sep 18 20:15:31.427498 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.427430    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:15:31.544919 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.544878    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/206b4006-42b6-42f8-8d86-5a17e31e57c2-istiod-ca-cert\") pod \"206b4006-42b6-42f8-8d86-5a17e31e57c2\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") "
Sep 18 20:15:31.545143 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.544930    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-podinfo\") pod \"206b4006-42b6-42f8-8d86-5a17e31e57c2\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") "
Sep 18 20:15:31.545143 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.544959    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-workload-socket\") pod \"206b4006-42b6-42f8-8d86-5a17e31e57c2\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") "
Sep 18 20:15:31.545143 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545021    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-credential-socket\") pod \"206b4006-42b6-42f8-8d86-5a17e31e57c2\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") "
Sep 18 20:15:31.545143 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545069    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-data\") pod \"206b4006-42b6-42f8-8d86-5a17e31e57c2\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") "
Sep 18 20:15:31.545143 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545090    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-envoy\") pod \"206b4006-42b6-42f8-8d86-5a17e31e57c2\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") "
Sep 18 20:15:31.545143 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545115    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4s7n\" (UniqueName: \"kubernetes.io/projected/206b4006-42b6-42f8-8d86-5a17e31e57c2-kube-api-access-x4s7n\") pod \"206b4006-42b6-42f8-8d86-5a17e31e57c2\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") "
Sep 18 20:15:31.545466 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545194    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-token\") pod \"206b4006-42b6-42f8-8d86-5a17e31e57c2\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") "
Sep 18 20:15:31.545466 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545262    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-workload-certs\") pod \"206b4006-42b6-42f8-8d86-5a17e31e57c2\" (UID: \"206b4006-42b6-42f8-8d86-5a17e31e57c2\") "
Sep 18 20:15:31.545466 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545356    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "206b4006-42b6-42f8-8d86-5a17e31e57c2" (UID: "206b4006-42b6-42f8-8d86-5a17e31e57c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:15:31.545621 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545474    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "206b4006-42b6-42f8-8d86-5a17e31e57c2" (UID: "206b4006-42b6-42f8-8d86-5a17e31e57c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:15:31.545621 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545490    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "206b4006-42b6-42f8-8d86-5a17e31e57c2" (UID: "206b4006-42b6-42f8-8d86-5a17e31e57c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:15:31.545621 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545491    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/206b4006-42b6-42f8-8d86-5a17e31e57c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "206b4006-42b6-42f8-8d86-5a17e31e57c2" (UID: "206b4006-42b6-42f8-8d86-5a17e31e57c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:15:31.545777 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545686    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "206b4006-42b6-42f8-8d86-5a17e31e57c2" (UID: "206b4006-42b6-42f8-8d86-5a17e31e57c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:15:31.545777 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545713    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/206b4006-42b6-42f8-8d86-5a17e31e57c2-istiod-ca-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:31.545777 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545734    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-workload-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:31.545777 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545749    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-credential-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:31.545777 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.545764    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-data\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:31.547480 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.547457    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "206b4006-42b6-42f8-8d86-5a17e31e57c2" (UID: "206b4006-42b6-42f8-8d86-5a17e31e57c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:15:31.547480 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.547460    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "206b4006-42b6-42f8-8d86-5a17e31e57c2" (UID: "206b4006-42b6-42f8-8d86-5a17e31e57c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:15:31.547641 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.547499    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "206b4006-42b6-42f8-8d86-5a17e31e57c2" (UID: "206b4006-42b6-42f8-8d86-5a17e31e57c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:15:31.547641 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.547535    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/206b4006-42b6-42f8-8d86-5a17e31e57c2-kube-api-access-x4s7n" (OuterVolumeSpecName: "kube-api-access-x4s7n") pod "206b4006-42b6-42f8-8d86-5a17e31e57c2" (UID: "206b4006-42b6-42f8-8d86-5a17e31e57c2"). InnerVolumeSpecName "kube-api-access-x4s7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:15:31.646612 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.646581    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-envoy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:31.646612 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.646610    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4s7n\" (UniqueName: \"kubernetes.io/projected/206b4006-42b6-42f8-8d86-5a17e31e57c2-kube-api-access-x4s7n\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:31.646824 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.646622    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:31.646824 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.646632    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/206b4006-42b6-42f8-8d86-5a17e31e57c2-workload-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:31.646824 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:31.646639    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/206b4006-42b6-42f8-8d86-5a17e31e57c2-istio-podinfo\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:32.330445 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:32.330407    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6" event={"ID":"206b4006-42b6-42f8-8d86-5a17e31e57c2","Type":"ContainerDied","Data":"69b97635bb4df00ad478ac6705d7192c604cd0809de41e23dcdeda8dde8abef5"}
Sep 18 20:15:32.330445 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:32.330439    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"
Sep 18 20:15:32.330918 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:32.330472    2583 scope.go:117] "RemoveContainer" containerID="60f627e776b3c23b3d3fa6d572382c7c4d2c8e0be9b7d9f9ecf488ae8c837a02"
Sep 18 20:15:32.358021 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:32.357996    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"]
Sep 18 20:15:32.366825 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:32.366803    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-953438-openshift-default-65798956cd-mfsg6"]
Sep 18 20:15:33.811888 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:33.811856    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="206b4006-42b6-42f8-8d86-5a17e31e57c2" path="/var/lib/kubelet/pods/206b4006-42b6-42f8-8d86-5a17e31e57c2/volumes"
Sep 18 20:15:37.074732 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:37.074699    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:37.173761 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:37.173732    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:37.261863 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:37.261817    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g"]
Sep 18 20:15:37.263967 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:37.263938    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:37.265136 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:37.265119    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-9c0eb2-4s27g"]
Sep 18 20:15:37.324160 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:37.324133    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:37.651336 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:37.651299    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:37.752251 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:37.752222    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:37.811536 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:37.811498    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="780305ff-bd00-4070-8269-8aca91eb5ad1" path="/var/lib/kubelet/pods/780305ff-bd00-4070-8269-8aca91eb5ad1/volumes"
Sep 18 20:15:38.366893 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:38.366850    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:39.193825 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:39.193799    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:43.397381 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:43.397345    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:43.496509 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:43.496468    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:43.643735 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:43.643695    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"]
Sep 18 20:15:43.643922 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:43.643898    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh" podUID="7d1d855f-ba5e-47a1-8751-c33748da2f49" containerName="istio-proxy" containerID="cri-o://ef7a33312365d28e17897233ec5603a0e47f9a2094d882e93ecb8c3cbededda6" gracePeriod=30
Sep 18 20:15:43.667425 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:43.667357    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:44.023287 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.023195    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb"]
Sep 18 20:15:44.023599 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.023585    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerName="istio-proxy"
Sep 18 20:15:44.023640 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.023601    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerName="istio-proxy"
Sep 18 20:15:44.023640 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.023612    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerName="istio-proxy"
Sep 18 20:15:44.023640 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.023618    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerName="istio-proxy"
Sep 18 20:15:44.023640 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.023638    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="780305ff-bd00-4070-8269-8aca91eb5ad1" containerName="revoke-keys"
Sep 18 20:15:44.023778 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.023644    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="780305ff-bd00-4070-8269-8aca91eb5ad1" containerName="revoke-keys"
Sep 18 20:15:44.023778 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.023705    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerName="istio-proxy"
Sep 18 20:15:44.023778 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.023714    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="780305ff-bd00-4070-8269-8aca91eb5ad1" containerName="revoke-keys"
Sep 18 20:15:44.028284 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.028263    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb"
Sep 18 20:15:44.031348 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.031322    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 20:15:44.031810 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.031789    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 20:15:44.034854 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.034829    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb"]
Sep 18 20:15:44.127365 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.127340    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:44.160808 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.160780    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf2350b3-bd06-4532-abbf-d21e3cf69f0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb\" (UID: \"bf2350b3-bd06-4532-abbf-d21e3cf69f0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb"
Sep 18 20:15:44.261770 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.261736    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf2350b3-bd06-4532-abbf-d21e3cf69f0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb\" (UID: \"bf2350b3-bd06-4532-abbf-d21e3cf69f0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb"
Sep 18 20:15:44.262428 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.262409    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf2350b3-bd06-4532-abbf-d21e3cf69f0e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb\" (UID: \"bf2350b3-bd06-4532-abbf-d21e3cf69f0e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb"
Sep 18 20:15:44.340115 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.340087    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb"
Sep 18 20:15:44.613207 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.613183    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb"]
Sep 18 20:15:44.614906 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:15:44.614883    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf2350b3_bd06_4532_abbf_d21e3cf69f0e.slice/crio-d79a83898fa861d60dfb170535c956e5c3f1511652662bb2af8082fa31da8ee8 WatchSource:0}: Error finding container d79a83898fa861d60dfb170535c956e5c3f1511652662bb2af8082fa31da8ee8: Status 404 returned error can't find the container with id d79a83898fa861d60dfb170535c956e5c3f1511652662bb2af8082fa31da8ee8
Sep 18 20:15:44.908935 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:44.908862    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:45.412125 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:45.412094    2583 generic.go:356] "Generic (PLEG): container finished" podID="bf2350b3-bd06-4532-abbf-d21e3cf69f0e" containerID="645747b2b5edb43ba8c6cd264163a3167f016b6e37969815017c84145e31f539" exitCode=0
Sep 18 20:15:45.412305 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:45.412140    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb" event={"ID":"bf2350b3-bd06-4532-abbf-d21e3cf69f0e","Type":"ContainerDied","Data":"645747b2b5edb43ba8c6cd264163a3167f016b6e37969815017c84145e31f539"}
Sep 18 20:15:45.412305 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:45.412186    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb" event={"ID":"bf2350b3-bd06-4532-abbf-d21e3cf69f0e","Type":"ContainerStarted","Data":"d79a83898fa861d60dfb170535c956e5c3f1511652662bb2af8082fa31da8ee8"}
Sep 18 20:15:45.706289 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:45.706257    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:46.478598 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:46.478575    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:46.556542 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:46.556518    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb"
Sep 18 20:15:46.685123 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:46.685030    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf2350b3-bd06-4532-abbf-d21e3cf69f0e-maas-api-service-ca\") pod \"bf2350b3-bd06-4532-abbf-d21e3cf69f0e\" (UID: \"bf2350b3-bd06-4532-abbf-d21e3cf69f0e\") "
Sep 18 20:15:46.685342 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:46.685319    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf2350b3-bd06-4532-abbf-d21e3cf69f0e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bf2350b3-bd06-4532-abbf-d21e3cf69f0e" (UID: "bf2350b3-bd06-4532-abbf-d21e3cf69f0e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:15:46.785866 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:46.785831    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf2350b3-bd06-4532-abbf-d21e3cf69f0e-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:47.425258 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:47.425227    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb"
Sep 18 20:15:47.425403 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:47.425269    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb" event={"ID":"bf2350b3-bd06-4532-abbf-d21e3cf69f0e","Type":"ContainerDied","Data":"d79a83898fa861d60dfb170535c956e5c3f1511652662bb2af8082fa31da8ee8"}
Sep 18 20:15:47.425403 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:47.425339    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d79a83898fa861d60dfb170535c956e5c3f1511652662bb2af8082fa31da8ee8"
Sep 18 20:15:48.891271 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:48.891246    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:15:49.006180 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006101    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d1d855f-ba5e-47a1-8751-c33748da2f49-istiod-ca-cert\") pod \"7d1d855f-ba5e-47a1-8751-c33748da2f49\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") "
Sep 18 20:15:49.006180 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006132    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-credential-socket\") pod \"7d1d855f-ba5e-47a1-8751-c33748da2f49\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") "
Sep 18 20:15:49.006180 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006165    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-data\") pod \"7d1d855f-ba5e-47a1-8751-c33748da2f49\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") "
Sep 18 20:15:49.006472 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006209    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-workload-socket\") pod \"7d1d855f-ba5e-47a1-8751-c33748da2f49\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") "
Sep 18 20:15:49.006472 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006228    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-podinfo\") pod \"7d1d855f-ba5e-47a1-8751-c33748da2f49\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") "
Sep 18 20:15:49.006472 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006258    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-workload-certs\") pod \"7d1d855f-ba5e-47a1-8751-c33748da2f49\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") "
Sep 18 20:15:49.006472 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006277    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-envoy\") pod \"7d1d855f-ba5e-47a1-8751-c33748da2f49\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") "
Sep 18 20:15:49.006472 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006311    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjhnr\" (UniqueName: \"kubernetes.io/projected/7d1d855f-ba5e-47a1-8751-c33748da2f49-kube-api-access-tjhnr\") pod \"7d1d855f-ba5e-47a1-8751-c33748da2f49\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") "
Sep 18 20:15:49.006472 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006334    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-token\") pod \"7d1d855f-ba5e-47a1-8751-c33748da2f49\" (UID: \"7d1d855f-ba5e-47a1-8751-c33748da2f49\") "
Sep 18 20:15:49.006730 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006460    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7d1d855f-ba5e-47a1-8751-c33748da2f49" (UID: "7d1d855f-ba5e-47a1-8751-c33748da2f49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:15:49.006730 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006523    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7d1d855f-ba5e-47a1-8751-c33748da2f49" (UID: "7d1d855f-ba5e-47a1-8751-c33748da2f49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:15:49.006730 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006590    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-data" (OuterVolumeSpecName: "istio-data") pod "7d1d855f-ba5e-47a1-8751-c33748da2f49" (UID: "7d1d855f-ba5e-47a1-8751-c33748da2f49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:15:49.006730 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006619    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d1d855f-ba5e-47a1-8751-c33748da2f49-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7d1d855f-ba5e-47a1-8751-c33748da2f49" (UID: "7d1d855f-ba5e-47a1-8751-c33748da2f49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:15:49.006730 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006691    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-workload-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:49.006730 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006710    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d1d855f-ba5e-47a1-8751-c33748da2f49-istiod-ca-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:49.006730 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006725    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-credential-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:49.007097 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006738    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-data\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:49.007097 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.006962    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7d1d855f-ba5e-47a1-8751-c33748da2f49" (UID: "7d1d855f-ba5e-47a1-8751-c33748da2f49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:15:49.008672 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.008644    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7d1d855f-ba5e-47a1-8751-c33748da2f49" (UID: "7d1d855f-ba5e-47a1-8751-c33748da2f49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:15:49.008810 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.008757    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d1d855f-ba5e-47a1-8751-c33748da2f49-kube-api-access-tjhnr" (OuterVolumeSpecName: "kube-api-access-tjhnr") pod "7d1d855f-ba5e-47a1-8751-c33748da2f49" (UID: "7d1d855f-ba5e-47a1-8751-c33748da2f49"). InnerVolumeSpecName "kube-api-access-tjhnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:15:49.009027 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.009007    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7d1d855f-ba5e-47a1-8751-c33748da2f49" (UID: "7d1d855f-ba5e-47a1-8751-c33748da2f49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:15:49.009140 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.009120    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-token" (OuterVolumeSpecName: "istio-token") pod "7d1d855f-ba5e-47a1-8751-c33748da2f49" (UID: "7d1d855f-ba5e-47a1-8751-c33748da2f49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:15:49.107283 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.107254    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-podinfo\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:49.107283 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.107278    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-workload-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:49.107283 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.107288    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-envoy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:49.107514 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.107297    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjhnr\" (UniqueName: \"kubernetes.io/projected/7d1d855f-ba5e-47a1-8751-c33748da2f49-kube-api-access-tjhnr\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:49.107514 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.107306    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d1d855f-ba5e-47a1-8751-c33748da2f49-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:49.438967 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.438936    2583 generic.go:356] "Generic (PLEG): container finished" podID="7d1d855f-ba5e-47a1-8751-c33748da2f49" containerID="ef7a33312365d28e17897233ec5603a0e47f9a2094d882e93ecb8c3cbededda6" exitCode=0
Sep 18 20:15:49.439150 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.438978    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh" event={"ID":"7d1d855f-ba5e-47a1-8751-c33748da2f49","Type":"ContainerDied","Data":"ef7a33312365d28e17897233ec5603a0e47f9a2094d882e93ecb8c3cbededda6"}
Sep 18 20:15:49.439150 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.438990    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"
Sep 18 20:15:49.439150 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.439021    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh" event={"ID":"7d1d855f-ba5e-47a1-8751-c33748da2f49","Type":"ContainerDied","Data":"44f9a7f0686047aef9b3b721c0fc4f58da3db1119b30791ce200c5304a1681b9"}
Sep 18 20:15:49.439150 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.439065    2583 scope.go:117] "RemoveContainer" containerID="ef7a33312365d28e17897233ec5603a0e47f9a2094d882e93ecb8c3cbededda6"
Sep 18 20:15:49.448924 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.448904    2583 scope.go:117] "RemoveContainer" containerID="56cb6768cc5bcf604349d01dd22df47032d9ddceca7f870bb1636daf9f7e0a48"
Sep 18 20:15:49.457144 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.457127    2583 scope.go:117] "RemoveContainer" containerID="ef7a33312365d28e17897233ec5603a0e47f9a2094d882e93ecb8c3cbededda6"
Sep 18 20:15:49.457418 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:15:49.457396    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef7a33312365d28e17897233ec5603a0e47f9a2094d882e93ecb8c3cbededda6\": container with ID starting with ef7a33312365d28e17897233ec5603a0e47f9a2094d882e93ecb8c3cbededda6 not found: ID does not exist" containerID="ef7a33312365d28e17897233ec5603a0e47f9a2094d882e93ecb8c3cbededda6"
Sep 18 20:15:49.457522 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.457423    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef7a33312365d28e17897233ec5603a0e47f9a2094d882e93ecb8c3cbededda6"} err="failed to get container status \"ef7a33312365d28e17897233ec5603a0e47f9a2094d882e93ecb8c3cbededda6\": rpc error: code = NotFound desc = could not find container \"ef7a33312365d28e17897233ec5603a0e47f9a2094d882e93ecb8c3cbededda6\": container with ID starting with ef7a33312365d28e17897233ec5603a0e47f9a2094d882e93ecb8c3cbededda6 not found: ID does not exist"
Sep 18 20:15:49.457522 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.457439    2583 scope.go:117] "RemoveContainer" containerID="56cb6768cc5bcf604349d01dd22df47032d9ddceca7f870bb1636daf9f7e0a48"
Sep 18 20:15:49.457815 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:15:49.457786    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56cb6768cc5bcf604349d01dd22df47032d9ddceca7f870bb1636daf9f7e0a48\": container with ID starting with 56cb6768cc5bcf604349d01dd22df47032d9ddceca7f870bb1636daf9f7e0a48 not found: ID does not exist" containerID="56cb6768cc5bcf604349d01dd22df47032d9ddceca7f870bb1636daf9f7e0a48"
Sep 18 20:15:49.457920 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.457815    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56cb6768cc5bcf604349d01dd22df47032d9ddceca7f870bb1636daf9f7e0a48"} err="failed to get container status \"56cb6768cc5bcf604349d01dd22df47032d9ddceca7f870bb1636daf9f7e0a48\": rpc error: code = NotFound desc = could not find container \"56cb6768cc5bcf604349d01dd22df47032d9ddceca7f870bb1636daf9f7e0a48\": container with ID starting with 56cb6768cc5bcf604349d01dd22df47032d9ddceca7f870bb1636daf9f7e0a48 not found: ID does not exist"
Sep 18 20:15:49.461068 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.461047    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"]
Sep 18 20:15:49.466246 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.466227    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-9c0eb2-openshift-default-77b88cd6c4-t9hwh"]
Sep 18 20:15:49.811450 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:49.811376    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d1d855f-ba5e-47a1-8751-c33748da2f49" path="/var/lib/kubelet/pods/7d1d855f-ba5e-47a1-8751-c33748da2f49/volumes"
Sep 18 20:15:54.500319 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.500283    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-57b6ce-29829375-2hhd9"]
Sep 18 20:15:54.504399 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.504374    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-57b6ce-29829375-2hhd9"]
Sep 18 20:15:54.508913 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.508891    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:54.542154 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.542117    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"]
Sep 18 20:15:54.542427 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.542401    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm" podUID="6df1c163-0eb1-4a05-95cd-c479b61a7ab9" containerName="payload-pre-processing" containerID="cri-o://56ee27a33915676aaeb32d50e231a95109eb07c410d783ed989ba9487e32c612" gracePeriod=30
Sep 18 20:15:54.579453 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.579412    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:54.680574 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.680545    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:54.704531 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.704504    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb"]
Sep 18 20:15:54.707690 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.707665    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-57b6ce-pqrpb"]
Sep 18 20:15:54.764028 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.763952    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:54.796829 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.796808    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"
Sep 18 20:15:54.858473 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.858446    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgnhj\" (UniqueName: \"kubernetes.io/projected/6df1c163-0eb1-4a05-95cd-c479b61a7ab9-kube-api-access-cgnhj\") pod \"6df1c163-0eb1-4a05-95cd-c479b61a7ab9\" (UID: \"6df1c163-0eb1-4a05-95cd-c479b61a7ab9\") "
Sep 18 20:15:54.858626 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.858501    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df1c163-0eb1-4a05-95cd-c479b61a7ab9-plugins-config-volume\") pod \"6df1c163-0eb1-4a05-95cd-c479b61a7ab9\" (UID: \"6df1c163-0eb1-4a05-95cd-c479b61a7ab9\") "
Sep 18 20:15:54.858858 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.858836    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6df1c163-0eb1-4a05-95cd-c479b61a7ab9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6df1c163-0eb1-4a05-95cd-c479b61a7ab9" (UID: "6df1c163-0eb1-4a05-95cd-c479b61a7ab9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:15:54.860565 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.860543    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6df1c163-0eb1-4a05-95cd-c479b61a7ab9-kube-api-access-cgnhj" (OuterVolumeSpecName: "kube-api-access-cgnhj") pod "6df1c163-0eb1-4a05-95cd-c479b61a7ab9" (UID: "6df1c163-0eb1-4a05-95cd-c479b61a7ab9"). InnerVolumeSpecName "kube-api-access-cgnhj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:15:54.959670 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.959638    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6df1c163-0eb1-4a05-95cd-c479b61a7ab9-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:54.959670 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:54.959664    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgnhj\" (UniqueName: \"kubernetes.io/projected/6df1c163-0eb1-4a05-95cd-c479b61a7ab9-kube-api-access-cgnhj\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:15:55.090247 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.090215    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:55.164304 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.164279    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:15:55.479648 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.479553    2583 generic.go:356] "Generic (PLEG): container finished" podID="6df1c163-0eb1-4a05-95cd-c479b61a7ab9" containerID="56ee27a33915676aaeb32d50e231a95109eb07c410d783ed989ba9487e32c612" exitCode=0
Sep 18 20:15:55.479648 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.479605    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"
Sep 18 20:15:55.479648 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.479621    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm" event={"ID":"6df1c163-0eb1-4a05-95cd-c479b61a7ab9","Type":"ContainerDied","Data":"56ee27a33915676aaeb32d50e231a95109eb07c410d783ed989ba9487e32c612"}
Sep 18 20:15:55.479863 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.479678    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm" event={"ID":"6df1c163-0eb1-4a05-95cd-c479b61a7ab9","Type":"ContainerDied","Data":"03241b5768e92b373289a4233703cfca41b73e6ae84f768725e279165253403b"}
Sep 18 20:15:55.479863 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.479701    2583 scope.go:117] "RemoveContainer" containerID="56ee27a33915676aaeb32d50e231a95109eb07c410d783ed989ba9487e32c612"
Sep 18 20:15:55.489646 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.489625    2583 scope.go:117] "RemoveContainer" containerID="56ee27a33915676aaeb32d50e231a95109eb07c410d783ed989ba9487e32c612"
Sep 18 20:15:55.489931 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:15:55.489909    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56ee27a33915676aaeb32d50e231a95109eb07c410d783ed989ba9487e32c612\": container with ID starting with 56ee27a33915676aaeb32d50e231a95109eb07c410d783ed989ba9487e32c612 not found: ID does not exist" containerID="56ee27a33915676aaeb32d50e231a95109eb07c410d783ed989ba9487e32c612"
Sep 18 20:15:55.490003 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.489943    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56ee27a33915676aaeb32d50e231a95109eb07c410d783ed989ba9487e32c612"} err="failed to get container status \"56ee27a33915676aaeb32d50e231a95109eb07c410d783ed989ba9487e32c612\": rpc error: code = NotFound desc = could not find container \"56ee27a33915676aaeb32d50e231a95109eb07c410d783ed989ba9487e32c612\": container with ID starting with 56ee27a33915676aaeb32d50e231a95109eb07c410d783ed989ba9487e32c612 not found: ID does not exist"
Sep 18 20:15:55.503163 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.503141    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"]
Sep 18 20:15:55.506994 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.506972    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-57b6ce-7c69b675c8-r2tsm"]
Sep 18 20:15:55.810979 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.810899    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="666f078e-ce0c-4387-8479-4bee7340415d" path="/var/lib/kubelet/pods/666f078e-ce0c-4387-8479-4bee7340415d/volumes"
Sep 18 20:15:55.811295 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.811281    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6df1c163-0eb1-4a05-95cd-c479b61a7ab9" path="/var/lib/kubelet/pods/6df1c163-0eb1-4a05-95cd-c479b61a7ab9/volumes"
Sep 18 20:15:55.811566 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.811555    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf2350b3-bd06-4532-abbf-d21e3cf69f0e" path="/var/lib/kubelet/pods/bf2350b3-bd06-4532-abbf-d21e3cf69f0e/volumes"
Sep 18 20:15:55.920582 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:15:55.920550    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:01.177785 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.177753    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:01.245915 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.245878    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:01.456084 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.455981    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:01.802387 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.802309    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9"]
Sep 18 20:16:01.802683 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.802671    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf2350b3-bd06-4532-abbf-d21e3cf69f0e" containerName="revoke-keys"
Sep 18 20:16:01.802728 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.802685    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf2350b3-bd06-4532-abbf-d21e3cf69f0e" containerName="revoke-keys"
Sep 18 20:16:01.802728 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.802699    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d1d855f-ba5e-47a1-8751-c33748da2f49" containerName="istio-proxy"
Sep 18 20:16:01.802728 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.802706    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d1d855f-ba5e-47a1-8751-c33748da2f49" containerName="istio-proxy"
Sep 18 20:16:01.802826 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.802729    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6df1c163-0eb1-4a05-95cd-c479b61a7ab9" containerName="payload-pre-processing"
Sep 18 20:16:01.802826 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.802734    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6df1c163-0eb1-4a05-95cd-c479b61a7ab9" containerName="payload-pre-processing"
Sep 18 20:16:01.802826 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.802788    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="206b4006-42b6-42f8-8d86-5a17e31e57c2" containerName="istio-proxy"
Sep 18 20:16:01.802826 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.802797    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6df1c163-0eb1-4a05-95cd-c479b61a7ab9" containerName="payload-pre-processing"
Sep 18 20:16:01.802826 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.802804    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d1d855f-ba5e-47a1-8751-c33748da2f49" containerName="istio-proxy"
Sep 18 20:16:01.802826 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.802810    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d1d855f-ba5e-47a1-8751-c33748da2f49" containerName="istio-proxy"
Sep 18 20:16:01.802826 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.802817    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf2350b3-bd06-4532-abbf-d21e3cf69f0e" containerName="revoke-keys"
Sep 18 20:16:01.807432 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.807404    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9"
Sep 18 20:16:01.810492 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.810466    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 18 20:16:01.810695 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.810614    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-5ttnn\""
Sep 18 20:16:01.815925 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.815723    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9"]
Sep 18 20:16:01.921219 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:01.921184    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79333b59-bd6c-4e86-9f41-cce8a76a53e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9\" (UID: \"79333b59-bd6c-4e86-9f41-cce8a76a53e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9"
Sep 18 20:16:02.022679 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:02.022643    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79333b59-bd6c-4e86-9f41-cce8a76a53e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9\" (UID: \"79333b59-bd6c-4e86-9f41-cce8a76a53e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9"
Sep 18 20:16:02.023313 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:02.023295    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79333b59-bd6c-4e86-9f41-cce8a76a53e3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9\" (UID: \"79333b59-bd6c-4e86-9f41-cce8a76a53e3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9"
Sep 18 20:16:02.119349 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:02.119315    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9"
Sep 18 20:16:02.434224 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:02.434195    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9"]
Sep 18 20:16:02.435028 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:16:02.434999    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79333b59_bd6c_4e86_9f41_cce8a76a53e3.slice/crio-30d615b6e111e62d2e23b93e0c98b86af8449f94a9e84ef0bca48ab6a8757440 WatchSource:0}: Error finding container 30d615b6e111e62d2e23b93e0c98b86af8449f94a9e84ef0bca48ab6a8757440: Status 404 returned error can't find the container with id 30d615b6e111e62d2e23b93e0c98b86af8449f94a9e84ef0bca48ab6a8757440
Sep 18 20:16:02.524318 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:02.524287    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9" event={"ID":"79333b59-bd6c-4e86-9f41-cce8a76a53e3","Type":"ContainerStarted","Data":"30d615b6e111e62d2e23b93e0c98b86af8449f94a9e84ef0bca48ab6a8757440"}
Sep 18 20:16:02.718740 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:02.718660    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:03.433384 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:03.433292    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:03.532275 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:03.532240    2583 generic.go:356] "Generic (PLEG): container finished" podID="79333b59-bd6c-4e86-9f41-cce8a76a53e3" containerID="bdebe931c0c668f631f78c13f11068910efa9c2388f94463a505f56f4d1ee5c7" exitCode=0
Sep 18 20:16:03.532679 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:03.532335    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9" event={"ID":"79333b59-bd6c-4e86-9f41-cce8a76a53e3","Type":"ContainerDied","Data":"bdebe931c0c668f631f78c13f11068910efa9c2388f94463a505f56f4d1ee5c7"}
Sep 18 20:16:04.666390 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:04.666368    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9"
Sep 18 20:16:04.751013 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:04.750988    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79333b59-bd6c-4e86-9f41-cce8a76a53e3-maas-api-service-ca\") pod \"79333b59-bd6c-4e86-9f41-cce8a76a53e3\" (UID: \"79333b59-bd6c-4e86-9f41-cce8a76a53e3\") "
Sep 18 20:16:04.751342 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:04.751319    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79333b59-bd6c-4e86-9f41-cce8a76a53e3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "79333b59-bd6c-4e86-9f41-cce8a76a53e3" (UID: "79333b59-bd6c-4e86-9f41-cce8a76a53e3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:16:04.851910 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:04.851882    2583 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/79333b59-bd6c-4e86-9f41-cce8a76a53e3-maas-api-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:16:05.546057 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:05.546009    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9"
Sep 18 20:16:05.546057 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:05.546032    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9" event={"ID":"79333b59-bd6c-4e86-9f41-cce8a76a53e3","Type":"ContainerDied","Data":"30d615b6e111e62d2e23b93e0c98b86af8449f94a9e84ef0bca48ab6a8757440"}
Sep 18 20:16:05.546265 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:05.546097    2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30d615b6e111e62d2e23b93e0c98b86af8449f94a9e84ef0bca48ab6a8757440"
Sep 18 20:16:12.293327 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.293299    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:12.298962 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.298936    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-5547b6-29829375-96kb4"]
Sep 18 20:16:12.301078 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.301055    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-5547b6-29829375-96kb4"]
Sep 18 20:16:12.322453 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.322427    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"]
Sep 18 20:16:12.322690 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.322668    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn" podUID="6c9d1a43-23fb-461e-afde-49e00021ede6" containerName="payload-processing" containerID="cri-o://e4829ea5919675a6daf91b45917cefb0061a487b4501aca8a653905b0f53d5dc" gracePeriod=30
Sep 18 20:16:12.363955 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.363929    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:12.464614 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.464575    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:12.481344 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.481282    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9"]
Sep 18 20:16:12.483838 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.483811    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-5547b6-c9mg9"]
Sep 18 20:16:12.521145 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.521122    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:12.588484 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.588458    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"
Sep 18 20:16:12.589006 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.588979    2583 generic.go:356] "Generic (PLEG): container finished" podID="6c9d1a43-23fb-461e-afde-49e00021ede6" containerID="e4829ea5919675a6daf91b45917cefb0061a487b4501aca8a653905b0f53d5dc" exitCode=0
Sep 18 20:16:12.589112 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.589070    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn" event={"ID":"6c9d1a43-23fb-461e-afde-49e00021ede6","Type":"ContainerDied","Data":"e4829ea5919675a6daf91b45917cefb0061a487b4501aca8a653905b0f53d5dc"}
Sep 18 20:16:12.589157 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.589118    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn" event={"ID":"6c9d1a43-23fb-461e-afde-49e00021ede6","Type":"ContainerDied","Data":"64f42090bfd72dc4bc932712430136dcc1fa0398c9e2a1fb9658ec02525860e7"}
Sep 18 20:16:12.589157 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.589144    2583 scope.go:117] "RemoveContainer" containerID="e4829ea5919675a6daf91b45917cefb0061a487b4501aca8a653905b0f53d5dc"
Sep 18 20:16:12.599937 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.599914    2583 scope.go:117] "RemoveContainer" containerID="e4829ea5919675a6daf91b45917cefb0061a487b4501aca8a653905b0f53d5dc"
Sep 18 20:16:12.600263 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:16:12.600241    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4829ea5919675a6daf91b45917cefb0061a487b4501aca8a653905b0f53d5dc\": container with ID starting with e4829ea5919675a6daf91b45917cefb0061a487b4501aca8a653905b0f53d5dc not found: ID does not exist" containerID="e4829ea5919675a6daf91b45917cefb0061a487b4501aca8a653905b0f53d5dc"
Sep 18 20:16:12.600377 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.600276    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4829ea5919675a6daf91b45917cefb0061a487b4501aca8a653905b0f53d5dc"} err="failed to get container status \"e4829ea5919675a6daf91b45917cefb0061a487b4501aca8a653905b0f53d5dc\": rpc error: code = NotFound desc = could not find container \"e4829ea5919675a6daf91b45917cefb0061a487b4501aca8a653905b0f53d5dc\": container with ID starting with e4829ea5919675a6daf91b45917cefb0061a487b4501aca8a653905b0f53d5dc not found: ID does not exist"
Sep 18 20:16:12.715193 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.715161    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c9d1a43-23fb-461e-afde-49e00021ede6-plugins-config-volume\") pod \"6c9d1a43-23fb-461e-afde-49e00021ede6\" (UID: \"6c9d1a43-23fb-461e-afde-49e00021ede6\") "
Sep 18 20:16:12.715337 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.715299    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjmsb\" (UniqueName: \"kubernetes.io/projected/6c9d1a43-23fb-461e-afde-49e00021ede6-kube-api-access-tjmsb\") pod \"6c9d1a43-23fb-461e-afde-49e00021ede6\" (UID: \"6c9d1a43-23fb-461e-afde-49e00021ede6\") "
Sep 18 20:16:12.715569 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.715547    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c9d1a43-23fb-461e-afde-49e00021ede6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6c9d1a43-23fb-461e-afde-49e00021ede6" (UID: "6c9d1a43-23fb-461e-afde-49e00021ede6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:16:12.717390 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.717368    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c9d1a43-23fb-461e-afde-49e00021ede6-kube-api-access-tjmsb" (OuterVolumeSpecName: "kube-api-access-tjmsb") pod "6c9d1a43-23fb-461e-afde-49e00021ede6" (UID: "6c9d1a43-23fb-461e-afde-49e00021ede6"). InnerVolumeSpecName "kube-api-access-tjmsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:16:12.816083 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.816056    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjmsb\" (UniqueName: \"kubernetes.io/projected/6c9d1a43-23fb-461e-afde-49e00021ede6-kube-api-access-tjmsb\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:16:12.816083 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.816079    2583 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6c9d1a43-23fb-461e-afde-49e00021ede6-plugins-config-volume\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:16:12.847247 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.847220    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:12.948129 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:12.948099    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:13.595468 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:13.595443    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"
Sep 18 20:16:13.617796 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:13.617768    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"]
Sep 18 20:16:13.622162 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:13.622133    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-5547b6-bb697b5cf-kvrnn"]
Sep 18 20:16:13.811250 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:13.811219    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ad925da-f775-4952-90f7-73748350a59b" path="/var/lib/kubelet/pods/5ad925da-f775-4952-90f7-73748350a59b/volumes"
Sep 18 20:16:13.811551 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:13.811539    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c9d1a43-23fb-461e-afde-49e00021ede6" path="/var/lib/kubelet/pods/6c9d1a43-23fb-461e-afde-49e00021ede6/volumes"
Sep 18 20:16:13.811834 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:13.811823    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79333b59-bd6c-4e86-9f41-cce8a76a53e3" path="/var/lib/kubelet/pods/79333b59-bd6c-4e86-9f41-cce8a76a53e3/volumes"
Sep 18 20:16:19.564086 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:19.564031    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:19.662918 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:19.662887    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:19.887186 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:19.887152    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"]
Sep 18 20:16:19.887423 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:19.887398    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl" podUID="0015137d-3932-4690-80cc-f4517c7b4686" containerName="istio-proxy" containerID="cri-o://b93c7185aa0bbb3b9480620bf91c241880be67a66cd64ffc6b415b70fd081739" gracePeriod=30
Sep 18 20:16:19.912868 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:19.912843    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:16:25.140392 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.140366    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:16:25.226453 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.226389    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0015137d-3932-4690-80cc-f4517c7b4686-istio-token\") pod \"0015137d-3932-4690-80cc-f4517c7b4686\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") "
Sep 18 20:16:25.226453 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.226439    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-istio-data\") pod \"0015137d-3932-4690-80cc-f4517c7b4686\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") "
Sep 18 20:16:25.226630 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.226466    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-credential-socket\") pod \"0015137d-3932-4690-80cc-f4517c7b4686\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") "
Sep 18 20:16:25.226630 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.226502    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xxrcc\" (UniqueName: \"kubernetes.io/projected/0015137d-3932-4690-80cc-f4517c7b4686-kube-api-access-xxrcc\") pod \"0015137d-3932-4690-80cc-f4517c7b4686\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") "
Sep 18 20:16:25.226630 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.226519    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0015137d-3932-4690-80cc-f4517c7b4686-istiod-ca-cert\") pod \"0015137d-3932-4690-80cc-f4517c7b4686\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") "
Sep 18 20:16:25.226630 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.226550    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-workload-socket\") pod \"0015137d-3932-4690-80cc-f4517c7b4686\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") "
Sep 18 20:16:25.226630 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.226601    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-workload-certs\") pod \"0015137d-3932-4690-80cc-f4517c7b4686\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") "
Sep 18 20:16:25.226889 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.226630    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-istio-envoy\") pod \"0015137d-3932-4690-80cc-f4517c7b4686\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") "
Sep 18 20:16:25.226889 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.226678    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0015137d-3932-4690-80cc-f4517c7b4686-istio-podinfo\") pod \"0015137d-3932-4690-80cc-f4517c7b4686\" (UID: \"0015137d-3932-4690-80cc-f4517c7b4686\") "
Sep 18 20:16:25.226889 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.226767    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-istio-data" (OuterVolumeSpecName: "istio-data") pod "0015137d-3932-4690-80cc-f4517c7b4686" (UID: "0015137d-3932-4690-80cc-f4517c7b4686"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:16:25.226889 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.226813    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0015137d-3932-4690-80cc-f4517c7b4686" (UID: "0015137d-3932-4690-80cc-f4517c7b4686"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:16:25.227130 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.226918    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0015137d-3932-4690-80cc-f4517c7b4686" (UID: "0015137d-3932-4690-80cc-f4517c7b4686"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:16:25.227130 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.226969    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0015137d-3932-4690-80cc-f4517c7b4686-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0015137d-3932-4690-80cc-f4517c7b4686" (UID: "0015137d-3932-4690-80cc-f4517c7b4686"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 18 20:16:25.227130 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.226998    2583 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-istio-data\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:16:25.227130 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.227017    2583 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-credential-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:16:25.227130 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.227031    2583 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-workload-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:16:25.227130 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.227072    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0015137d-3932-4690-80cc-f4517c7b4686" (UID: "0015137d-3932-4690-80cc-f4517c7b4686"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:16:25.228624 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.228600    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0015137d-3932-4690-80cc-f4517c7b4686-istio-token" (OuterVolumeSpecName: "istio-token") pod "0015137d-3932-4690-80cc-f4517c7b4686" (UID: "0015137d-3932-4690-80cc-f4517c7b4686"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:16:25.228748 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.228721    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0015137d-3932-4690-80cc-f4517c7b4686-kube-api-access-xxrcc" (OuterVolumeSpecName: "kube-api-access-xxrcc") pod "0015137d-3932-4690-80cc-f4517c7b4686" (UID: "0015137d-3932-4690-80cc-f4517c7b4686"). InnerVolumeSpecName "kube-api-access-xxrcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:16:25.228844 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.228830    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0015137d-3932-4690-80cc-f4517c7b4686" (UID: "0015137d-3932-4690-80cc-f4517c7b4686"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:16:25.228885 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.228852    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0015137d-3932-4690-80cc-f4517c7b4686-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0015137d-3932-4690-80cc-f4517c7b4686" (UID: "0015137d-3932-4690-80cc-f4517c7b4686"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 18 20:16:25.327884 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.327860    2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0015137d-3932-4690-80cc-f4517c7b4686-istio-token\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:16:25.327884 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.327881    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xxrcc\" (UniqueName: \"kubernetes.io/projected/0015137d-3932-4690-80cc-f4517c7b4686-kube-api-access-xxrcc\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:16:25.328071 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.327891    2583 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0015137d-3932-4690-80cc-f4517c7b4686-istiod-ca-cert\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:16:25.328071 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.327901    2583 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-workload-socket\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:16:25.328071 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.327909    2583 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0015137d-3932-4690-80cc-f4517c7b4686-istio-envoy\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:16:25.328071 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.327917    2583 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0015137d-3932-4690-80cc-f4517c7b4686-istio-podinfo\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:16:25.663242 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.663207    2583 generic.go:356] "Generic (PLEG): container finished" podID="0015137d-3932-4690-80cc-f4517c7b4686" containerID="b93c7185aa0bbb3b9480620bf91c241880be67a66cd64ffc6b415b70fd081739" exitCode=0
Sep 18 20:16:25.663458 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.663264    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"
Sep 18 20:16:25.663458 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.663301    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl" event={"ID":"0015137d-3932-4690-80cc-f4517c7b4686","Type":"ContainerDied","Data":"b93c7185aa0bbb3b9480620bf91c241880be67a66cd64ffc6b415b70fd081739"}
Sep 18 20:16:25.663458 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.663354    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl" event={"ID":"0015137d-3932-4690-80cc-f4517c7b4686","Type":"ContainerDied","Data":"a78506357196a93797767b88e756bddec1f71a7045b55d442c64278b55085e80"}
Sep 18 20:16:25.663458 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.663377    2583 scope.go:117] "RemoveContainer" containerID="b93c7185aa0bbb3b9480620bf91c241880be67a66cd64ffc6b415b70fd081739"
Sep 18 20:16:25.673412 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.673395    2583 scope.go:117] "RemoveContainer" containerID="d9fa48f5cbd59789b547a23c2ec021096d19df3026e76510aabaef5cdaa56a85"
Sep 18 20:16:25.681659 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.681638    2583 scope.go:117] "RemoveContainer" containerID="b93c7185aa0bbb3b9480620bf91c241880be67a66cd64ffc6b415b70fd081739"
Sep 18 20:16:25.681890 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:16:25.681869    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b93c7185aa0bbb3b9480620bf91c241880be67a66cd64ffc6b415b70fd081739\": container with ID starting with b93c7185aa0bbb3b9480620bf91c241880be67a66cd64ffc6b415b70fd081739 not found: ID does not exist" containerID="b93c7185aa0bbb3b9480620bf91c241880be67a66cd64ffc6b415b70fd081739"
Sep 18 20:16:25.681935 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.681901    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b93c7185aa0bbb3b9480620bf91c241880be67a66cd64ffc6b415b70fd081739"} err="failed to get container status \"b93c7185aa0bbb3b9480620bf91c241880be67a66cd64ffc6b415b70fd081739\": rpc error: code = NotFound desc = could not find container \"b93c7185aa0bbb3b9480620bf91c241880be67a66cd64ffc6b415b70fd081739\": container with ID starting with b93c7185aa0bbb3b9480620bf91c241880be67a66cd64ffc6b415b70fd081739 not found: ID does not exist"
Sep 18 20:16:25.681935 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.681922    2583 scope.go:117] "RemoveContainer" containerID="d9fa48f5cbd59789b547a23c2ec021096d19df3026e76510aabaef5cdaa56a85"
Sep 18 20:16:25.682183 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:16:25.682149    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9fa48f5cbd59789b547a23c2ec021096d19df3026e76510aabaef5cdaa56a85\": container with ID starting with d9fa48f5cbd59789b547a23c2ec021096d19df3026e76510aabaef5cdaa56a85 not found: ID does not exist" containerID="d9fa48f5cbd59789b547a23c2ec021096d19df3026e76510aabaef5cdaa56a85"
Sep 18 20:16:25.682183 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.682168    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9fa48f5cbd59789b547a23c2ec021096d19df3026e76510aabaef5cdaa56a85"} err="failed to get container status \"d9fa48f5cbd59789b547a23c2ec021096d19df3026e76510aabaef5cdaa56a85\": rpc error: code = NotFound desc = could not find container \"d9fa48f5cbd59789b547a23c2ec021096d19df3026e76510aabaef5cdaa56a85\": container with ID starting with d9fa48f5cbd59789b547a23c2ec021096d19df3026e76510aabaef5cdaa56a85 not found: ID does not exist"
Sep 18 20:16:25.685989 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.685966    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"]
Sep 18 20:16:25.688112 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.688081    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-5547b6-openshift-default-6576cf4476-llwtl"]
Sep 18 20:16:25.810901 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:25.810877    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0015137d-3932-4690-80cc-f4517c7b4686" path="/var/lib/kubelet/pods/0015137d-3932-4690-80cc-f4517c7b4686/volumes"
Sep 18 20:16:58.198834 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:16:58.198790    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:17:34.241314 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:17:34.241283    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:17:47.709721 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:17:47.709690    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:17:49.146801 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:17:49.146771    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:18:01.697374 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:18:01.697300    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:18:55.928461 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:18:55.928422    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:19:19.958228 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:19:19.958196    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 20:19:19.964606 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:19:19.964587    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zggbw_53867202-24a8-425c-b9c5-ada8d6cc631e/ovn-acl-logging/0.log"
Sep 18 20:20:09.911636 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:09.911609    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:20:10.008406 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:10.008369    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:20:21.123403 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:21.123372    2583 scope.go:117] "RemoveContainer" containerID="cefee588f84df97b04f4106904da4b30d1f4ddc6dfc4d5d6d639d464a4c58784"
Sep 18 20:20:43.499013 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:43.498980    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:20:49.565291 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.565258    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"]
Sep 18 20:20:49.565764 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.565745    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c9d1a43-23fb-461e-afde-49e00021ede6" containerName="payload-processing"
Sep 18 20:20:49.565854 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.565768    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c9d1a43-23fb-461e-afde-49e00021ede6" containerName="payload-processing"
Sep 18 20:20:49.565854 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.565791    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d1d855f-ba5e-47a1-8751-c33748da2f49" containerName="istio-proxy"
Sep 18 20:20:49.565854 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.565800    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d1d855f-ba5e-47a1-8751-c33748da2f49" containerName="istio-proxy"
Sep 18 20:20:49.565854 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.565814    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0015137d-3932-4690-80cc-f4517c7b4686" containerName="istio-proxy"
Sep 18 20:20:49.565854 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.565831    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0015137d-3932-4690-80cc-f4517c7b4686" containerName="istio-proxy"
Sep 18 20:20:49.565854 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.565851    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0015137d-3932-4690-80cc-f4517c7b4686" containerName="istio-proxy"
Sep 18 20:20:49.566202 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.565860    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="0015137d-3932-4690-80cc-f4517c7b4686" containerName="istio-proxy"
Sep 18 20:20:49.566202 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.565879    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79333b59-bd6c-4e86-9f41-cce8a76a53e3" containerName="revoke-keys"
Sep 18 20:20:49.566202 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.565888    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="79333b59-bd6c-4e86-9f41-cce8a76a53e3" containerName="revoke-keys"
Sep 18 20:20:49.566202 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.565977    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="79333b59-bd6c-4e86-9f41-cce8a76a53e3" containerName="revoke-keys"
Sep 18 20:20:49.566202 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.565993    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0015137d-3932-4690-80cc-f4517c7b4686" containerName="istio-proxy"
Sep 18 20:20:49.566202 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.566000    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c9d1a43-23fb-461e-afde-49e00021ede6" containerName="payload-processing"
Sep 18 20:20:49.566202 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.566010    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="0015137d-3932-4690-80cc-f4517c7b4686" containerName="istio-proxy"
Sep 18 20:20:49.569121 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.569099    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.571398 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.571379    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-ccd585a7-kserve-self-signed-certs\""
Sep 18 20:20:49.578410 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.578385    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"]
Sep 18 20:20:49.602603 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.602576    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:20:49.685613 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.685582    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-tmp-dir\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.685774 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.685645    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30b12f18-9248-4323-8d75-0f66bedc436f-tls-certs\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.685774 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.685677    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-model-cache\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.685774 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.685720    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-home\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.685918 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.685782    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8tmb\" (UniqueName: \"kubernetes.io/projected/30b12f18-9248-4323-8d75-0f66bedc436f-kube-api-access-f8tmb\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.685918 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.685831    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-dshm\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.787095 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.787018    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-tmp-dir\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.787243 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.787128    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30b12f18-9248-4323-8d75-0f66bedc436f-tls-certs\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.787243 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.787153    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-model-cache\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.787243 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.787191    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-home\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.787243 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.787217    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8tmb\" (UniqueName: \"kubernetes.io/projected/30b12f18-9248-4323-8d75-0f66bedc436f-kube-api-access-f8tmb\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.787495 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.787249    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-dshm\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.787495 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.787429    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-tmp-dir\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.787611 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.787531    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-model-cache\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.787611 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.787560    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-home\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.789425 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.789405    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-dshm\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.789718 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.789697    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30b12f18-9248-4323-8d75-0f66bedc436f-tls-certs\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.795137 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.795119    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8tmb\" (UniqueName: \"kubernetes.io/projected/30b12f18-9248-4323-8d75-0f66bedc436f-kube-api-access-f8tmb\") pod \"e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") " pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:49.880077 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:49.880054    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:50.151916 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:50.151886    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"]
Sep 18 20:20:50.152901 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:20:50.152865    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30b12f18_9248_4323_8d75_0f66bedc436f.slice/crio-5f24b5dabe1f1a5a64c5c53626e7cbc9a5ec829779622391011d6a8188b1ce12 WatchSource:0}: Error finding container 5f24b5dabe1f1a5a64c5c53626e7cbc9a5ec829779622391011d6a8188b1ce12: Status 404 returned error can't find the container with id 5f24b5dabe1f1a5a64c5c53626e7cbc9a5ec829779622391011d6a8188b1ce12
Sep 18 20:20:51.161710 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:51.161673    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct" event={"ID":"30b12f18-9248-4323-8d75-0f66bedc436f","Type":"ContainerStarted","Data":"1cb2bedebd0dd6733fd98fd3f2e8707dc85e85b1b73a94ec1dc4736d0412b145"}
Sep 18 20:20:51.161710 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:51.161714    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct" event={"ID":"30b12f18-9248-4323-8d75-0f66bedc436f","Type":"ContainerStarted","Data":"5f24b5dabe1f1a5a64c5c53626e7cbc9a5ec829779622391011d6a8188b1ce12"}
Sep 18 20:20:59.880841 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:59.880810    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:59.880841 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:59.880851    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:59.893304 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:59.893281    2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:20:59.912819 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:20:59.912773    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct" podStartSLOduration=10.912758111 podStartE2EDuration="10.912758111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:20:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:20:51.184972483 +0000 UTC m=+2493.512066258" watchObservedRunningTime="2026-09-18 20:20:59.912758111 +0000 UTC m=+2502.239851871"
Sep 18 20:21:00.227356 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:00.227273    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:21:13.967159 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:13.967129    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:14.775890 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:14.775854    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"]
Sep 18 20:21:14.786256 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:14.786230    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:21:21.145230 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:21.145199    2583 scope.go:117] "RemoveContainer" containerID="753b629d8d53534439d3a8a385890589cade7f1e14f65feb06cd206021c271b1"
Sep 18 20:21:21.153913 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:21.153892    2583 scope.go:117] "RemoveContainer" containerID="65c547e5d1184769b9fb0182f01e9a59ba7474a79dcab2339c71fa431f8c907c"
Sep 18 20:21:21.161992 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:21.161972    2583 scope.go:117] "RemoveContainer" containerID="3a4800e223998c1fd40e0c446c651b11c6a68a4206bb1579747c655c9bb41a5a"
Sep 18 20:21:29.794819 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:29.794759    2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct" podUID="30b12f18-9248-4323-8d75-0f66bedc436f" containerName="main" containerID="cri-o://1cb2bedebd0dd6733fd98fd3f2e8707dc85e85b1b73a94ec1dc4736d0412b145" gracePeriod=45
Sep 18 20:21:30.041258 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.041231    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:21:30.114872 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.114839    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-model-cache\") pod \"30b12f18-9248-4323-8d75-0f66bedc436f\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") "
Sep 18 20:21:30.115062 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.114918    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-home\") pod \"30b12f18-9248-4323-8d75-0f66bedc436f\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") "
Sep 18 20:21:30.115062 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.114944    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30b12f18-9248-4323-8d75-0f66bedc436f-tls-certs\") pod \"30b12f18-9248-4323-8d75-0f66bedc436f\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") "
Sep 18 20:21:30.115062 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.114995    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8tmb\" (UniqueName: \"kubernetes.io/projected/30b12f18-9248-4323-8d75-0f66bedc436f-kube-api-access-f8tmb\") pod \"30b12f18-9248-4323-8d75-0f66bedc436f\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") "
Sep 18 20:21:30.115062 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.115020    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-tmp-dir\") pod \"30b12f18-9248-4323-8d75-0f66bedc436f\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") "
Sep 18 20:21:30.115305 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.115066    2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-dshm\") pod \"30b12f18-9248-4323-8d75-0f66bedc436f\" (UID: \"30b12f18-9248-4323-8d75-0f66bedc436f\") "
Sep 18 20:21:30.115305 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.115175    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-model-cache" (OuterVolumeSpecName: "model-cache") pod "30b12f18-9248-4323-8d75-0f66bedc436f" (UID: "30b12f18-9248-4323-8d75-0f66bedc436f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:21:30.115305 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.115215    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-home" (OuterVolumeSpecName: "home") pod "30b12f18-9248-4323-8d75-0f66bedc436f" (UID: "30b12f18-9248-4323-8d75-0f66bedc436f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:21:30.115453 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.115373    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "30b12f18-9248-4323-8d75-0f66bedc436f" (UID: "30b12f18-9248-4323-8d75-0f66bedc436f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:21:30.115501 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.115469    2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:21:30.115501 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.115487    2583 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:21:30.115501 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.115500    2583 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:21:30.117255 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.117227    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-dshm" (OuterVolumeSpecName: "dshm") pod "30b12f18-9248-4323-8d75-0f66bedc436f" (UID: "30b12f18-9248-4323-8d75-0f66bedc436f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 18 20:21:30.117367 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.117315    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30b12f18-9248-4323-8d75-0f66bedc436f-kube-api-access-f8tmb" (OuterVolumeSpecName: "kube-api-access-f8tmb") pod "30b12f18-9248-4323-8d75-0f66bedc436f" (UID: "30b12f18-9248-4323-8d75-0f66bedc436f"). InnerVolumeSpecName "kube-api-access-f8tmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 18 20:21:30.117367 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.117353    2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30b12f18-9248-4323-8d75-0f66bedc436f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "30b12f18-9248-4323-8d75-0f66bedc436f" (UID: "30b12f18-9248-4323-8d75-0f66bedc436f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 18 20:21:30.216562 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.216538    2583 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30b12f18-9248-4323-8d75-0f66bedc436f-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:21:30.216562 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.216559    2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8tmb\" (UniqueName: \"kubernetes.io/projected/30b12f18-9248-4323-8d75-0f66bedc436f-kube-api-access-f8tmb\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:21:30.216562 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.216568    2583 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30b12f18-9248-4323-8d75-0f66bedc436f-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\""
Sep 18 20:21:30.381852 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.381757    2583 generic.go:356] "Generic (PLEG): container finished" podID="30b12f18-9248-4323-8d75-0f66bedc436f" containerID="1cb2bedebd0dd6733fd98fd3f2e8707dc85e85b1b73a94ec1dc4736d0412b145" exitCode=0
Sep 18 20:21:30.381852 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.381804    2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"
Sep 18 20:21:30.382107 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.381853    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct" event={"ID":"30b12f18-9248-4323-8d75-0f66bedc436f","Type":"ContainerDied","Data":"1cb2bedebd0dd6733fd98fd3f2e8707dc85e85b1b73a94ec1dc4736d0412b145"}
Sep 18 20:21:30.382107 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.381902    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct" event={"ID":"30b12f18-9248-4323-8d75-0f66bedc436f","Type":"ContainerDied","Data":"5f24b5dabe1f1a5a64c5c53626e7cbc9a5ec829779622391011d6a8188b1ce12"}
Sep 18 20:21:30.382107 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.381925    2583 scope.go:117] "RemoveContainer" containerID="1cb2bedebd0dd6733fd98fd3f2e8707dc85e85b1b73a94ec1dc4736d0412b145"
Sep 18 20:21:30.391335 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.391321    2583 scope.go:117] "RemoveContainer" containerID="1cb2bedebd0dd6733fd98fd3f2e8707dc85e85b1b73a94ec1dc4736d0412b145"
Sep 18 20:21:30.391618 ip-10-0-135-240 kubenswrapper[2583]: E0918 20:21:30.391600    2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cb2bedebd0dd6733fd98fd3f2e8707dc85e85b1b73a94ec1dc4736d0412b145\": container with ID starting with 1cb2bedebd0dd6733fd98fd3f2e8707dc85e85b1b73a94ec1dc4736d0412b145 not found: ID does not exist" containerID="1cb2bedebd0dd6733fd98fd3f2e8707dc85e85b1b73a94ec1dc4736d0412b145"
Sep 18 20:21:30.391670 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.391626    2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cb2bedebd0dd6733fd98fd3f2e8707dc85e85b1b73a94ec1dc4736d0412b145"} err="failed to get container status \"1cb2bedebd0dd6733fd98fd3f2e8707dc85e85b1b73a94ec1dc4736d0412b145\": rpc error: code = NotFound desc = could not find container \"1cb2bedebd0dd6733fd98fd3f2e8707dc85e85b1b73a94ec1dc4736d0412b145\": container with ID starting with 1cb2bedebd0dd6733fd98fd3f2e8707dc85e85b1b73a94ec1dc4736d0412b145 not found: ID does not exist"
Sep 18 20:21:30.407109 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.407081    2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"]
Sep 18 20:21:30.412871 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:30.412850    2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-ccd585a7-kserve-7cfd95c49f-sfsct"]
Sep 18 20:21:31.811090 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:21:31.811031    2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30b12f18-9248-4323-8d75-0f66bedc436f" path="/var/lib/kubelet/pods/30b12f18-9248-4323-8d75-0f66bedc436f/volumes"
Sep 18 20:22:14.022023 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:14.021997    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd4fcf9c7-smtdb_a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8/copy-manifests/0.log"
Sep 18 20:22:14.035803 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:14.035777    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd4fcf9c7-smtdb_a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8/manager/0.log"
Sep 18 20:22:14.658977 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:14.658943    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29829360-sf4z7_8dee1a0b-209a-4ff8-ba90-2af8055910ed/cleanup/0.log"
Sep 18 20:22:14.787019 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:14.786990    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29829375-bg26m_02acef5f-5e5d-4623-8aaf-e845c6c6bb4d/cleanup/0.log"
Sep 18 20:22:16.824991 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:16.824964    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v_dc62143b-2654-44c3-96fb-1f14212e2eea/istio-proxy/0.log"
Sep 18 20:22:16.945020 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:16.944993    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-kzpkn_aac4f276-f608-45b1-afe6-9c766feef714/discovery/0.log"
Sep 18 20:22:17.646769 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:17.646745    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-679f8486cd-4ktr5_2d739ea5-66dc-4a3c-83b6-59d21c3054e5/router/0.log"
Sep 18 20:22:18.006104 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:18.006003    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-lbcgl_1d1c6d04-a770-446d-8f03-fd1883e4d36d/main/0.log"
Sep 18 20:22:18.237252 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:18.237214    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-xr7vd_f1c0f1bc-78e5-4868-9825-751b16a2a5a3/main/0.log"
Sep 18 20:22:21.189884 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:21.189855    2583 scope.go:117] "RemoveContainer" containerID="fd694305bb2352e407614bf6919e1fa2697e5598aca8b5470e4781c981b6630f"
Sep 18 20:22:21.198390 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:21.198372    2583 scope.go:117] "RemoveContainer" containerID="645747b2b5edb43ba8c6cd264163a3167f016b6e37969815017c84145e31f539"
Sep 18 20:22:21.205890 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:21.205874    2583 scope.go:117] "RemoveContainer" containerID="bdebe931c0c668f631f78c13f11068910efa9c2388f94463a505f56f4d1ee5c7"
Sep 18 20:22:24.636757 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.636718    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ts5cd/must-gather-ldt92"]
Sep 18 20:22:24.637293 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.637261    2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b12f18-9248-4323-8d75-0f66bedc436f" containerName="main"
Sep 18 20:22:24.637293 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.637287    2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b12f18-9248-4323-8d75-0f66bedc436f" containerName="main"
Sep 18 20:22:24.637541 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.637428    2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="30b12f18-9248-4323-8d75-0f66bedc436f" containerName="main"
Sep 18 20:22:24.642466 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.642449    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts5cd/must-gather-ldt92"
Sep 18 20:22:24.644760 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.644743    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ts5cd\"/\"openshift-service-ca.crt\""
Sep 18 20:22:24.645859 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.645840    2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ts5cd\"/\"kube-root-ca.crt\""
Sep 18 20:22:24.646192 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.645864    2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ts5cd\"/\"default-dockercfg-4nfxp\""
Sep 18 20:22:24.648764 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.648744    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts5cd/must-gather-ldt92"]
Sep 18 20:22:24.659883 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.659861    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:24.691601 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.691569    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/687ccb57-2f7c-4705-ab36-caed614caa5b-must-gather-output\") pod \"must-gather-ldt92\" (UID: \"687ccb57-2f7c-4705-ab36-caed614caa5b\") " pod="openshift-must-gather-ts5cd/must-gather-ldt92"
Sep 18 20:22:24.691702 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.691641    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv5c4\" (UniqueName: \"kubernetes.io/projected/687ccb57-2f7c-4705-ab36-caed614caa5b-kube-api-access-gv5c4\") pod \"must-gather-ldt92\" (UID: \"687ccb57-2f7c-4705-ab36-caed614caa5b\") " pod="openshift-must-gather-ts5cd/must-gather-ldt92"
Sep 18 20:22:24.758670 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.758643    2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log" limit=1024
Sep 18 20:22:24.792739 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.792715    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv5c4\" (UniqueName: \"kubernetes.io/projected/687ccb57-2f7c-4705-ab36-caed614caa5b-kube-api-access-gv5c4\") pod \"must-gather-ldt92\" (UID: \"687ccb57-2f7c-4705-ab36-caed614caa5b\") " pod="openshift-must-gather-ts5cd/must-gather-ldt92"
Sep 18 20:22:24.792840 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.792758    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/687ccb57-2f7c-4705-ab36-caed614caa5b-must-gather-output\") pod \"must-gather-ldt92\" (UID: \"687ccb57-2f7c-4705-ab36-caed614caa5b\") " pod="openshift-must-gather-ts5cd/must-gather-ldt92"
Sep 18 20:22:24.793026 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.793013    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/687ccb57-2f7c-4705-ab36-caed614caa5b-must-gather-output\") pod \"must-gather-ldt92\" (UID: \"687ccb57-2f7c-4705-ab36-caed614caa5b\") " pod="openshift-must-gather-ts5cd/must-gather-ldt92"
Sep 18 20:22:24.804310 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.804284    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv5c4\" (UniqueName: \"kubernetes.io/projected/687ccb57-2f7c-4705-ab36-caed614caa5b-kube-api-access-gv5c4\") pod \"must-gather-ldt92\" (UID: \"687ccb57-2f7c-4705-ab36-caed614caa5b\") " pod="openshift-must-gather-ts5cd/must-gather-ldt92"
Sep 18 20:22:24.953101 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:24.953016    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts5cd/must-gather-ldt92"
Sep 18 20:22:25.224891 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:25.224867    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts5cd/must-gather-ldt92"]
Sep 18 20:22:25.226718 ip-10-0-135-240 kubenswrapper[2583]: W0918 20:22:25.226695    2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod687ccb57_2f7c_4705_ab36_caed614caa5b.slice/crio-2ae05ac1e9ba720939ea75c838f1f3326f88f54d2f2e206f524fceeeb23cddfc WatchSource:0}: Error finding container 2ae05ac1e9ba720939ea75c838f1f3326f88f54d2f2e206f524fceeeb23cddfc: Status 404 returned error can't find the container with id 2ae05ac1e9ba720939ea75c838f1f3326f88f54d2f2e206f524fceeeb23cddfc
Sep 18 20:22:25.228599 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:25.228583    2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 18 20:22:25.699968 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:25.699930    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts5cd/must-gather-ldt92" event={"ID":"687ccb57-2f7c-4705-ab36-caed614caa5b","Type":"ContainerStarted","Data":"2ae05ac1e9ba720939ea75c838f1f3326f88f54d2f2e206f524fceeeb23cddfc"}
Sep 18 20:22:26.710715 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:26.710656    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts5cd/must-gather-ldt92" event={"ID":"687ccb57-2f7c-4705-ab36-caed614caa5b","Type":"ContainerStarted","Data":"1617142938fb88371e9f88325e5f7dd29869385ee4b0d2a83afc90d44a3295df"}
Sep 18 20:22:26.711204 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:26.711087    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts5cd/must-gather-ldt92" event={"ID":"687ccb57-2f7c-4705-ab36-caed614caa5b","Type":"ContainerStarted","Data":"30c1d77219ee067173cb97e39e7771ece32377dd194a18f9626a64499d566884"}
Sep 18 20:22:26.726746 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:26.726691    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ts5cd/must-gather-ldt92" podStartSLOduration=2.070620293 podStartE2EDuration="2.726670743s" totalImagesPullingTime="656.05045ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-18 20:22:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:22:26.724879536 +0000 UTC m=+2589.051973305" watchObservedRunningTime="2026-09-18 20:22:26.726670743 +0000 UTC m=+2589.053764508"
Sep 18 20:22:27.408376 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:27.408350    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ntbrb_8f0786db-0fd7-4113-ab68-7fc1a4048560/global-pull-secret-syncer/0.log"
Sep 18 20:22:27.497684 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:27.497656    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7vlhj_b83ca37a-46bd-4d22-9fa2-f9d3517200e6/konnectivity-agent/0.log"
Sep 18 20:22:27.586643 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:27.586615    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-240.ec2.internal_04ddfa7d8805c056a864c45acb85b2eb/haproxy/0.log"
Sep 18 20:22:34.097697 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:34.097645    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-847b8bd8d7-slmwj_e82cbbf2-9c64-4139-b7a5-0269815d4a21/cluster-monitoring-operator/0.log"
Sep 18 20:22:34.124247 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:34.124209    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mvvgs_5a863862-2470-44ab-8eaa-2e6d1377801f/kube-state-metrics/0.log"
Sep 18 20:22:34.145888 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:34.145856    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mvvgs_5a863862-2470-44ab-8eaa-2e6d1377801f/kube-rbac-proxy-main/0.log"
Sep 18 20:22:34.200723 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:34.200666    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-84c885658c-mvvgs_5a863862-2470-44ab-8eaa-2e6d1377801f/kube-rbac-proxy-self/0.log"
Sep 18 20:22:34.497444 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:34.497398    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlbpj_c604c92b-e572-499f-8da4-526f1c924ccf/node-exporter/0.log"
Sep 18 20:22:34.521614 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:34.521582    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlbpj_c604c92b-e572-499f-8da4-526f1c924ccf/kube-rbac-proxy/0.log"
Sep 18 20:22:34.544383 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:34.544280    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zlbpj_c604c92b-e572-499f-8da4-526f1c924ccf/init-textfile/0.log"
Sep 18 20:22:34.844106 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:34.844006    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-lfksr_92c9b495-5902-4735-aed3-fd3f18befbf9/prometheus-operator/0.log"
Sep 18 20:22:34.865418 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:34.865378    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-lfksr_92c9b495-5902-4735-aed3-fd3f18befbf9/kube-rbac-proxy/0.log"
Sep 18 20:22:34.998219 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:34.998187    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f8f5c4f87-cbknm_20c50db7-aa2f-40b1-9379-6f3ffea5c941/thanos-query/0.log"
Sep 18 20:22:35.021025 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:35.020986    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f8f5c4f87-cbknm_20c50db7-aa2f-40b1-9379-6f3ffea5c941/kube-rbac-proxy-web/0.log"
Sep 18 20:22:35.045772 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:35.045746    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f8f5c4f87-cbknm_20c50db7-aa2f-40b1-9379-6f3ffea5c941/kube-rbac-proxy/0.log"
Sep 18 20:22:35.069779 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:35.069756    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f8f5c4f87-cbknm_20c50db7-aa2f-40b1-9379-6f3ffea5c941/prom-label-proxy/0.log"
Sep 18 20:22:35.091180 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:35.091144    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f8f5c4f87-cbknm_20c50db7-aa2f-40b1-9379-6f3ffea5c941/kube-rbac-proxy-rules/0.log"
Sep 18 20:22:35.114152 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:35.114065    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f8f5c4f87-cbknm_20c50db7-aa2f-40b1-9379-6f3ffea5c941/kube-rbac-proxy-metrics/0.log"
Sep 18 20:22:36.510149 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:36.510110    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-tp4hr_70f3f4ae-9bcc-4527-b307-6d9b707d7673/networking-console-plugin/0.log"
Sep 18 20:22:37.254399 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.254358    2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"]
Sep 18 20:22:37.258607 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.258573    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.266484 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.266458    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"]
Sep 18 20:22:37.318933 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.318899    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-podres\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.319148 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.318970    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-proc\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.319148 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.319094    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-lib-modules\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.319148 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.319139    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq6j5\" (UniqueName: \"kubernetes.io/projected/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-kube-api-access-bq6j5\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.319315 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.319191    2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-sys\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.420790 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.420741    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-lib-modules\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.420988 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.420816    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq6j5\" (UniqueName: \"kubernetes.io/projected/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-kube-api-access-bq6j5\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.420988 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.420855    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-sys\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.420988 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.420901    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-podres\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.420988 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.420980    2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-proc\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.421264 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.421125    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-proc\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.421844 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.421818    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-lib-modules\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.422002 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.421978    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-sys\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.422203 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.422186    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-podres\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.431602 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.431579    2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq6j5\" (UniqueName: \"kubernetes.io/projected/8fd3b61a-bf59-4e74-b591-ca2f83d418f8-kube-api-access-bq6j5\") pod \"perf-node-gather-daemonset-jtwf8\" (UID: \"8fd3b61a-bf59-4e74-b591-ca2f83d418f8\") " pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.577916 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.577836    2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:37.868428 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:37.866242    2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"]
Sep 18 20:22:38.815917 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:38.815879    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8" event={"ID":"8fd3b61a-bf59-4e74-b591-ca2f83d418f8","Type":"ContainerStarted","Data":"49b427a79b80913d2db1c91a2415b0580136998e1d8686193d12e6ea7db77425"}
Sep 18 20:22:38.816407 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:38.815935    2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8" event={"ID":"8fd3b61a-bf59-4e74-b591-ca2f83d418f8","Type":"ContainerStarted","Data":"8275ace12cf315084ed898e5e89962d39ec169eea83f0e0a0c3f10735df130c1"}
Sep 18 20:22:38.816407 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:38.815980    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:38.832003 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:38.831952    2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8" podStartSLOduration=1.8319346909999998 podStartE2EDuration="1.831934691s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-18 20:22:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-18 20:22:38.831162662 +0000 UTC m=+2601.158256427" watchObservedRunningTime="2026-09-18 20:22:38.831934691 +0000 UTC m=+2601.159028454"
Sep 18 20:22:39.612413 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:39.612388    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xxsmg_9c53ef47-6278-4b13-88f8-9e873a25f48d/dns/0.log"
Sep 18 20:22:39.632171 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:39.632139    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xxsmg_9c53ef47-6278-4b13-88f8-9e873a25f48d/kube-rbac-proxy/0.log"
Sep 18 20:22:39.655995 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:39.655969    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dbv6f_7502ed14-3896-469a-b1e2-8e58bf1433a1/dns-node-resolver/0.log"
Sep 18 20:22:40.301639 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:40.301613    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zqk5q_19f67046-5187-4f84-b4ad-1ef94c8a8e27/node-ca/0.log"
Sep 18 20:22:41.209538 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:41.209507    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v_dc62143b-2654-44c3-96fb-1f14212e2eea/istio-proxy/0.log"
Sep 18 20:22:41.762660 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:41.762629    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-kzpkn_aac4f276-f608-45b1-afe6-9c766feef714/discovery/0.log"
Sep 18 20:22:41.918057 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:41.917996    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-679f8486cd-4ktr5_2d739ea5-66dc-4a3c-83b6-59d21c3054e5/router/0.log"
Sep 18 20:22:42.846159 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:42.846132    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n4mp2_77200409-483c-4a0f-bc4c-51980845fa8e/serve-healthcheck-canary/0.log"
Sep 18 20:22:43.418924 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:43.418899    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f8svn_296d30f9-5ce1-4b50-a561-52e035e9864a/kube-rbac-proxy/0.log"
Sep 18 20:22:43.439327 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:43.439300    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f8svn_296d30f9-5ce1-4b50-a561-52e035e9864a/exporter/0.log"
Sep 18 20:22:43.461333 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:43.461304    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f8svn_296d30f9-5ce1-4b50-a561-52e035e9864a/extractor/0.log"
Sep 18 20:22:44.831747 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:44.831711    2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ts5cd/perf-node-gather-daemonset-jtwf8"
Sep 18 20:22:46.276799 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:46.276756    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd4fcf9c7-smtdb_a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8/manager/0.log"
Sep 18 20:22:46.293736 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:46.293709    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-bd4fcf9c7-smtdb_a6d4d0fc-c3ce-4a76-8721-d3d9507a60e8/copy-manifests/0.log"
Sep 18 20:22:47.710246 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:47.710103    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5947d9d788-5jv2c_628b59fe-16f3-4355-b177-a3045b4b0b34/manager/0.log"
Sep 18 20:22:47.775269 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:47.775235    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-75lvb_4bbf1fbd-f8c4-4cea-9a17-1ff5a8e6fa99/openshift-lws-operator/0.log"
Sep 18 20:22:48.252072 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:48.252019    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v_dc62143b-2654-44c3-96fb-1f14212e2eea/istio-proxy/0.log"
Sep 18 20:22:48.842623 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:48.842567    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-kzpkn_aac4f276-f608-45b1-afe6-9c766feef714/discovery/0.log"
Sep 18 20:22:48.949301 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:48.949269    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-679f8486cd-4ktr5_2d739ea5-66dc-4a3c-83b6-59d21c3054e5/router/0.log"
Sep 18 20:22:50.431647 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:50.431615    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-fgl4v_dc62143b-2654-44c3-96fb-1f14212e2eea/istio-proxy/0.log"
Sep 18 20:22:51.022702 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:51.022663    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-kzpkn_aac4f276-f608-45b1-afe6-9c766feef714/discovery/0.log"
Sep 18 20:22:51.148316 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:51.148290    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-679f8486cd-4ktr5_2d739ea5-66dc-4a3c-83b6-59d21c3054e5/router/0.log"
Sep 18 20:22:52.975728 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:52.975686    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-srf6t_5f7398bc-780a-40de-8214-60efb6295e06/migrator/0.log"
Sep 18 20:22:52.997263 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:52.997232    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-76794cbd6c-srf6t_5f7398bc-780a-40de-8214-60efb6295e06/graceful-termination/0.log"
Sep 18 20:22:53.345060 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:53.345015    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-cdh8l_793a4f9c-0c8b-4ade-b72d-38db5bd23628/kube-storage-version-migrator-operator/1.log"
Sep 18 20:22:53.346187 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:53.346156    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55889f7b47-cdh8l_793a4f9c-0c8b-4ade-b72d-38db5bd23628/kube-storage-version-migrator-operator/0.log"
Sep 18 20:22:54.529057 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:54.529012    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hv4r5_56f66ac8-8aa6-4fbb-b20a-5f89e15fa483/kube-multus-additional-cni-plugins/0.log"
Sep 18 20:22:54.551470 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:54.551446    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hv4r5_56f66ac8-8aa6-4fbb-b20a-5f89e15fa483/egress-router-binary-copy/0.log"
Sep 18 20:22:54.572375 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:54.572349    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hv4r5_56f66ac8-8aa6-4fbb-b20a-5f89e15fa483/cni-plugins/0.log"
Sep 18 20:22:54.593060 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:54.593012    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hv4r5_56f66ac8-8aa6-4fbb-b20a-5f89e15fa483/bond-cni-plugin/0.log"
Sep 18 20:22:54.614774 ip-10-0-135-240 kubenswrapper[2583]: I0918 20:22:54.614748    2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hv4r5_56f66ac8-8aa6-4fbb-b20a-5f89e15fa483/routeoverride-cni/0.log"